it spidered more pages over the weekend than it's done in the entire month of February...

we were swarmed by bots today.

Googlebot 28334
the number was 13,000+ on Friday nite

wow,
google goes for broke!

Robots/Spiders Last visit
Googlebot 54350 22 Feb 2005 - 07:01

..and the saddest part is:
we are not anywhere near to the top in Google...

once a month they hit my forums with about 600 at a time

and? what is the end result?

As I understand it Google maintains a list of all the domains it can find. It then sends its spiders out to grab their content one by one. There are a whole lot of domains so it takes the spiders a month or so to run through them all. But when they hit your domain they look at every page they can find and update their records where neccessary. So every month or so you will see them spider you.

Then, my best guess is every couple of months they reindex the whole directory with the new info that they have. That's when you'll go up or down in position.

N.B. I don't work for Google so this is just my best guess :)

google spiders as often as i tell it too .. every day :)

i hope you are not talking about the comeback in x days tag. <_<