Google went beserk today...

Winetalk.com · 02-20-2005

it spidered more pages over the weekend than it's done in the entire month of February...

we were swarmed by bots today.

Googlebot 28334
the number was 13,000+ on Friday nite

Winetalk.com · 02-22-2005

wow,
google goes for broke!

Robots/Spiders Last visit
Googlebot 54350 22 Feb 2005 - 07:01

..and the saddest part is:
we are not anywhere near to the top in Google...

Titan · 02-22-2005

once a month they hit my forums with about 600 at a time

Winetalk.com · 02-22-2005

Quote:

Originally posted by Titan@Feb 22 2005, 01:53 PM
once a month they hit my forums with about 600 at a time

and? what is the end result?

02-22-2005

As I understand it Google maintains a list of all the domains it can find. It then sends its spiders out to grab their content one by one. There are a whole lot of domains so it takes the spiders a month or so to run through them all. But when they hit your domain they look at every page they can find and update their records where neccessary. So every month or so you will see them spider you.

Then, my best guess is every couple of months they reindex the whole directory with the new info that they have. That's when you'll go up or down in position.

N.B. I don't work for Google so this is just my best guess

Titan · 02-23-2005

google spiders as often as i tell it too .. every day

Inabon · 02-25-2005

Quote:

Originally posted by Titan@Feb 23 2005, 01:18 PM
google spiders as often as i tell it too .. every day

i hope you are not talking about the comeback in x days tag. <_<

02-20-2005	#1
Winetalk.com Prostate Examiner I quoff fine wine at corkd.com Join Date: Oct 2002 Location: good 'ole USA Posts: 21,018	it spidered more pages over the weekend than it's done in the entire month of February... we were swarmed by bots today. Googlebot 28334 the number was 13,000+ on Friday nite __________________ why dogs sniff each other butts?

02-22-2005	#2
Winetalk.com Prostate Examiner I quoff fine wine at corkd.com Join Date: Oct 2002 Location: good 'ole USA Posts: 21,018	wow, google goes for broke! Robots/Spiders Last visit Googlebot 54350 22 Feb 2005 - 07:01 ..and the saddest part is: we are not anywhere near to the top in Google... __________________ why dogs sniff each other butts?

Thread Tools
Show Printable Version Email this Page
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode

02-22-2005	#3
Titan Members Join Date: Jan 2005 Posts: 492	once a month they hit my forums with about 600 at a time

02-22-2005	#5
imported_Technick Guest Posts: n/a	As I understand it Google maintains a list of all the domains it can find. It then sends its spiders out to grab their content one by one. There are a whole lot of domains so it takes the spiders a month or so to run through them all. But when they hit your domain they look at every page they can find and update their records where neccessary. So every month or so you will see them spider you. Then, my best guess is every couple of months they reindex the whole directory with the new info that they have. That's when you'll go up or down in position. N.B. I don't work for Google so this is just my best guess

02-23-2005	#6
Titan Members Join Date: Jan 2005 Posts: 492	google spiders as often as i tell it too .. every day