Letting spiders in

Damian · 08-11-2005

Hi

New here, so apologies if this is dull/OT/etc

I want to let search engine spiders in behind my registration so they can see the depth and breadth of content and how often we refresh it.

Anyone got a clue on how to do this as I don't!

Thanks in advance.

Damian Jennings
http://www.playboy.co.uk

Newton · 08-11-2005

The only question that is dull/ot/etc is the one that you don't ask .. so ask away and welcome to Oprano

Jace · 08-11-2005

Quote:

Originally Posted by Newton

The only question that is dull/ot/etc is the one that you don't ask .. so ask away and welcome to Oprano

he already did

sarettah · 08-11-2005

Quote:

Originally Posted by Damian

Hi
New here, so apologies if this is dull/OT/etc

I want to let search engine spiders in behind my registration so they can see the depth and breadth of content and how often we refresh it.

Anyone got a clue on how to do this as I don't!

I have several sites that I do that on. They are all php sites so I have a routine at the top that checks for known user agents, some I let in, some I don't. So, it would deppend on what exatcly your "registration" is. Is it a pay site or just a site you have to join to get into the back pages of ?

Oh, wlecom to the board btw

sarettah · 08-11-2005

Quote:

Originally Posted by JaceXXX

he already did

You, my friend, have email

Nickatilynx · 08-11-2005

there are many ways to allow visitors you want to to spider your site , and prevent those you want to not.

Hell you can send some IPs one way , some the other.

08-11-2005	#1
Damian Trying to get enough posts to spam a link I'm new! Join Date: Aug 2005 Posts: 1	Letting spiders in Hi New here, so apologies if this is dull/OT/etc I want to let search engine spiders in behind my registration so they can see the depth and breadth of content and how often we refresh it. Anyone got a clue on how to do this as I don't! Thanks in advance. Damian Jennings http://www.playboy.co.uk

08-11-2005	#2
Newton It's always business, never personal! The POWER of radio Oprano Radio Join Date: Aug 2004 Location: On a golf course Posts: 4,916	Re: Letting spiders in The only question that is dull/ot/etc is the one that you don't ask .. so ask away and welcome to Oprano __________________ Poser Bush in a mix-up over his hi-tech gizmo - ICLOD

08-11-2005	#6
Nickatilynx Banned Want to see your own Advertising Here! Join Date: Oct 2002 Location: Vancouver Canada Posts: 15,115	Re: Letting spiders in there are many ways to allow visitors you want to to spider your site , and prevent those you want to not. Hell you can send some IPs one way , some the other.