Oprano Adult Industry Forums

Oprano Adult Industry Forums (http://www.oprano.com/msgboard/index.php)
-   Legacy Archived Main Board (http://www.oprano.com/msgboard/forumdisplay.php?f=25)
-   -   Letting spiders in (http://www.oprano.com/msgboard/showthread.php?t=42465)

Damian 08-11-2005 06:25 AM

Letting spiders in
 
Hi

New here, so apologies if this is dull/OT/etc

I want to let search engine spiders in behind my registration so they can see the depth and breadth of content and how often we refresh it.

Anyone got a clue on how to do this as I don't!

Thanks in advance.

Damian Jennings
http://www.playboy.co.uk

Newton 08-11-2005 08:57 AM

Re: Letting spiders in
 
The only question that is dull/ot/etc is the one that you don't ask .. so ask away and welcome to Oprano ;)

Jace 08-11-2005 08:53 PM

Re: Letting spiders in
 
Quote:

Originally Posted by Newton
The only question that is dull/ot/etc is the one that you don't ask .. so ask away and welcome to Oprano ;)

he already did

sarettah 08-11-2005 09:27 PM

Re: Letting spiders in
 
Quote:

Originally Posted by Damian
Hi
New here, so apologies if this is dull/OT/etc

I want to let search engine spiders in behind my registration so they can see the depth and breadth of content and how often we refresh it.

Anyone got a clue on how to do this as I don't!

I have several sites that I do that on. They are all php sites so I have a routine at the top that checks for known user agents, some I let in, some I don't. So, it would deppend on what exatcly your "registration" is. Is it a pay site or just a site you have to join to get into the back pages of ?

Oh, wlecom to the board btw :)

sarettah 08-11-2005 09:27 PM

Re: Letting spiders in
 
Quote:

Originally Posted by JaceXXX
he already did

You, my friend, have email :okthumb:

Nickatilynx 08-11-2005 11:05 PM

Re: Letting spiders in
 
there are many ways to allow visitors you want to to spider your site , and prevent those you want to not.

Hell you can send some IPs one way , some the other. :)


All times are GMT -4. The time now is 11:36 AM..

Powered by vBulletin® Version 3.7.4
Copyright ©2000 - 2026, Jelsoft Enterprises Ltd.
Copyright Evil Empire Inc. 2006-2022