The proper usage of the robot.txt file - Oprano Adult Industry Forums

Oprano Front Page

		Oprano Adult Industry Forums > The Business Of Porn - Closed For Posting > Legacy Archived Main Board
The proper usage of the robot.txt file

Notices

If your considering copy and pasting your latest drive by spam here because you cant find any other place.

DONT!

Oprano has a ZERO tolerance policy for spam. Yours WILL be deleted. If you are looking for more exposure for your product please contact advertising@oprano.com for more information.

Legacy Archived Main Board Business chat and general industry chat. All participation is welcome. Dont post your fucking spam here.

Check Out YnotMail

The Original Oprano Flat Board (Thanks To Sarettah!)--- Oprano Swag Shop "History Of Porn Timeline

Thread Tools

Display Modes

03-18-2005	#4
iknowalttl Members Join Date: Mar 2005 Location: Florida Posts: 215	Would there be any reason to allow spiders to crawl any folders other than the html and ftp public folders? Would I be hurting myself in anyway to disallow all folders except these? __________________ Got Lifeforce?

Bookmarks

Google

« Previous Thread | Next Thread »

Posting Rules
You may not post new threads You may not post replies You may not post attachments You may not edit your posts BB code is On Smilies are On [IMG] code is On HTML code is On

All times are GMT -4. The time now is 07:05 PM..