Portal Forums Calendar Active Threads
Previous Thread
Next Thread
Print Thread
Hop To
spiders
#240852 12/30/2010 12:41 AM
Joined: Aug 2010
Posts: 21
A
Allen2010
Offline
stranger
Allen2010
stranger
A Offline
Joined: Aug 2010
Posts: 21
how do i keep spiders from spidering any part of my forums
Re: spiders
Allen2010 #240853 12/30/2010 12:56 AM
Joined: Jun 2006
Posts: 1,344
NY
G
gliderdad Offline
veteran
gliderdad
veteran
G Offline
Joined: Jun 2006
Posts: 1,344
NY
create a robots.txt file in your public directory and add something like this

User-agent: *
Disallow: /forum_dir/
Re: spiders
Allen2010 #240856 12/30/2010 12:15 PM
Joined: Jan 2004
Posts: 2,474
Likes: 3
D
driv Offline
Pooh-Bah
driv
Pooh-Bah
D Offline
Joined: Jan 2004
Posts: 2,474
Likes: 3


Link Copied to Clipboard
ShoutChat
Comment Guidelines: Do post respectful and insightful comments. Don't flame, hate, spam.
Recent Topics
Bots
by Outdoorking - 04/13/2024 5:08 PM
Can you add html to language files?
by Baldeagle - 04/07/2024 2:41 PM
Do I need to rebuild my database?
by Baldeagle - 04/07/2024 2:58 AM
This is not a bug, but a suggestion
by Baldeagle - 04/05/2024 11:25 PM
Is UBB.threads still going?
by Aaron101 - 04/01/2022 8:18 AM
Who's Online Now
1 members (1 invisible), 631 guests, and 152 robots.
Key: Admin, Global Mod, Mod
Random Gallery Image
Latest Gallery Images
Los Angeles
Los Angeles
by isaac, August 6
3D Creations
3D Creations
by JAISP, December 30
Artistic structures
Artistic structures
by isaac, August 29
Stones
Stones
by isaac, August 19
Forum Rules · Mark All Read Contact Us · Forum Help · UBBCentral
Powered by UBB.threads™ PHP Forum Software 8.0.0
(Preview build 20240501)