Site Links
Home
Features
Documentation
Pricing & Order
Members Area
Support Options
UBBDev.com
UBBWiki.com
Who's Online
7 registered (nims2, Ruben, Mike L, Dunny, Bjab, Gizmo, Bert), 24 Guests and 14 Spiders online.
Key: Admin, Global Mod, Mod
Featured Member
Registered: 04/22/10
Posts: 5
Top Posters (30 Days)
Ruben 65
SD 55
Gizmo 48
gliderdad 33
Dunny 21
driv 18
Iann128 16
dbremer 16
Stan 15
Mark S 13
Latest Photos
Testing
Basildon Train Station
Basildon Town Centre looking from the rounderbout
Basildon Town Square
Gizzo Marx
Topic Options
#188371 - 06/23/07 12:14 AM How do I BLOCK search engines?
Gizmo Online   cat

Registered: 06/05/06
Posts: 14904
Loc: Portland, OR; USA
Well, there are several options if you're in the boat that you want to block Search Engines from crawling your forums alltogether.

A good "first step" is to disable SE Friendly URLs, myself I don't like doing this, it's much easier on the eyes and the urls look ugly.

Please note however that this will NOT block search engines, it'll simply make it more difficult for them to crawl your content; so it's not an end-all be-all sugguestion.

If the Search Engine respects robots.txt standards, it's even easier (most non-abusive search engines support this), just edit (or add) your robots.txt file (in your web root) and add the following:
 Code:
User-agent: *
Disallow: /forum


Be sure however to update /forum with whatever your forum's location is (from your domain's web root); so if your forum is in http://www.ubbcentral.com/forums/ you'd enter "/forums" (no trailing slash).
_________________________
Forums: UGN Security & VNC Web Design & Development
UBB.Threads: UBB.Wiki, My UBBSkins, UBB.Sitemaps
Longtime UBB Supporter, UBB Beta Tester & Resident Post-A-Holic.
UBB Modifications, Styling, Coding Services, Disaster Recovery, and more!
Top
Express Hosting
Express Hosting "We are the official hosting company of UBB.threads. Ask us about our free migration services to migrate your UBB.threads installation."



Shout Box

Today's Birthdays
No Birthdays
Recent Topics
Edit Post
by Bert
Today at 01:19 PM
A positive note
by SteveS
Yesterday at 09:36 PM
How to locate links to particular site if they are only used in images?
by Conrad
02/10/12 09:41 PM
Pictures not displaying
by Marker23
02/09/12 10:04 PM
Issue with logging out constantly
by Flanuva
02/09/12 07:05 PM
Forum Stats
10213 Members
36 Forums
33667 Topics
180917 Posts

Max Online: 978 @ 06/24/07 11:19 PM
Random Image