|
|
|
|
Joined: Jun 2006
Posts: 1,344
veteran
|
|
veteran
Joined: Jun 2006
Posts: 1,344 |
You will need to do a robot.txt file, but not all spiders play nice http://www.robotstxt.org/robotstxt.html
Last edited by gliderdad; 03/30/2011 9:44 PM.
|
|
|
|
|
Bots
by Outdoorking - 04/13/2024 5:08 PM
|
|
|
|
|
0 members (),
836
guests, and
180
robots. |
|
Key:
Admin,
Global Mod,
Mod
|
|
|
|
|
|
