|
|
Joined: Jun 2006
Posts: 1,344
veteran
|
veteran
Joined: Jun 2006
Posts: 1,344 |
You will need to do a robot.txt file, but not all spiders play nice http://www.robotstxt.org/robotstxt.html
Last edited by gliderdad; 03/30/2011 9:44 PM.
|
|
|
Test
by Phun - 05/28/2024 7:31 PM
|
|
|
|
1 members (Nightcrawler),
352
guests, and
159
robots. |
Key:
Admin,
Global Mod,
Mod
|
|
|
|
|