|
|
|
|
Joined: Mar 2009
Posts: 180
member
|
|
member
Joined: Mar 2009
Posts: 180 |
I'm on UBB 7.5. And i can't figure out where this file is. (Maybe I don't even have one.)
I am completely lost.
Thanks in advance for your help.
|
|
|
|
|
Joined: Jun 2006
Posts: 1,344
veteran
|
|
veteran
Joined: Jun 2006
Posts: 1,344 |
robots.txt should be in your public directory not in ubb threads. It would be in the same place your sites index file is for your domain. You may have to create the file as it's not automatically there.
ex: /home/yoursite/htdocs/ or /home/yoursite/public_html/
|
|
|
|
|
Joined: Mar 2009
Posts: 180
member
|
|
member
Joined: Mar 2009
Posts: 180 |
Thanks gliderdad,
It seems i might need create one. I'll have a look later.
tacks
|
|
|
|
|
Joined: Jun 2006
Posts: 16,299 Likes: 116
|
|
Joined: Jun 2006
Posts: 16,299 Likes: 116 |
robots.txt should always be at your web root, it's something you'll have to make yourself. An example would be: User-agent: *
Crawl-Delay: 3
Disallow: /forum/ubbthreads.php?ubb=calendar
Disallow: /forum/ubbthreads.php/ubb/calendar
Disallow: /forum/ubbthreads.php?ubb=showday
Disallow: /forum/ubbthreads.php/ubb/showday
Disallow: /forum/ubbthreads.php?ubb=showprofile
Disallow: /forum/ubbthreads.php/ubb/showprofile
Disallow: /forum/ubbthreads.php?ubb=showmembers
Disallow: /forum/ubbthreads.php/ubb/showmembers
|
|
|
|
|
Joined: Jan 2004
Posts: 2,474 Likes: 3
Pooh-Bah
|
|
Pooh-Bah
Joined: Jan 2004
Posts: 2,474 Likes: 3 |
|
|
|
|
|
Joined: Mar 2009
Posts: 180
member
|
|
member
Joined: Mar 2009
Posts: 180 |
Hey Giz and Driv, God bless. Much appreciated, as always.
|
|
|
|
|
Joined: Jun 2006
Posts: 16,299 Likes: 116
|
|
Joined: Jun 2006
Posts: 16,299 Likes: 116 |
Some sites *ahem* get kinda funny in their boring old robots.txt... # robots.txt for http://www.undergroundnews.com/
# A robot may not injure a human being or through inaction allow a human being to come to harm.
# A robot must obey the orders given it by human beings, except where such orders would conflict with the First Law
# A robot must protect its own existence, as long as such protection does not conflict with the First or Second Laws.
User-agent: zombies
Disallow: /brains
User-agent: unclesam
Disallow: /pocketbook
|
|
|
Bots
by Outdoorking - 04/13/2024 5:08 PM
|
|
|
|
|
|
|
|
|
|
|
1 members (Napalm),
806
guests, and
165
robots. |
|
Key:
Admin,
Global Mod,
Mod
|
|
|
|
|
|
