Locating robots.txt file? - UBB.threads PHP Forum Software Community

You are not logged in. [Log In] UBB.threads PHP Forum Software Community » Forums » UBB.threads 7 Discussion » General Assistance (How Do I?) » Locating robots.txt file?

Site Links

Home
Features
Documentation
Pricing & Order
Members Area
Support Options
UBBDev.com
UBBWiki.com

Top Posters (30 Days)

Ruben	50
DennyP	24
Gizmo	23
Dunny	15
SteveS	13
AllenAyres	12
dbremer	10
SD	10
drkknght00	9
doug	8

Latest Photos

Basildon Town Centre looking from the rounderbout

Topic Options

#242309 - 03/25/11 10:21 AM

Locating robots.txt file?

tacks

member

Registered: 03/31/09
Posts: 166

I'm on UBB 7.5. And i can't figure out where this file is. (Maybe I don't even have one.)

I am completely lost.

Thanks in advance for your help.

Top

Express Hosting

Express Hosting "We are the official hosting company of UBB.threads. Ask us about our free migration services to migrate your UBB.threads installation."

#242310 - 03/25/11 10:37 AM

Re: Locating robots.txt file? [Re: tacks]

gliderdad Offline

Registered: 06/08/06
Posts: 1466
Loc: NY

robots.txt should be in your public directory not in ubb threads. It would be in the same place your sites index file is for your domain. You may have to create the file as it's not automatically there.

ex: /home/yoursite/htdocs/ or /home/yoursite/public_html/

Top

#242312 - 03/25/11 10:47 AM

Re: Locating robots.txt file? [Re: gliderdad]

tacks

member

Registered: 03/31/09
Posts: 166

Thanks gliderdad,

It seems i might need create one. I'll have a look later.

tacks

Top

#242336 - 03/25/11 08:06 PM

Re: Locating robots.txt file? [Re: tacks]

Gizmo

Registered: 06/05/06
Posts: 14995
Loc: Portland, OR; USA

robots.txt should always be at your web root, it's something you'll have to make yourself.

An example would be:

Code:

User-agent: *
Crawl-Delay: 3
Disallow: /forum/ubbthreads.php?ubb=calendar
Disallow: /forum/ubbthreads.php/ubb/calendar
Disallow: /forum/ubbthreads.php?ubb=showday
Disallow: /forum/ubbthreads.php/ubb/showday
Disallow: /forum/ubbthreads.php?ubb=showprofile
Disallow: /forum/ubbthreads.php/ubb/showprofile
Disallow: /forum/ubbthreads.php?ubb=showmembers
Disallow: /forum/ubbthreads.php/ubb/showmembers

_________________________
Forums: UGN Security & VNC Web Design & Development
UBB.Threads: UBB.Wiki, My UBBSkins, UBB.Sitemaps
Longtime UBB Supporter, UBB Beta Tester & Resident Post-A-Holic.
UBB Modifications, Styling, Coding Services, Disaster Recovery, and more!

Top

#242343 - 03/26/11 08:18 AM

Re: Locating robots.txt file? [Re: tacks]

driv

Pooh-Bah

Registered: 01/10/04
Posts: 2377

A handy link http://www.robotstxt.org/robotstxt.html

_________________________
Using version :: 7.5.6

Top

#242344 - 03/26/11 09:04 AM

Re: Locating robots.txt file? [Re: tacks]

tacks

member

Registered: 03/31/09
Posts: 166

Hey Giz and Driv, God bless. Much appreciated, as always.

Top

#242347 - 03/26/11 03:07 PM

Re: Locating robots.txt file? [Re: tacks]

Gizmo

Registered: 06/05/06
Posts: 14995
Loc: Portland, OR; USA

Some sites *ahem* get kinda funny in their boring old robots.txt...

Code:

# robots.txt for http://www.undergroundnews.com/
# A robot may not injure a human being or through inaction allow a human being to come to harm.
# A robot must obey the orders given it by human beings, except where such orders would conflict with the First Law
# A robot must protect its own existence, as long as such protection does not conflict with the First or Second Laws.
User-agent: zombies
Disallow: /brains
User-agent: unclesam
Disallow: /pocketbook

Top

Previous Topic

Index

Next Topic

Hop to:

Moderator: AllenAyres, Harold, Ian, Ron M

Shout Box

May
Su	M	Tu	W	Th	F	Sa
		1	2	3	4	5
6	7	8	9	10	11	12
13	14	15	16	17	18	19
20	21	22	23	24	25	26
27	28	29	30	31

Today's Birthdays

No Birthdays