456 se spiders; all but 1 being yahoo lol

I had two pages of it. But only used in the most innocent of ways.

Speaking of search bots, I have a question. I don't really get many search bots - maybe four or five at a time. I've always thought it was because I don't have the following checked in the CP.

Enable Spider-friendly URLs?
Warning: This function allows search engine spiders to crawl the community, which may result in higher bandwidth usage and server load.

Note: The PATH_INFO environmental variable must be available for this feature to function properly.

The reason I don't have this checked, is because I don't want individual posts coming up in search results in Google and other engines. Do I have a correct understanding of this function?

Just wondering.

SE Friendly urls make it "easier" for SE's to troll your board, yes; though not impossible

But am I right in thinking that if I have that box checked, individual posts will appear in search engine results?

All that box will do is help SE's spider pages easier; they can spide without the option.

And if pages are included in google then yes, individual posts will be in there too.

You'll find that even the most mudayne posts will bring in users from search engines lol

hrm. so if i post sex slave midget and then

a real serious post, google will bring em on in..

note to self.. preface all posts with above words

lol, kinda ;)...

Our most popular incoming thread at UGN?? HotChicks thread... Kinda like UBB.Central's longest thread lol

Well, my users are totally against having individual posts listed in search engines, and so am I really. I guess I'll leave that unchecked.

well, see, it's not just individual posts; it's the entire topics (and as individual posts are a PART of the topic, they're included as well).

BTW, nothings to say that they won't crawl it anyway, unless you have a robots.txt rule to specificaly tell search engines not to crawl your forums.

I've tried searching for posts on Google, and they don't come up. People talk about some real personal stuff on my forums, and I'd really hate to see those come up in search results.

I do have a robots.txt, but I don't restrict the forums.