Previous Thread
Next Thread
Print Thread
Hop To
#221267 01/18/2009 11:43 PM
Joined: Jan 2009
Posts: 34
C
newbie
newbie
C Offline
Joined: Jan 2009
Posts: 34
Is there any way to improve the ability of the pages in a forum being listed in the search engines? The index page of my forum lists well with the search engines but none of the others.


Capt. Clay C
Capt. Clay C #221268 01/18/2009 11:51 PM
Joined: Jun 2006
Posts: 16,292
Likes: 116
UBB.threads Developer
UBB.threads Developer
Joined: Jun 2006
Posts: 16,292
Likes: 116
Well, SE Friendly URLs are a good start (option in UBB.T), and a sitemap is also helpful (I have a paid mod that lists out all of your forum topics in a sitemap; click here for more information)


I am a Web Development Contractor, I do not work for UBBCentral. I have provided free User to User Support since the beginning of these support forums.
Do you need Forum Install or Upgrade Services?
Forums: A Gardeners Forum, Scouters World
UBB.threads: UBBWiki, UBB Styles, UBB.Sitemaps
Longtime Supporter & Resident Post-A-Holic
VNC Web Services: Code Modifications, Upgrades, Styling, Coding Services, Disaster Recovery, and more!
Gizmo #221329 01/20/2009 2:07 PM
Joined: Jan 2009
Posts: 34
C
newbie
newbie
C Offline
Joined: Jan 2009
Posts: 34
I must be blind because I am missing the option. I expected it to be there. I will check into your site about the sitemap as well.


Capt. Clay C
Joined: Dec 2003
Posts: 6,560
Likes: 78
Joined: Dec 2003
Posts: 6,560
Likes: 78
You have two options in the control panel.
Control Panel ยป Primary Settings

Enable Spider-friendly URLs?
Warning: This function allows most search engine spiders to crawl the community and also allows for specially formatted URLs, which may result in higher bandwidth usage and server load.

Note: The PATH_INFO environmental variable must be available for this feature to function properly.

Enable HTML Extension:

At least I think they are both there for your version.

Last edited by Ruben Rocha; 01/20/2009 2:31 PM.

Blue Man Group
There is no such thing as stupid questions. Just stupid answers
Ruben #221333 01/20/2009 3:04 PM
Joined: Jun 2006
Posts: 16,292
Likes: 116
UBB.threads Developer
UBB.threads Developer
Joined: Jun 2006
Posts: 16,292
Likes: 116
Enable Spider-frinedly has been there since 7.0; html extension was added in 7.3 i think?

There are some SEO options since 7.3 as well i believe.


I am a Web Development Contractor, I do not work for UBBCentral. I have provided free User to User Support since the beginning of these support forums.
Do you need Forum Install or Upgrade Services?
Forums: A Gardeners Forum, Scouters World
UBB.threads: UBBWiki, UBB Styles, UBB.Sitemaps
Longtime Supporter & Resident Post-A-Holic
VNC Web Services: Code Modifications, Upgrades, Styling, Coding Services, Disaster Recovery, and more!
Gizmo #221338 01/20/2009 5:24 PM
Joined: Jan 2009
Posts: 34
C
newbie
newbie
C Offline
Joined: Jan 2009
Posts: 34
Sounds like I need to get off my butt and get updated. I found where to update the spider url but the note below has me pausing bc I have no idea what it means. What do I do to get that variable available?
Note: The PATH_INFO environmental variable must be available for this feature to function properly.

Thanks for the help ,


Capt. Clay C
Joined: Dec 2003
Posts: 6,560
Likes: 78
Joined: Dec 2003
Posts: 6,560
Likes: 78
One place to look is in the control panel>phpinfo.
Scroll through the list looking for path_info.

It may not show even though it is available.

If you are on a linux server it is probably enabled.
There are may topics on path_info here just search for them.

But just login to your control panel change the setting.
Don't logout
Open another browser and visit your forum.
If PAth_info is not set you will get a file not found.
If you do just open your browser that is logged in and switch it back.

Then you can research why by searching here.

Here Is one topic to test for path_info

Last edited by Ruben Rocha; 01/20/2009 5:50 PM.

Blue Man Group
There is no such thing as stupid questions. Just stupid answers
Ruben #221340 01/20/2009 6:02 PM
Joined: Jan 2009
Posts: 34
C
newbie
newbie
C Offline
Joined: Jan 2009
Posts: 34
I changed the setting so spider friendly URls are enabled and the forum is working fine so that should mean it worked correct?


Capt. Clay C
Joined: Dec 2003
Posts: 6,560
Likes: 78
Joined: Dec 2003
Posts: 6,560
Likes: 78
Yes,
I just visited your site.
If you notice the urls look different now when you goto different topics and forums.


Blue Man Group
There is no such thing as stupid questions. Just stupid answers
Ruben #221350 01/20/2009 8:34 PM
Joined: Jun 2006
Posts: 16,292
Likes: 116
UBB.threads Developer
UBB.threads Developer
Joined: Jun 2006
Posts: 16,292
Likes: 116
yeh, my sugguestion was going to be "Enable it, then poke around your forums, if it isn't broken, it's on" lol


I am a Web Development Contractor, I do not work for UBBCentral. I have provided free User to User Support since the beginning of these support forums.
Do you need Forum Install or Upgrade Services?
Forums: A Gardeners Forum, Scouters World
UBB.threads: UBBWiki, UBB Styles, UBB.Sitemaps
Longtime Supporter & Resident Post-A-Holic
VNC Web Services: Code Modifications, Upgrades, Styling, Coding Services, Disaster Recovery, and more!
Gizmo #221617 01/26/2009 3:56 PM
Joined: Feb 2006
Posts: 6
E
stranger
stranger
E Offline
Joined: Feb 2006
Posts: 6
Hey Gizmo-

You seem to be at the leading edge of search engine promotion with respects to the UBB Threads board and generating a sitemap for it.

I am an ASP programmer and had already written code a few years ago that used the File Scripting Object to iterate through all the flat files generated by the old UBB and generate URL's to all the posts and topics for inclusion in my sitemap.

We switched to Threads 7.2 several months ago, and I just now got around to modifying my sitemap generator to include the Threads-based URLs.

I basically just wrote code that uses ADO to open the MySQL database and iterate through the ubbt_topics, ubbt_posts, and ubbt_users tables to generate all the possible URLs.

I'm sure the resulting XML that is written is correctly formatted and valid, but much to my dismay, after submitting the newly generated sitemap to Google, they aren't indexing ANY of the URLs!

Did you have any problems with Google not indexing the URLs your sitemap generator generates? Did it just take a while for them to get around to indexing them?

The sitemap in question doesn't just include generated URLs for the Threads board, but also from our inventory database and other sources.

If you want to see what my URL's look like, it is located at http://www.myfootshop.com/myfootshopcom-sitemap.xml
It includes over 33,000 URLs, but the first ones in the XML file are the Threads URLs.

embryo #221618 01/26/2009 4:34 PM
Joined: Jun 2006
Posts: 16,292
Likes: 116
UBB.threads Developer
UBB.threads Developer
Joined: Jun 2006
Posts: 16,292
Likes: 116
Well, theres a couple of hints for you... You should limit your sitemap to 25k urls per page, use a sitemap index if you need to go over.

Theres no need to have your users or posts in a sitemap, all you need is the topic link as the posts will all go here, you'll just be feeding it more data than it needs.

A sitemap won't get all of your stuff crawled overnight; you're simply aiding the SE's discovery bot in finding new content, it can still take months for all of that yummy content to get indexed.

A huge sitemap will cause strain on your server, the sitemap index will definately help ease requests, especially if the sitemap itself isn't cached and builds live, you'll be putting strain on the sql server for having it push out all possible urls.

Also, try avoiding duplicate URLs, once it has a url it'll crawl all possible urls on that page, feeding it say 5 possible urls to the same page is simply going to bog down the request time...


I am a Web Development Contractor, I do not work for UBBCentral. I have provided free User to User Support since the beginning of these support forums.
Do you need Forum Install or Upgrade Services?
Forums: A Gardeners Forum, Scouters World
UBB.threads: UBBWiki, UBB Styles, UBB.Sitemaps
Longtime Supporter & Resident Post-A-Holic
VNC Web Services: Code Modifications, Upgrades, Styling, Coding Services, Disaster Recovery, and more!
Gizmo #227707 07/18/2009 1:23 AM
Joined: Feb 2007
Posts: 36
newbie
newbie
Joined: Feb 2007
Posts: 36
Okay....I have an issue.

I am running 7.5.3 on a Linux server hosted @ godaddy. I am having a problem. When I enable "Spider Friendly search engines" then I get an "access denied" error. I deselect the spider friendly box, and all goes back to normal.

I pulled up my php info box, and I found this reference to path_info:

PATH_INFO /forums/admin/phpinfo_iframe.php

I have looked through the forums to see what I can do to fix this issue, and I have not found anything. I assume that this is on godaddy's end and not through UBB, but I don't know what to ask their tech team to do to fix the issue. Any help you could offer would be appreciated!!

J. Holly #227708 07/18/2009 1:55 AM
Joined: Jun 2006
Posts: 16,292
Likes: 116
UBB.threads Developer
UBB.threads Developer
Joined: Jun 2006
Posts: 16,292
Likes: 116
Well, there isn't much you can do if your host doesn't support Path_Info; they can simply add this to your apache user:
AcceptPathInfo On

Or, if for whatever reason they've allowed it, you can add that to a .htaccess file, but this only works if they've allowed you privileges to override their settings (which most hosts won't allow).


I am a Web Development Contractor, I do not work for UBBCentral. I have provided free User to User Support since the beginning of these support forums.
Do you need Forum Install or Upgrade Services?
Forums: A Gardeners Forum, Scouters World
UBB.threads: UBBWiki, UBB Styles, UBB.Sitemaps
Longtime Supporter & Resident Post-A-Holic
VNC Web Services: Code Modifications, Upgrades, Styling, Coding Services, Disaster Recovery, and more!
Gizmo #227709 07/18/2009 3:13 AM
Joined: Feb 2007
Posts: 36
newbie
newbie
Joined: Feb 2007
Posts: 36
I talked to the host, and they indicated that it is ON, and I do have access....now to figure out the .htaccess thing.

Do you have any recommendations on a good place for a beginner to learn how to do this? I will be searching this site and the web also, but if this has been answered before, I would appreciate a nod in the right direction.

J. Holly #227713 07/18/2009 3:51 AM
Joined: Feb 2007
Posts: 36
newbie
newbie
Joined: Feb 2007
Posts: 36
I have created a .htaccess file and placed it in the /forums directory. I tried it with only "AcceptPathInfo On" in it, I got a 500 internal server error. I then tried it with only "AllowOverride All" in it, same error. I then moved that file to the admin directory, same result, and also tried it with only "AcceptPathInfo On" in the admin directory, getting the error again....am I doing this wrong??

J. Holly #227714 07/18/2009 11:20 AM
Joined: Jun 2006
Posts: 9,242
Likes: 1
R
Former Developer
Former Developer
R Offline
Joined: Jun 2006
Posts: 9,242
Likes: 1
You want to remove the quotes. Only put this:

AcceptPathInfo On

Rick #227715 07/18/2009 2:51 PM
Joined: Feb 2007
Posts: 36
newbie
newbie
Joined: Feb 2007
Posts: 36
That is what I tried....without the quotes....any other ideas??

J. Holly #227716 07/18/2009 3:35 PM
Joined: Jun 2006
Posts: 9,242
Likes: 1
R
Former Developer
Former Developer
R Offline
Joined: Jun 2006
Posts: 9,242
Likes: 1
Hmm, do you have access to your webserver error logs? If so, then right after you get the error, I'd check the logs and it should have some info on the error.

Rick #227719 07/18/2009 5:24 PM
Joined: Jun 2006
Posts: 16,292
Likes: 116
UBB.threads Developer
UBB.threads Developer
Joined: Jun 2006
Posts: 16,292
Likes: 116
If a .htaccess file in your web root throws a 500 error, you likely don't have AllowOverride All set in your account and it'd throwing the error.

Literally, all you need in your .htaccess is:
AcceptPathInfo On

Any apache webserver, with the AllowOverride option on should be able to work witht hat setting...


I am a Web Development Contractor, I do not work for UBBCentral. I have provided free User to User Support since the beginning of these support forums.
Do you need Forum Install or Upgrade Services?
Forums: A Gardeners Forum, Scouters World
UBB.threads: UBBWiki, UBB Styles, UBB.Sitemaps
Longtime Supporter & Resident Post-A-Holic
VNC Web Services: Code Modifications, Upgrades, Styling, Coding Services, Disaster Recovery, and more!

Link Copied to Clipboard
ShoutChat
Comment Guidelines: Do post respectful and insightful comments. Don't flame, hate, spam.
Recent Topics
spam issues
by ECNet - 03/19/2024 11:45 PM
Looking for a forum
by azr - 03/15/2024 11:26 PM
Editing Links in Post
by Outdoorking - 03/15/2024 9:31 AM
Question on barkrowler and the like
by Mors - 02/29/2024 6:51 PM
Member Permissions Help
by domspeak - 02/27/2024 6:31 PM
Who's Online Now
0 members (), 396 guests, and 110 robots.
Key: Admin, Global Mod, Mod
Random Gallery Image
Latest Gallery Images
Los Angeles
Los Angeles
by isaac, August 6
3D Creations
3D Creations
by JAISP, December 30
Artistic structures
Artistic structures
by isaac, August 29
Stones
Stones
by isaac, August 19
Powered by UBB.threads™ PHP Forum Software 8.0.0
(Preview build 20230217)