Originally Posted by jgeoff
Luckily Yahoo caved in and now accepts Google's sitemap.xml format.
My spider addon supports both Yahoo's RSS sitemap and Googles XML sitemap... Along with a HTML map, text links, and some prepriatary ASP mapping... So, I was bored...

It's a shame though that Google doesn't support blocking their bot with a robots.txt rule, yet still feeding it a sitemap of what you want crawled.

Though this is more a limitation on Google's side than a bug in my script; my script was coded as a way to feed valid links immediately to Search Engines to get content in there NOW from a fresh import versus having to wait for it to be naturally crawled.

I am a Web Development Contractor, I do not work for UBBCentral. I have provided free User to User Support since the beginning of these support forums.
Do you need Forum Install or Upgrade Services?
Forums: A Gardeners Forum, Scouters World
UBB.threads: UBBWiki, UBB Styles, UBB.Sitemaps
Longtime Supporter & Resident Post-A-Holic
VNC Web Services: Code Modifications, Upgrades, Styling, Coding Services, Disaster Recovery, and more!