Thanks Ruben!
Appreciated.
For starters you can goto google and setup a account that gives you webmaster tools.
One setting is crawl rate.
Of course if you set it high it will mean your bandwidth goes up.
Interesting. Unfortunately there's a bit of a security issue with our owner giving me access to the account. He can't give it to me for our forum section without giving it to me for his entire website -- roughly 16 years of hard labor.
And i'm not about to complain about that.
