Chukee, go to your control panel.
Display Options -> General
Choose the Recent Visitors tab.
Uncheck the box next to Enable Recent Visitors.
Submit.
That will turn off the Recent Visitors function on your boards. That isn't the cureall, but that is a start.
I assume you are on a dedicated box and just hosting a few other sites.
