It's a dedicated server. I even moved up to a dual Woodcrest with 4 GB RAM, and yet this is still happening.

This happens regardless of the server load, which is close to nothing most of the time. Could it be a mysql setting perhaps?