I assume that you've tweaked MySQL with the new server already? You don't seem to have too many posts or users - high numbers of either are the usual bottleneck.
You should really upgrade to 6.5.0, or 6.5.1 when it's released. It contains both performance improvements and a few other critical fixes...
