Okay thats what I was thinking. I use cpanel myself and it looked like I had to add the ip from the remote site.
"Change the security settings on server B to allow incoming mysql traffic from server A's IP."
Of course I don't really have way to test that now. But very helpful anyway.
At least for the next move.(Shudder)