A VPS is basically a shared dedicated server; you're given control over resources that are dedicated just for you; the only "downside" is that you're in charge of your own server upgrades, but this gives you the ability to run any build of software you want (such as bleeding edge releases of php/mysql for example)