Beta 5 is now in the members area. This should be our last beta and we'll now be working on our first release candidate. This beta comes with an upgrade utility to make things a bit easier.
If you don't have any custom changes to templates or languages that you are worried about just upload everything except for the includes, styles and cache_builders/custom directories (Note, you will want to upload all of the .php files within the cache_builders directory). Next bring up install/upgrade.php and it will walk you through the rest. Once you're finished delete the entire install directory.
If you only want to upload the files that have changed and any new language strings then just upload everything in the install directory first. At that point, bring up the install/upgrade.php script in your browser and it will let you know exactly what files have been changed, language strings, etc. Upload what it tells you to and then continue with the rest of the instructions. When finished delete the entire install directory.