Ok, I re-downloaded the package from here, totally deleted the database, deleted the entire folder off the server, and uploaded everything again.

Went through all the setup once more and it is working fine now.

Mush have been a corrupt file somehow.