Finally finished the 7.3 upgrade only to find out that the data in the tables got corrupted somewhere along the way.

It seems that the data is in latin2 format even though all tables are in UTF8.

Does anyone have any ideas on how to fix this?

It looks OK in v6.5.5 though.

Example:
Det här forumet är till för att diskutera rollspel i allmänhet och dessutom alla specifika rollspel som inte har nå...

Should look like this:
Det här forumet är till för att diskutera rollspel i allmänhet och dessutom alla specifika rollspel som inte har nå...

My ideas are these:
  1. Dump the data, convert dump file to UTF8, restore data.
    Problem: iconv thinks file is already in UTF8, but contains above corrupted characters. Also, breaks on some characters and removes lines.
  2. Convert text columns to BLOBs, switch table to latin1, convert blobs back to text, convert tables back to utf8.
    Problem: Will take ages, can't find a script to do this, seems lika a high risk that something breaks.
  3. Create a new dump of old data which hopefully is correct and do the complete upgrade again.
    Problem: Not feasible, the old upgrade took the entire weekend and then some.
  4. Break down and cry.
    Problem: Doesn't actually solve anything.

Anyone have any other ideas?


aka Olle Johansson