Previous Thread
Next Thread
Print Thread
Hop To
Joined: May 2006
Posts: 243
Likes: 1
Enthusiast
Enthusiast
Joined: May 2006
Posts: 243
Likes: 1
Several months ago, I jumped in head first and moved my site from one server to a better one. Being pretty inexperienced, it took me some time, and some help from good people here. Here's the thread: Importing UBB Threads ...to UBB Threads

It was all moved and things looked ok, so I threw the switch and started running on the new site.

THEN I discovered a terrible problem with the Import. I documented it in the last two posts of the "Importing" thread. But it took me several weeks to clean up the problem with some manual editing of hundreds of posts.

I discovered that EVERY odd ascii character caused the imported message to truncate at that character! Here's a list of the characters I found to cause a problem. I am sure many others would too, but these are ones used in posts on my site:
Code
ch.  hex    Description
--  ----  ---------------
…   \x85  ellipsis
‘   \x91  left curly apostrophe
’   \x92  right curly apostrophe
“   \x93  left curly doublequote
”   \x94  right curly doublequote
•   \x95  imported bullets ( not [list] ubb code )
–   \x96  longer dash
—   \x97  longest dash
™   \x99  TM
¢   \xa2  cents
­   \xad  another dash
®   \xae  registered or TM
°   \xb0  degree symbol
·   \xb7  small bullet
½   \xbd  1/2
¾   \xbe  3/4
ä   \xe4  Bärtsch (a last name)
é   \xe9  café
I checked the posts and found that it was ONLY the text in the POST_BODY column was truncated. All other columns in the SQL Insert statement into the ubbt_POSTS table were fully inserted into the new database.

In my "Importing" thread, nobody responded to this problem report, so I thought I'd bring it up again. If anyone copies this post into their forum, and then tries to do a backup followed by a restore or Import of it, I'll bet the post will be truncated at that first ellipsis character above.

And I know there are lots of forums running in European languages, so I am curious how bad this problem is.

Or is there simply a character-set problem between my my laptop (where the import files are) and the new server??? The import files contain the full messages -- that is where I picked up the text of the broken posts.

Joined: May 2006
Posts: 243
Likes: 1
Enthusiast
Enthusiast
Joined: May 2006
Posts: 243
Likes: 1
Hmmm..... 68 views, no comments. I'm worried this one would bite anyone who might need to restore from a backup.

Joined: Jan 2004
Posts: 2,474
Likes: 3
D
Pooh-Bah
Pooh-Bah
D Offline
Joined: Jan 2004
Posts: 2,474
Likes: 3
Hi Steve,
I really wish I could help but from my own experience, I've not come across this problem.

I have had to import data three times over the years and each time I used BigDump. It has its own peculiarities but it has worked for me each time.

Can we take it that your problem is now resolved? I guess you just want to resolve this to future-proof your imports?

Perhaps you could try importing with BigDump on a test server?

Joined: May 2006
Posts: 243
Likes: 1
Enthusiast
Enthusiast
Joined: May 2006
Posts: 243
Likes: 1
Driv, have you actually looked at the posts that were imported? If you take my first post above, and copy it into a post on your board, then try a backup / restore, check it after the restore. See if the full text of the post is restored.

I would do this myself, but I am not sure how to test it without backing up and restoring my entire ubbt_POSTS table.

....I suppose with some sql, I could clone the ubbt_posts table definition, and then try a restore into it.


> Can we take it that your problem is now resolved? I guess you just want to resolve this to future-proof your imports?

I spent a lot of hours finding and repairing the posts manually using the online post editing process.


Link Copied to Clipboard
ShoutChat
Comment Guidelines: Do post respectful and insightful comments. Don't flame, hate, spam.
Recent Topics
PHP 8 bug in membermanage.tmpl
by phoenix011235 - 09/08/2026 7:47 PM
Are any of these legitmate?
by Baldeagle - 09/06/2026 1:37 PM
After server reboot
by Morgan - 09/02/2026 8:27 AM
Email Settings
by Outdoorking - 05/13/2026 2:44 AM
Who's Online Now
1 members (1 invisible), 304 guests, and 96 robots.
Key: Admin, Global Mod, Mod
Random Gallery Image
Latest Gallery Images
Ride safe!
Ride safe!
by Morgan, December 7
Los Angeles
Los Angeles
by isaac, August 6
3D Creations
3D Creations
by JAISP, December 30
Artistic structures
Artistic structures
by isaac, August 29
Powered by UBB.threads™ PHP Forum Software 8.1.0
(Snapshot build 20260527)