Previous Thread
Next Thread
Print Thread
Hop To
import from threads 6.5.4 problem #1374 07/19/2006 3:55 AM
Joined: Jun 2006
Posts: 956
Zarzal Offline OP
Old Hand
OP Offline
Old Hand
Joined: Jun 2006
Posts: 956
Hi,

today I try out Threads7. I get the beta and the import script. I setup threads with just create the tables and then I run the importer. Seems good up to this point.

The importer begin to work and do something realy fast. As I note he stop a moment while importing the posts (=120) and continue importing the personal mail. I have up to 100.000 posts.

The script finish and I can logon with my just imported admin accounts. All boards are created, users seems to be fine but only a handfull of posts are ready.

Is there any way to get a logfile from the importer and some kind of debug view?

My Threads6 board is old and was years ago imported from classic. I fear that some inconsistency exists in the posting table that confuse the importer. Is some kind of check available to test this? What can I do now?


my board: http://www.dragonclan-forum.de
my hobby: http://www.biker-reise.de
Ich kann bei Fragen zu UBBthreads in Deutsch weiterhelfen oder es zumindest versuchen
Re: import from threads 6.5.4 problem [Re: Zarzal] #1375 07/19/2006 5:15 AM
Joined: Jun 2006
Posts: 956
Zarzal Offline OP
Old Hand
OP Offline
Old Hand
Joined: Jun 2006
Posts: 956
I m on the way ... seems that I have very old usernames from imports in my database that contains / [ ] and , in B_AnonName.
Now I edit the db and run the importer again. We will see


my board: http://www.dragonclan-forum.de
my hobby: http://www.biker-reise.de
Ich kann bei Fragen zu UBBthreads in Deutsch weiterhelfen oder es zumindest versuchen
Re: import from threads 6.5.4 problem [Re: Zarzal] #1379 07/19/2006 8:47 AM
Joined: Jun 2006
Posts: 956
Zarzal Offline OP
Old Hand
OP Offline
Old Hand
Joined: Jun 2006
Posts: 956
All usernames fixed but this doesn't fix my problem. There must be a post somewhere that give an error, but the import is to fast so I cant see any message. It imports 2803 postings from 100.000

/edit: is there a limit how long a imported thread can be? I have some talk threads with thousends of replys.

/edit2: Seems I found it:

Importing Topic (Frage & Antwort (Endlosthread)) and it's 2227 replies.
Large Topic Encountered. The rest of the topics in this batch will be handled on the next refresh.

Done! Now importing your titles, notes, banlists. (please wait)
(threads_import.php?ubb=extras)

but he dont continue the batch and jumps to:

importing Banned Host: 85.255.117.%
Importing Banned Email: jerk@jerk.com

Last edited by Zarzal; 07/19/2006 9:39 AM.

my board: http://www.dragonclan-forum.de
my hobby: http://www.biker-reise.de
Ich kann bei Fragen zu UBBthreads in Deutsch weiterhelfen oder es zumindest versuchen
Re: import from threads 6.5.4 problem [Re: Zarzal] #1389 07/19/2006 10:32 AM
Joined: Jun 2006
Posts: 46
Jamin Offline
newbie
Offline
newbie
Joined: Jun 2006
Posts: 46
Same deal here, except I'm on a much smaller forum. The importer brought in 949 out of 1498 topics, and 7703 out of 12896 posts. It missed a handful of posts from every forum, and left two of the forums empty entirely.

Everything else with the importer seemed to work fine. Got all my users, even got the groups and forum permissions, which surprised me. I was expecting to have to reset all that.

Anyway, yeah, just throwing my $0.02 in here, since Zarzal was reporting the same problem. Otherwise great job!

---Jamin


"Those who would give up essential liberty to purchase a little temporary safety, deserve neither liberty nor safety."
Re: import from threads 6.5.4 problem [Re: Jamin] #1395 07/19/2006 11:02 AM
Joined: Jun 2006
Posts: 9,243
Rick Offline
Former Developer
Offline
Former Developer
Joined: Jun 2006
Posts: 9,243
Jamin, do you have any extremely large posts, one with alot of replies, as well? I think it's a problem when it runs into one of those that I need to fix.

Re: import from threads 6.5.4 problem [Re: Rick] #1396 07/19/2006 11:03 AM
Joined: Jun 2006
Posts: 9,243
Rick Offline
Former Developer
Offline
Former Developer
Joined: Jun 2006
Posts: 9,243
Thanks for all of the info Zarzal. It's definitely a problem with the large posts as you've found. I have to do some special tricks for those so we don't run into timeout problems and I don't think it's working quite right just yet. Will be working on this more.

Re: import from threads 6.5.4 problem [Re: Rick] #1397 07/19/2006 11:10 AM
Joined: Jun 2006
Posts: 9,243
Rick Offline
Former Developer
Offline
Former Developer
Joined: Jun 2006
Posts: 9,243
I think I found the problem, just a quick little change. If you edit your threads_import.php file line 773 has a block of code that looks like this:

PHP Code
$end = $end - (20 - $topic_count);
break; 


Change that, to this:

PHP Code
$end = $end - (20 - $topic_count);
$more = true;
break; 



Re: import from threads 6.5.4 problem [Re: Rick] #1398 07/19/2006 11:23 AM
Joined: Jun 2006
Posts: 46
Jamin Offline
newbie
Offline
newbie
Joined: Jun 2006
Posts: 46
Rick, I have a few posts with 100+ replies, but no really really big ones like Zarzal. My host is currently having a lot of issues with one of their file servers, so everything is slow as nuts right now, but I'll try that fix as soon as things pick up and see if it worked.

---Jamin


"Those who would give up essential liberty to purchase a little temporary safety, deserve neither liberty nor safety."
Re: import from threads 6.5.4 problem [Re: Jamin] #1400 07/19/2006 11:34 AM
Joined: Jun 2006
Posts: 9,243
Rick Offline
Former Developer
Offline
Former Developer
Joined: Jun 2006
Posts: 9,243
Ok, right now a large topic is considered 200+ replies. So if you have any with over 200 it will skip the rest without that fix.

Re: import from threads 6.5.4 problem [Re: Rick] #1403 07/19/2006 11:54 AM
Joined: Jun 2006
Posts: 3,837
Ian Offline
Carpal Tunnel
Offline
Carpal Tunnel
Joined: Jun 2006
Posts: 3,837
I have two with over 10,000 posts each - eek!! Goodness knows how many are over 200 smile

Looks like I will holding fire for a while smile

Re: import from threads 6.5.4 problem [Re: Rick] #1404 07/19/2006 11:54 AM
Joined: Jun 2006
Posts: 956
Zarzal Offline OP
Old Hand
OP Offline
Old Hand
Joined: Jun 2006
Posts: 956
I do the modification and the import runs right now. Seems good but I have to wait a while for finish smile Thanks.


my board: http://www.dragonclan-forum.de
my hobby: http://www.biker-reise.de
Ich kann bei Fragen zu UBBthreads in Deutsch weiterhelfen oder es zumindest versuchen
Re: import from threads 6.5.4 problem [Re: Ian] #1405 07/19/2006 11:57 AM
Joined: Jun 2006
Posts: 9,243
Rick Offline
Former Developer
Offline
Former Developer
Joined: Jun 2006
Posts: 9,243
Originally Posted by Ian
I have two with over 10,000 posts each - eek!! Goodness knows how many are over 200 smile

Looks like I will holding fire for a while smile


That should be fine. Basically what it does, is it will only import the one topic and then refresh right after it to avoid a browser timeout. 200 is just a number I pulled out of my...um....head, and can probably be much higher. wink

Re: import from threads 6.5.4 problem [Re: Rick] #1407 07/19/2006 12:03 PM
Joined: Jun 2006
Posts: 3,837
Ian Offline
Carpal Tunnel
Offline
Carpal Tunnel
Joined: Jun 2006
Posts: 3,837
so my 10,000 post threads should be fine (I think one is around 12,500 posts long at the moment)

Thanks.

Re: import from threads 6.5.4 problem [Re: Ian] #1408 07/19/2006 12:07 PM
Joined: Jun 2006
Posts: 9,243
Rick Offline
Former Developer
Offline
Former Developer
Joined: Jun 2006
Posts: 9,243
It should be. The SQL part isn't really the issue, the queries are very quick, the only problem I've had to work on avoiding is a browser timeout. Only 1 way to find out for sure though is by setting up a test forum for a test run wink Yours would be a great experiment laugh

Re: import from threads 6.5.4 problem [Re: Rick] #1418 07/19/2006 1:10 PM
Joined: Jun 2006
Posts: 3,837
Ian Offline
Carpal Tunnel
Offline
Carpal Tunnel
Joined: Jun 2006
Posts: 3,837
My only issue at the moment is upgrading to 6.5.4 - I run 6.5.2 and cannot upgrade until I actually switch.

My only option is to install a duplicate site, and upgrade that.

I am assuming that one can't just set up a beta and then import a 6.5.2 database.

Re: import from threads 6.5.4 problem [Re: Ian] #1420 07/19/2006 1:22 PM
Joined: Jun 2006
Posts: 9,243
Rick Offline
Former Developer
Offline
Former Developer
Joined: Jun 2006
Posts: 9,243
The import will actually work as long as you are at least running version 6.5. So since you are running 6.5.2 you can do just that. Setup the beta and then do the import. wink

Re: import from threads 6.5.4 problem [Re: Rick] #1425 07/19/2006 2:05 PM
Joined: Jun 2006
Posts: 3,837
Ian Offline
Carpal Tunnel
Offline
Carpal Tunnel
Joined: Jun 2006
Posts: 3,837
Ok cool smile Thanks.


Re: import from threads 6.5.4 problem [Re: Ian] #1428 07/19/2006 2:17 PM
Joined: Dec 2003
Posts: 1,796
AllenAyres Offline
Pooh-Bah
Offline
Pooh-Bah
Joined: Dec 2003
Posts: 1,796
I've found through many many imports that you'll probably have better results with the timeout issues if you use firefox. With the newest changes IE will probably be ok, but firefox doesn't time out as badly.


- Allen
- ThreadsDev | PraiseCafe
Re: import from threads 6.5.4 problem [Re: ] #1435 07/19/2006 3:12 PM
Joined: Jun 2006
Posts: 46
Jamin Offline
newbie
Offline
newbie
Joined: Jun 2006
Posts: 46
Rick, just FYI the fix worked great, and it imported everything correctly this time.

---Jamin


"Those who would give up essential liberty to purchase a little temporary safety, deserve neither liberty nor safety."
Re: import from threads 6.5.4 problem [Re: Jamin] #1436 07/19/2006 3:28 PM
Joined: Jun 2006
Posts: 9,243
Rick Offline
Former Developer
Offline
Former Developer
Joined: Jun 2006
Posts: 9,243
Thanks for the update Jamin. Good to hear!

Re: import from threads 6.5.4 problem [Re: Rick] #1450 07/19/2006 4:46 PM
Joined: Jun 2006
Posts: 956
Zarzal Offline OP
Old Hand
OP Offline
Old Hand
Joined: Jun 2006
Posts: 956
my import is finish and it works. More then 100.000 potings in nearly 9.000 topics and 11.000 private topics imported. All fine.

the only thing I note (and it seems to be by design): all polls start from 0, the old results get not transferd.


my board: http://www.dragonclan-forum.de
my hobby: http://www.biker-reise.de
Ich kann bei Fragen zu UBBthreads in Deutsch weiterhelfen oder es zumindest versuchen
Re: import from threads 6.5.4 problem [Re: Zarzal] #1453 07/19/2006 5:03 PM
Joined: Jun 2006
Posts: 9,243
Rick Offline
Former Developer
Offline
Former Developer
Joined: Jun 2006
Posts: 9,243
Hmm, it is supposed to transfer the results. It's ok that they start from 0, but results should have been brought over as well. I'll need to debug this to get it fixed.

Re: import from threads 6.5.4 problem [Re: Rick] #1483 07/20/2006 12:38 AM
Joined: Jun 2006
Posts: 412
Mors Offline
addict
Offline
addict
Joined: Jun 2006
Posts: 412
Originally Posted by Rick
I think I found the problem, just a quick little change. If you edit your threads_import.php file line 773 has a block of code that looks like this:

PHP Code
$end = $end - (20 - $topic_count);
break; 


Change that, to this:

PHP Code
$end = $end - (20 - $topic_count);
$more = true;
break; 




This worked perfect for me today.. My conversion stopped at like 800 posts.. this fixed it.


Happy Customer !!!
Re: import from threads 6.5.4 problem [Re: Mors] #1508 07/20/2006 10:48 AM
Joined: Jun 2006
Posts: 956
Zarzal Offline OP
Old Hand
OP Offline
Old Hand
Joined: Jun 2006
Posts: 956
Just a note:
Importet postings with included quotes looks different. I guess its related to the diffent styles from ubb6.5 and ubb7 and the handling of quotes. Postings will transfered and not modifed in its body so the new quote layout is not applied.


my board: http://www.dragonclan-forum.de
my hobby: http://www.biker-reise.de
Ich kann bei Fragen zu UBBthreads in Deutsch weiterhelfen oder es zumindest versuchen

Forum Search
ShoutChat Box
Comment Guidelines: Do post respectful and insightful comments. Don't flame, hate, spam.
Recent Topics
Having issue with redirects to UBB classic URLs
by amciotola - 10/16/2019 1:11 AM
Unable to save General settings
by amciotola - 10/13/2019 4:23 AM
I see signature line images, but no avatars
by Morgan - 10/12/2019 2:21 PM
Show PDF
by Geoff - 10/09/2019 1:33 AM
Subscription’s Auto Return URL for PayPal
by Geoff - 09/27/2019 12:10 AM
Who's Online Now
2 registered members (Philipp, JAISP), 81 guests, and 442 spiders.
Key: Admin, Global Mod, Mod
Random Gallery Image
Latest Gallery Images
Artistic structures
Artistic structures
by isaac, August 29
Stones
Stones
by isaac, August 19
Amusing Terain Scenics
Amusing Terain Scenics
by isaac, August 19
Sky places
Sky places
by isaac, August 19
Powered by UBB.threads™ PHP Forum Software 7.7.4
(Snapshot build 20190930)