Site Links
Home
Features
Documentation
Pricing & Order
Members Area
Support Options
UBBDev.com
UBBWiki.com
Who's Online Now
2 registered members (TheBrit, Zarzal), 46 guests, and 202 spiders.
Key: Admin, Global Mod, Mod
Member Spotlight
Mark J.Cairns
Mark J.Cairns
Northern Ireland, UK
Posts: 38
Joined: September 2009
Show All Member Profiles 
Top Posters(30 Days)
Gizmo 18
isaac 14
TheBrit 10
SteveS 8
Zarzal 6
Morgan 5
Ruben 4
jorb 4
Latest Photos
Test
Testing to drag photos
Comfortable Cats
Test
BSA photos
Previous Thread
Next Thread
Print Thread
import from threads 6.5.4 problem #1374
07/19/06 02:55 AM
07/19/06 02:55 AM
Zarzal  Online Sleepy OP
Old Hand
Joined: Jun 2006
Posts: 1,154
Berlin, Germany
Hi,

today I try out Threads7. I get the beta and the import script. I setup threads with just create the tables and then I run the importer. Seems good up to this point.

The importer begin to work and do something realy fast. As I note he stop a moment while importing the posts (=120) and continue importing the personal mail. I have up to 100.000 posts.

The script finish and I can logon with my just imported admin accounts. All boards are created, users seems to be fine but only a handfull of posts are ready.

Is there any way to get a logfile from the importer and some kind of debug view?

My Threads6 board is old and was years ago imported from classic. I fear that some inconsistency exists in the posting table that confuse the importer. Is some kind of check available to test this? What can I do now?


my board: http://www.dragonclan-forum.de
my hobby: http://www.biker-reise.de
Ich kann bei Fragen zu UBBthreads in Deutsch weiterhelfen oder es zumindest versuchen
Express Hosting
Express Hosting "We are the official hosting company of UBB.threads. Ask us about our free migration services to migrate your UBB.threads installation."
Re: import from threads 6.5.4 problem [Re: Zarzal] #1375
07/19/06 04:15 AM
07/19/06 04:15 AM
Zarzal  Online Sleepy OP
Old Hand
Joined: Jun 2006
Posts: 1,154
Berlin, Germany
I m on the way ... seems that I have very old usernames from imports in my database that contains / [ ] and , in B_AnonName.
Now I edit the db and run the importer again. We will see


my board: http://www.dragonclan-forum.de
my hobby: http://www.biker-reise.de
Ich kann bei Fragen zu UBBthreads in Deutsch weiterhelfen oder es zumindest versuchen
Re: import from threads 6.5.4 problem [Re: Zarzal] #1379
07/19/06 07:47 AM
07/19/06 07:47 AM
Zarzal  Online Sleepy OP
Old Hand
Joined: Jun 2006
Posts: 1,154
Berlin, Germany
All usernames fixed but this doesn't fix my problem. There must be a post somewhere that give an error, but the import is to fast so I cant see any message. It imports 2803 postings from 100.000

/edit: is there a limit how long a imported thread can be? I have some talk threads with thousends of replys.

/edit2: Seems I found it:

Importing Topic (Frage & Antwort (Endlosthread)) and it's 2227 replies.
Large Topic Encountered. The rest of the topics in this batch will be handled on the next refresh.

Done! Now importing your titles, notes, banlists. (please wait)
(threads_import.php?ubb=extras)

but he dont continue the batch and jumps to:

importing Banned Host: 85.255.117.%
Importing Banned Email: jerk@jerk.com

Last edited by Zarzal; 07/19/06 08:39 AM.

my board: http://www.dragonclan-forum.de
my hobby: http://www.biker-reise.de
Ich kann bei Fragen zu UBBthreads in Deutsch weiterhelfen oder es zumindest versuchen
Re: import from threads 6.5.4 problem [Re: Zarzal] #1389
07/19/06 09:32 AM
07/19/06 09:32 AM
Jamin  Offline
newbie
Joined: Jun 2006
Posts: 47
Dallas, TX
Same deal here, except I'm on a much smaller forum. The importer brought in 949 out of 1498 topics, and 7703 out of 12896 posts. It missed a handful of posts from every forum, and left two of the forums empty entirely.

Everything else with the importer seemed to work fine. Got all my users, even got the groups and forum permissions, which surprised me. I was expecting to have to reset all that.

Anyway, yeah, just throwing my $0.02 in here, since Zarzal was reporting the same problem. Otherwise great job!

---Jamin


"Those who would give up essential liberty to purchase a little temporary safety, deserve neither liberty nor safety."
Re: import from threads 6.5.4 problem [Re: Jamin] #1395
07/19/06 10:02 AM
07/19/06 10:02 AM
R
Rick  Offline
Former Developer
Joined: Jun 2006
Posts: 10,177
Aberdeen, WA
Jamin, do you have any extremely large posts, one with alot of replies, as well? I think it's a problem when it runs into one of those that I need to fix.

Re: import from threads 6.5.4 problem [Re: Rick] #1396
07/19/06 10:03 AM
07/19/06 10:03 AM
R
Rick  Offline
Former Developer
Joined: Jun 2006
Posts: 10,177
Aberdeen, WA
Thanks for all of the info Zarzal. It's definitely a problem with the large posts as you've found. I have to do some special tricks for those so we don't run into timeout problems and I don't think it's working quite right just yet. Will be working on this more.

Re: import from threads 6.5.4 problem [Re: Rick] #1397
07/19/06 10:10 AM
07/19/06 10:10 AM
R
Rick  Offline
Former Developer
Joined: Jun 2006
Posts: 10,177
Aberdeen, WA
I think I found the problem, just a quick little change. If you edit your threads_import.php file line 773 has a block of code that looks like this:

PHP Code
$end = $end - (20 - $topic_count);
break; 


Change that, to this:

PHP Code
$end = $end - (20 - $topic_count);
$more = true;
break; 



Re: import from threads 6.5.4 problem [Re: Rick] #1398
07/19/06 10:23 AM
07/19/06 10:23 AM
Jamin  Offline
newbie
Joined: Jun 2006
Posts: 47
Dallas, TX
Rick, I have a few posts with 100+ replies, but no really really big ones like Zarzal. My host is currently having a lot of issues with one of their file servers, so everything is slow as nuts right now, but I'll try that fix as soon as things pick up and see if it worked.

---Jamin


"Those who would give up essential liberty to purchase a little temporary safety, deserve neither liberty nor safety."
Re: import from threads 6.5.4 problem [Re: Jamin] #1400
07/19/06 10:34 AM
07/19/06 10:34 AM
R
Rick  Offline
Former Developer
Joined: Jun 2006
Posts: 10,177
Aberdeen, WA
Ok, right now a large topic is considered 200+ replies. So if you have any with over 200 it will skip the rest without that fix.

Re: import from threads 6.5.4 problem [Re: Rick] #1403
07/19/06 10:54 AM
07/19/06 10:54 AM
I
Ian  Offline

Carpal Tunnel
Joined: Jun 2006
Posts: 4,374
Essex, UK
I have two with over 10,000 posts each - eek!! Goodness knows how many are over 200 smile

Looks like I will holding fire for a while smile

Re: import from threads 6.5.4 problem [Re: Rick] #1404
07/19/06 10:54 AM
07/19/06 10:54 AM
Zarzal  Online Sleepy OP
Old Hand
Joined: Jun 2006
Posts: 1,154
Berlin, Germany
I do the modification and the import runs right now. Seems good but I have to wait a while for finish smile Thanks.


my board: http://www.dragonclan-forum.de
my hobby: http://www.biker-reise.de
Ich kann bei Fragen zu UBBthreads in Deutsch weiterhelfen oder es zumindest versuchen
Re: import from threads 6.5.4 problem [Re: Ian] #1405
07/19/06 10:57 AM
07/19/06 10:57 AM
R
Rick  Offline
Former Developer
Joined: Jun 2006
Posts: 10,177
Aberdeen, WA
Originally Posted by Ian
I have two with over 10,000 posts each - eek!! Goodness knows how many are over 200 smile

Looks like I will holding fire for a while smile


That should be fine. Basically what it does, is it will only import the one topic and then refresh right after it to avoid a browser timeout. 200 is just a number I pulled out of my...um....head, and can probably be much higher. wink

Re: import from threads 6.5.4 problem [Re: Rick] #1407
07/19/06 11:03 AM
07/19/06 11:03 AM
I
Ian  Offline

Carpal Tunnel
Joined: Jun 2006
Posts: 4,374
Essex, UK
so my 10,000 post threads should be fine (I think one is around 12,500 posts long at the moment)

Thanks.

Re: import from threads 6.5.4 problem [Re: Ian] #1408
07/19/06 11:07 AM
07/19/06 11:07 AM
R
Rick  Offline
Former Developer
Joined: Jun 2006
Posts: 10,177
Aberdeen, WA
It should be. The SQL part isn't really the issue, the queries are very quick, the only problem I've had to work on avoiding is a browser timeout. Only 1 way to find out for sure though is by setting up a test forum for a test run wink Yours would be a great experiment laugh

Re: import from threads 6.5.4 problem [Re: Rick] #1418
07/19/06 12:10 PM
07/19/06 12:10 PM
I
Ian  Offline

Carpal Tunnel
Joined: Jun 2006
Posts: 4,374
Essex, UK
My only issue at the moment is upgrading to 6.5.4 - I run 6.5.2 and cannot upgrade until I actually switch.

My only option is to install a duplicate site, and upgrade that.

I am assuming that one can't just set up a beta and then import a 6.5.2 database.

Re: import from threads 6.5.4 problem [Re: Ian] #1420
07/19/06 12:22 PM
07/19/06 12:22 PM
R
Rick  Offline
Former Developer
Joined: Jun 2006
Posts: 10,177
Aberdeen, WA
The import will actually work as long as you are at least running version 6.5. So since you are running 6.5.2 you can do just that. Setup the beta and then do the import. wink

Re: import from threads 6.5.4 problem [Re: Rick] #1425
07/19/06 01:05 PM
07/19/06 01:05 PM
I
Ian  Offline

Carpal Tunnel
Joined: Jun 2006
Posts: 4,374
Essex, UK
Ok cool smile Thanks.


Re: import from threads 6.5.4 problem [Re: Ian] #1428
07/19/06 01:17 PM
07/19/06 01:17 PM
AllenAyres  Offline
Pooh-Bah
Joined: Dec 2003
Posts: 2,046
Texas
I've found through many many imports that you'll probably have better results with the timeout issues if you use firefox. With the newest changes IE will probably be ok, but firefox doesn't time out as badly.


- Allen
- ThreadsDev | PraiseCafe
Re: import from threads 6.5.4 problem [Re: ] #1435
07/19/06 02:12 PM
07/19/06 02:12 PM
Jamin  Offline
newbie
Joined: Jun 2006
Posts: 47
Dallas, TX
Rick, just FYI the fix worked great, and it imported everything correctly this time.

---Jamin


"Those who would give up essential liberty to purchase a little temporary safety, deserve neither liberty nor safety."
Re: import from threads 6.5.4 problem [Re: Jamin] #1436
07/19/06 02:28 PM
07/19/06 02:28 PM
R
Rick  Offline
Former Developer
Joined: Jun 2006
Posts: 10,177
Aberdeen, WA
Thanks for the update Jamin. Good to hear!

Re: import from threads 6.5.4 problem [Re: Rick] #1450
07/19/06 03:46 PM
07/19/06 03:46 PM
Zarzal  Online Sleepy OP
Old Hand
Joined: Jun 2006
Posts: 1,154
Berlin, Germany
my import is finish and it works. More then 100.000 potings in nearly 9.000 topics and 11.000 private topics imported. All fine.

the only thing I note (and it seems to be by design): all polls start from 0, the old results get not transferd.


my board: http://www.dragonclan-forum.de
my hobby: http://www.biker-reise.de
Ich kann bei Fragen zu UBBthreads in Deutsch weiterhelfen oder es zumindest versuchen
Re: import from threads 6.5.4 problem [Re: Zarzal] #1453
07/19/06 04:03 PM
07/19/06 04:03 PM
R
Rick  Offline
Former Developer
Joined: Jun 2006
Posts: 10,177
Aberdeen, WA
Hmm, it is supposed to transfer the results. It's ok that they start from 0, but results should have been brought over as well. I'll need to debug this to get it fixed.

Re: import from threads 6.5.4 problem [Re: Rick] #1483
07/19/06 11:38 PM
07/19/06 11:38 PM
Mors  Offline
addict
Joined: Jun 2006
Posts: 472
So. California
Originally Posted by Rick
I think I found the problem, just a quick little change. If you edit your threads_import.php file line 773 has a block of code that looks like this:

PHP Code
$end = $end - (20 - $topic_count);
break; 


Change that, to this:

PHP Code
$end = $end - (20 - $topic_count);
$more = true;
break; 




This worked perfect for me today.. My conversion stopped at like 800 posts.. this fixed it.


Happy Customer !!!
Re: import from threads 6.5.4 problem [Re: Mors] #1508
07/20/06 09:48 AM
07/20/06 09:48 AM
Zarzal  Online Sleepy OP
Old Hand
Joined: Jun 2006
Posts: 1,154
Berlin, Germany
Just a note:
Importet postings with included quotes looks different. I guess its related to the diffent styles from ubb6.5 and ubb7 and the handling of quotes. Postings will transfered and not modifed in its body so the new quote layout is not applied.


my board: http://www.dragonclan-forum.de
my hobby: http://www.biker-reise.de
Ich kann bei Fragen zu UBBthreads in Deutsch weiterhelfen oder es zumindest versuchen

Shout Box
Today's Birthdays
No Birthdays
Recent Topics
update multilanguage site problem
by Zarzal. 12/15/18 04:20 PM
Char coding utf-8 and older forums
by Zarzal. 12/15/18 03:59 PM
table issue
by TheBrit. 12/13/18 06:05 PM
testing table layout
by TheBrit. 12/13/18 11:16 AM
header.php after update from 7.5.x to 7.6.x
by Zarzal. 12/12/18 05:29 AM
Forum Statistics
Forums36
Topics35,180
Posts191,677
Members12,122
Most Online978
Jun 24th, 2007
Random Image
Powered by UBB.threads™ PHP Forum Software 7.6.2