Site Links
Home
Features
Documentation
Pricing & Order
Members Area
Support Options
UBBDev.com
UBBWiki.com
Who's Online
1 registered (Telly), 24 Guests and 15 Spiders online.
Key: Admin, Global Mod, Mod
Featured Member
Registered: 05/17/12
Posts: 3
Top Posters (30 Days)
Ruben 50
DennyP 24
Gizmo 24
Dunny 17
SteveS 14
AllenAyres 12
dbremer 10
SD 9
drkknght00 9
driv 8
Latest Photos
OK Corral Shoot Out
Testing
Basildon Train Station
Basildon Town Centre looking from the rounderbout
Basildon Town Square
Page 1 of 3 1 2 3 >
Topic Options
#1374 - 07/19/06 03:55 AM import from threads 6.5.4 problem
Zarzal Offline
old hand
Registered: 06/05/06
Posts: 1142
Loc: Berlin, Germany
Hi,

today I try out Threads7. I get the beta and the import script. I setup threads with just create the tables and then I run the importer. Seems good up to this point.

The importer begin to work and do something realy fast. As I note he stop a moment while importing the posts (=120) and continue importing the personal mail. I have up to 100.000 posts.

The script finish and I can logon with my just imported admin accounts. All boards are created, users seems to be fine but only a handfull of posts are ready.

Is there any way to get a logfile from the importer and some kind of debug view?

My Threads6 board is old and was years ago imported from classic. I fear that some inconsistency exists in the posting table that confuse the importer. Is some kind of check available to test this? What can I do now?
_________________________
my board: http://www.dragon-clan.de
my hobby: http://www.biker-reise.de
Ich kann bei Fragen zu UBBthreads in Deutsch weiterhelfen oder es zumindest versuchen
Top
Express Hosting
Express Hosting "We are the official hosting company of UBB.threads. Ask us about our free migration services to migrate your UBB.threads installation."
#1375 - 07/19/06 05:15 AM Re: import from threads 6.5.4 problem [Re: Zarzal]
Zarzal Offline
old hand
Registered: 06/05/06
Posts: 1142
Loc: Berlin, Germany
I m on the way ... seems that I have very old usernames from imports in my database that contains / [ ] and , in B_AnonName.
Now I edit the db and run the importer again. We will see
_________________________
my board: http://www.dragon-clan.de
my hobby: http://www.biker-reise.de
Ich kann bei Fragen zu UBBthreads in Deutsch weiterhelfen oder es zumindest versuchen
Top
#1379 - 07/19/06 08:47 AM Re: import from threads 6.5.4 problem [Re: Zarzal]
Zarzal Offline
old hand
Registered: 06/05/06
Posts: 1142
Loc: Berlin, Germany
All usernames fixed but this doesn't fix my problem. There must be a post somewhere that give an error, but the import is to fast so I cant see any message. It imports 2803 postings from 100.000

/edit: is there a limit how long a imported thread can be? I have some talk threads with thousends of replys.

/edit2: Seems I found it:

Importing Topic (Frage & Antwort (Endlosthread)) and it's 2227 replies.
Large Topic Encountered. The rest of the topics in this batch will be handled on the next refresh.

Done! Now importing your titles, notes, banlists. (please wait)
(threads_import.php?ubb=extras)

but he dont continue the batch and jumps to:

importing Banned Host: 85.255.117.%
Importing Banned Email: jerk@jerk.com


Edited by Zarzal (07/19/06 09:39 AM)
_________________________
my board: http://www.dragon-clan.de
my hobby: http://www.biker-reise.de
Ich kann bei Fragen zu UBBthreads in Deutsch weiterhelfen oder es zumindest versuchen
Top
#1389 - 07/19/06 10:32 AM Re: import from threads 6.5.4 problem [Re: Zarzal]
Jamin Offline
newbie
Registered: 06/05/06
Posts: 47
Loc: Dallas, TX
Same deal here, except I'm on a much smaller forum. The importer brought in 949 out of 1498 topics, and 7703 out of 12896 posts. It missed a handful of posts from every forum, and left two of the forums empty entirely.

Everything else with the importer seemed to work fine. Got all my users, even got the groups and forum permissions, which surprised me. I was expecting to have to reset all that.

Anyway, yeah, just throwing my $0.02 in here, since Zarzal was reporting the same problem. Otherwise great job!

---Jamin
_________________________
"Those who would give up essential liberty to purchase a little temporary safety, deserve neither liberty nor safety."
Top
#1395 - 07/19/06 11:02 AM Re: import from threads 6.5.4 problem [Re: Jamin]
Rick Offline
Post-a-holic
Registered: 06/04/06
Posts: 10164
Loc: Aberdeen, WA
Jamin, do you have any extremely large posts, one with alot of replies, as well? I think it's a problem when it runs into one of those that I need to fix.
Top
#1396 - 07/19/06 11:03 AM Re: import from threads 6.5.4 problem [Re: Rick]
Rick Offline
Post-a-holic
Registered: 06/04/06
Posts: 10164
Loc: Aberdeen, WA
Thanks for all of the info Zarzal. It's definitely a problem with the large posts as you've found. I have to do some special tricks for those so we don't run into timeout problems and I don't think it's working quite right just yet. Will be working on this more.
Top
#1397 - 07/19/06 11:10 AM Re: import from threads 6.5.4 problem [Re: Rick]
Rick Offline
Post-a-holic
Registered: 06/04/06
Posts: 10164
Loc: Aberdeen, WA
I think I found the problem, just a quick little change. If you edit your threads_import.php file line 773 has a block of code that looks like this:

Php Code:
$end = $end - (20 - $topic_count);
break; 


Change that, to this:

Php Code:
$end = $end - (20 - $topic_count);
$more = true;
break; 


Top
#1398 - 07/19/06 11:23 AM Re: import from threads 6.5.4 problem [Re: Rick]
Jamin Offline
newbie
Registered: 06/05/06
Posts: 47
Loc: Dallas, TX
Rick, I have a few posts with 100+ replies, but no really really big ones like Zarzal. My host is currently having a lot of issues with one of their file servers, so everything is slow as nuts right now, but I'll try that fix as soon as things pick up and see if it worked.

---Jamin
_________________________
"Those who would give up essential liberty to purchase a little temporary safety, deserve neither liberty nor safety."
Top
#1400 - 07/19/06 11:34 AM Re: import from threads 6.5.4 problem [Re: Jamin]
Rick Offline
Post-a-holic
Registered: 06/04/06
Posts: 10164
Loc: Aberdeen, WA
Ok, right now a large topic is considered 200+ replies. So if you have any with over 200 it will skip the rest without that fix.
Top
#1403 - 07/19/06 11:54 AM Re: import from threads 6.5.4 problem [Re: Rick]
Ian Offline
Registered: 06/05/06
Posts: 4337
Loc: Essex, UK
I have two with over 10,000 posts each - eek!! Goodness knows how many are over 200 smile

Looks like I will holding fire for a while smile
Top
#1404 - 07/19/06 11:54 AM Re: import from threads 6.5.4 problem [Re: Rick]
Zarzal Offline
old hand
Registered: 06/05/06
Posts: 1142
Loc: Berlin, Germany
I do the modification and the import runs right now. Seems good but I have to wait a while for finish smile Thanks.
_________________________
my board: http://www.dragon-clan.de
my hobby: http://www.biker-reise.de
Ich kann bei Fragen zu UBBthreads in Deutsch weiterhelfen oder es zumindest versuchen
Top
#1405 - 07/19/06 11:57 AM Re: import from threads 6.5.4 problem [Re: Ian]
Rick Offline
Post-a-holic
Registered: 06/04/06
Posts: 10164
Loc: Aberdeen, WA
Originally Posted By: Ian
I have two with over 10,000 posts each - eek!! Goodness knows how many are over 200 smile

Looks like I will holding fire for a while smile


That should be fine. Basically what it does, is it will only import the one topic and then refresh right after it to avoid a browser timeout. 200 is just a number I pulled out of my...um....head, and can probably be much higher. wink
Top
#1407 - 07/19/06 12:03 PM Re: import from threads 6.5.4 problem [Re: Rick]
Ian Offline
Registered: 06/05/06
Posts: 4337
Loc: Essex, UK
so my 10,000 post threads should be fine (I think one is around 12,500 posts long at the moment)

Thanks.
Top
#1408 - 07/19/06 12:07 PM Re: import from threads 6.5.4 problem [Re: Ian]
Rick Offline
Post-a-holic
Registered: 06/04/06
Posts: 10164
Loc: Aberdeen, WA
It should be. The SQL part isn't really the issue, the queries are very quick, the only problem I've had to work on avoiding is a browser timeout. Only 1 way to find out for sure though is by setting up a test forum for a test run wink Yours would be a great experiment laugh
Top
#1418 - 07/19/06 01:10 PM Re: import from threads 6.5.4 problem [Re: Rick]
Ian Offline
Registered: 06/05/06
Posts: 4337
Loc: Essex, UK
My only issue at the moment is upgrading to 6.5.4 - I run 6.5.2 and cannot upgrade until I actually switch.

My only option is to install a duplicate site, and upgrade that.

I am assuming that one can't just set up a beta and then import a 6.5.2 database.
Top
#1420 - 07/19/06 01:22 PM Re: import from threads 6.5.4 problem [Re: Ian]
Rick Offline
Post-a-holic
Registered: 06/04/06
Posts: 10164
Loc: Aberdeen, WA
The import will actually work as long as you are at least running version 6.5. So since you are running 6.5.2 you can do just that. Setup the beta and then do the import. wink
Top
#1425 - 07/19/06 02:05 PM Re: import from threads 6.5.4 problem [Re: Rick]
Ian Offline
Registered: 06/05/06
Posts: 4337
Loc: Essex, UK
Ok cool smile Thanks.

Top
#1428 - 07/19/06 02:17 PM Re: import from threads 6.5.4 problem [Re: Ian]
AllenAyres Offline

Registered: 12/29/03
Posts: 1995
Loc: Texas
I've found through many many imports that you'll probably have better results with the timeout issues if you use firefox. With the newest changes IE will probably be ok, but firefox doesn't time out as badly.
_________________________
- Allen
- ThreadsDev | PraiseCafe
Top
#1435 - 07/19/06 03:12 PM Re: import from threads 6.5.4 problem [Re: ]
Jamin Offline
newbie
Registered: 06/05/06
Posts: 47
Loc: Dallas, TX
Rick, just FYI the fix worked great, and it imported everything correctly this time.

---Jamin
_________________________
"Those who would give up essential liberty to purchase a little temporary safety, deserve neither liberty nor safety."
Top
#1436 - 07/19/06 03:28 PM Re: import from threads 6.5.4 problem [Re: Jamin]
Rick Offline
Post-a-holic
Registered: 06/04/06
Posts: 10164
Loc: Aberdeen, WA
Thanks for the update Jamin. Good to hear!
Top
#1450 - 07/19/06 04:46 PM Re: import from threads 6.5.4 problem [Re: Rick]
Zarzal Offline
old hand
Registered: 06/05/06
Posts: 1142
Loc: Berlin, Germany
my import is finish and it works. More then 100.000 potings in nearly 9.000 topics and 11.000 private topics imported. All fine.

the only thing I note (and it seems to be by design): all polls start from 0, the old results get not transferd.
_________________________
my board: http://www.dragon-clan.de
my hobby: http://www.biker-reise.de
Ich kann bei Fragen zu UBBthreads in Deutsch weiterhelfen oder es zumindest versuchen
Top
#1453 - 07/19/06 05:03 PM Re: import from threads 6.5.4 problem [Re: Zarzal]
Rick Offline
Post-a-holic
Registered: 06/04/06
Posts: 10164
Loc: Aberdeen, WA
Hmm, it is supposed to transfer the results. It's ok that they start from 0, but results should have been brought over as well. I'll need to debug this to get it fixed.
Top
#1483 - 07/20/06 12:38 AM Re: import from threads 6.5.4 problem [Re: Rick]
Mors Offline
addict
Registered: 06/26/06
Posts: 471
Loc: So. California
Originally Posted By: Rick
I think I found the problem, just a quick little change. If you edit your threads_import.php file line 773 has a block of code that looks like this:

Php Code:
$end = $end - (20 - $topic_count);
break; 


Change that, to this:

Php Code:
$end = $end - (20 - $topic_count);
$more = true;
break; 




This worked perfect for me today.. My conversion stopped at like 800 posts.. this fixed it.
_________________________
Happy Customer !!!
Top
#1508 - 07/20/06 10:48 AM Re: import from threads 6.5.4 problem [Re: Mors]
Zarzal Offline
old hand
Registered: 06/05/06
Posts: 1142
Loc: Berlin, Germany
Just a note:
Importet postings with included quotes looks different. I guess its related to the diffent styles from ubb6.5 and ubb7 and the handling of quotes. Postings will transfered and not modifed in its body so the new quote layout is not applied.
_________________________
my board: http://www.dragon-clan.de
my hobby: http://www.biker-reise.de
Ich kann bei Fragen zu UBBthreads in Deutsch weiterhelfen oder es zumindest versuchen
Top
Page 1 of 3 1 2 3 >



Moderator:  AllenAyres, Harold, Ian, Ron M 
Shout Box

Today's Birthdays
No Birthdays
Recent Topics
Ability to "like" individual posts (not Facebook "likes)
by doug
Today at 09:03 AM
Island Permissions
by ThreadsUser
Yesterday at 03:03 PM
streaming video
by prkrgrp
05/20/12 07:02 PM
New Posts Corrupted? Can someone help?
by PianoWorld
05/19/12 09:41 AM
Custom forum permissions
by ntdoc
05/18/12 02:07 PM
Forum Stats
10488 Members
36 Forums
33835 Topics
181687 Posts

Max Online: 978 @ 06/24/07 11:19 PM
Random Image