Site Links
Home
Features
Documentation
Pricing & Order
Members Area
Support Options
Who's Online
3 registered (Ruben Rocha, Thelockman, 1 invisible), 28 Guests and 15 Spiders online.
Key: Admin, Global Mod, Mod
Featured Member
Registered: 10/08/06
Posts: 49
Top Posters (30 Days)
Ruben Rocha 167
Rick 117
Gizmo 107
Thelockman 64
driv 53
AllenAyres 35
ScriptKeeper 34
Ian 31
Mark S 30
blaaskaak 28
Latest Photos
My Home System
test photo gallery
Bernese Mountain Dogs
My Daimler
Dorado and shark
Page 1 of 3 1 2 3 >
Topic Options
Rate This Topic
#1374 - 07/19/06 12:55 AM import from threads 6.5.4 problem
Zarzal Offline
old hand

Registered: 06/05/06
Posts: 1091
Loc: Berlin, Germany
Hi,

today I try out Threads7. I get the beta and the import script. I setup threads with just create the tables and then I run the importer. Seems good up to this point.

The importer begin to work and do something realy fast. As I note he stop a moment while importing the posts (=120) and continue importing the personal mail. I have up to 100.000 posts.

The script finish and I can logon with my just imported admin accounts. All boards are created, users seems to be fine but only a handfull of posts are ready.

Is there any way to get a logfile from the importer and some kind of debug view?

My Threads6 board is old and was years ago imported from classic. I fear that some inconsistency exists in the posting table that confuse the importer. Is some kind of check available to test this? What can I do now?
_________________________
my board: http://www.dragon-clan.de
my hobby: http://www.biker-reise.de
Ich kann bei Fragen zu UBBthreads in Deutsch weiterhelfen oder es zumindest versuchen

Top
#1375 - 07/19/06 02:15 AM Re: import from threads 6.5.4 problem [Re: Zarzal]
Zarzal Offline
old hand

Registered: 06/05/06
Posts: 1091
Loc: Berlin, Germany
I m on the way ... seems that I have very old usernames from imports in my database that contains / [ ] and , in B_AnonName.
Now I edit the db and run the importer again. We will see
_________________________
my board: http://www.dragon-clan.de
my hobby: http://www.biker-reise.de
Ich kann bei Fragen zu UBBthreads in Deutsch weiterhelfen oder es zumindest versuchen

Top
#1379 - 07/19/06 05:47 AM Re: import from threads 6.5.4 problem [Re: Zarzal]
Zarzal Offline
old hand

Registered: 06/05/06
Posts: 1091
Loc: Berlin, Germany
All usernames fixed but this doesn't fix my problem. There must be a post somewhere that give an error, but the import is to fast so I cant see any message. It imports 2803 postings from 100.000

/edit: is there a limit how long a imported thread can be? I have some talk threads with thousends of replys.

/edit2: Seems I found it:

Importing Topic (Frage & Antwort (Endlosthread)) and it's 2227 replies.
Large Topic Encountered. The rest of the topics in this batch will be handled on the next refresh.

Done! Now importing your titles, notes, banlists. (please wait)
(threads_import.php?ubb=extras)

but he dont continue the batch and jumps to:

importing Banned Host: 85.255.117.%
Importing Banned Email: jerk@jerk.com


Edited by Zarzal (07/19/06 06:39 AM)
_________________________
my board: http://www.dragon-clan.de
my hobby: http://www.biker-reise.de
Ich kann bei Fragen zu UBBthreads in Deutsch weiterhelfen oder es zumindest versuchen

Top
#1389 - 07/19/06 07:32 AM Re: import from threads 6.5.4 problem [Re: Zarzal]
Jamin Offline
newbie

Registered: 06/05/06
Posts: 47
Loc: Dallas, TX
Same deal here, except I'm on a much smaller forum. The importer brought in 949 out of 1498 topics, and 7703 out of 12896 posts. It missed a handful of posts from every forum, and left two of the forums empty entirely.

Everything else with the importer seemed to work fine. Got all my users, even got the groups and forum permissions, which surprised me. I was expecting to have to reset all that.

Anyway, yeah, just throwing my $0.02 in here, since Zarzal was reporting the same problem. Otherwise great job!

---Jamin
_________________________
"Those who would give up essential liberty to purchase a little temporary safety, deserve neither liberty nor safety."

Top
#1395 - 07/19/06 08:02 AM Re: import from threads 6.5.4 problem [Re: Jamin]
Rick Administrator Offline

*****

Registered: 06/04/06
Posts: 7883
Loc: Aberdeen, WA
Jamin, do you have any extremely large posts, one with alot of replies, as well? I think it's a problem when it runs into one of those that I need to fix.
_________________________
UBB.threads™ Developer
My Personal Website · StogieSmokers.com

Top
#1396 - 07/19/06 08:03 AM Re: import from threads 6.5.4 problem [Re: Rick]
Rick Administrator Offline

*****

Registered: 06/04/06
Posts: 7883
Loc: Aberdeen, WA
Thanks for all of the info Zarzal. It's definitely a problem with the large posts as you've found. I have to do some special tricks for those so we don't run into timeout problems and I don't think it's working quite right just yet. Will be working on this more.
_________________________
UBB.threads™ Developer
My Personal Website · StogieSmokers.com

Top
#1397 - 07/19/06 08:10 AM Re: import from threads 6.5.4 problem [Re: Rick]
Rick Administrator Offline

*****

Registered: 06/04/06
Posts: 7883
Loc: Aberdeen, WA
I think I found the problem, just a quick little change. If you edit your threads_import.php file line 773 has a block of code that looks like this:

Php Code:
$end = $end - (20 - $topic_count);
break; 


Change that, to this:

Php Code:
$end = $end - (20 - $topic_count);
$more = true;
break; 


_________________________
UBB.threads™ Developer
My Personal Website · StogieSmokers.com

Top
#1398 - 07/19/06 08:23 AM Re: import from threads 6.5.4 problem [Re: Rick]
Jamin Offline
newbie

Registered: 06/05/06
Posts: 47
Loc: Dallas, TX
Rick, I have a few posts with 100+ replies, but no really really big ones like Zarzal. My host is currently having a lot of issues with one of their file servers, so everything is slow as nuts right now, but I'll try that fix as soon as things pick up and see if it worked.

---Jamin
_________________________
"Those who would give up essential liberty to purchase a little temporary safety, deserve neither liberty nor safety."

Top
#1400 - 07/19/06 08:34 AM Re: import from threads 6.5.4 problem [Re: Jamin]
Rick Administrator Offline

*****

Registered: 06/04/06
Posts: 7883
Loc: Aberdeen, WA
Ok, right now a large topic is considered 200+ replies. So if you have any with over 200 it will skip the rest without that fix.
_________________________
UBB.threads™ Developer
My Personal Website · StogieSmokers.com

Top
#1403 - 07/19/06 08:54 AM Re: import from threads 6.5.4 problem [Re: Rick]
Ian Moderator Offline

***

Registered: 06/05/06
Posts: 4156
Loc: Essex, UK
I have two with over 10,000 posts each - eek!! Goodness knows how many are over 200 smile

Looks like I will holding fire for a while smile
_________________________
Fans Focus - Focusing on Fans of Sport

(Okay - mainly football (the British variety wink at the moment - but expanding all the time....))

Top
#1404 - 07/19/06 08:54 AM Re: import from threads 6.5.4 problem [Re: Rick]
Zarzal Offline
old hand

Registered: 06/05/06
Posts: 1091
Loc: Berlin, Germany
I do the modification and the import runs right now. Seems good but I have to wait a while for finish smile Thanks.
_________________________
my board: http://www.dragon-clan.de
my hobby: http://www.biker-reise.de
Ich kann bei Fragen zu UBBthreads in Deutsch weiterhelfen oder es zumindest versuchen

Top
#1405 - 07/19/06 08:57 AM Re: import from threads 6.5.4 problem [Re: Ian]
Rick Administrator Offline

*****

Registered: 06/04/06
Posts: 7883
Loc: Aberdeen, WA
Originally Posted By: Ian
I have two with over 10,000 posts each - eek!! Goodness knows how many are over 200 smile

Looks like I will holding fire for a while smile


That should be fine. Basically what it does, is it will only import the one topic and then refresh right after it to avoid a browser timeout. 200 is just a number I pulled out of my...um....head, and can probably be much higher. wink
_________________________
UBB.threads™ Developer
My Personal Website · StogieSmokers.com

Top
#1407 - 07/19/06 09:03 AM Re: import from threads 6.5.4 problem [Re: Rick]
Ian Moderator Offline

***

Registered: 06/05/06
Posts: 4156
Loc: Essex, UK
so my 10,000 post threads should be fine (I think one is around 12,500 posts long at the moment)

Thanks.
_________________________
Fans Focus - Focusing on Fans of Sport

(Okay - mainly football (the British variety wink at the moment - but expanding all the time....))

Top
#1408 - 07/19/06 09:07 AM Re: import from threads 6.5.4 problem [Re: Ian]
Rick Administrator Offline

*****

Registered: 06/04/06
Posts: 7883
Loc: Aberdeen, WA
It should be. The SQL part isn't really the issue, the queries are very quick, the only problem I've had to work on avoiding is a browser timeout. Only 1 way to find out for sure though is by setting up a test forum for a test run wink Yours would be a great experiment laugh
_________________________
UBB.threads™ Developer
My Personal Website · StogieSmokers.com

Top
#1418 - 07/19/06 10:10 AM Re: import from threads 6.5.4 problem [Re: Rick]
Ian Moderator Offline

***

Registered: 06/05/06
Posts: 4156
Loc: Essex, UK
My only issue at the moment is upgrading to 6.5.4 - I run 6.5.2 and cannot upgrade until I actually switch.

My only option is to install a duplicate site, and upgrade that.

I am assuming that one can't just set up a beta and then import a 6.5.2 database.
_________________________
Fans Focus - Focusing on Fans of Sport

(Okay - mainly football (the British variety wink at the moment - but expanding all the time....))

Top
#1420 - 07/19/06 10:22 AM Re: import from threads 6.5.4 problem [Re: Ian]
Rick Administrator Offline

*****

Registered: 06/04/06
Posts: 7883
Loc: Aberdeen, WA
The import will actually work as long as you are at least running version 6.5. So since you are running 6.5.2 you can do just that. Setup the beta and then do the import. wink
_________________________
UBB.threads™ Developer
My Personal Website · StogieSmokers.com

Top
#1425 - 07/19/06 11:05 AM Re: import from threads 6.5.4 problem [Re: Rick]
Ian Moderator Offline

***

Registered: 06/05/06
Posts: 4156
Loc: Essex, UK
Ok cool smile Thanks.

_________________________
Fans Focus - Focusing on Fans of Sport

(Okay - mainly football (the British variety wink at the moment - but expanding all the time....))

Top
#1428 - 07/19/06 11:17 AM Re: import from threads 6.5.4 problem [Re: Ian]
AllenAyres Moderator Offline

****

Registered: 12/29/03
Posts: 1628
Loc: Texas
I've found through many many imports that you'll probably have better results with the timeout issues if you use firefox. With the newest changes IE will probably be ok, but firefox doesn't time out as badly.
_________________________
- Allen
- ThreadsDev | PraiseCafe

Top
#1435 - 07/19/06 12:12 PM Re: import from threads 6.5.4 problem [Re: ]
Jamin Offline
newbie

Registered: 06/05/06
Posts: 47
Loc: Dallas, TX
Rick, just FYI the fix worked great, and it imported everything correctly this time.

---Jamin
_________________________
"Those who would give up essential liberty to purchase a little temporary safety, deserve neither liberty nor safety."

Top
#1436 - 07/19/06 12:28 PM Re: import from threads 6.5.4 problem [Re: Jamin]
Rick Administrator Offline

*****

Registered: 06/04/06
Posts: 7883
Loc: Aberdeen, WA
Thanks for the update Jamin. Good to hear!
_________________________
UBB.threads™ Developer
My Personal Website · StogieSmokers.com

Top
#1450 - 07/19/06 01:46 PM Re: import from threads 6.5.4 problem [Re: Rick]
Zarzal Offline
old hand

Registered: 06/05/06
Posts: 1091
Loc: Berlin, Germany
my import is finish and it works. More then 100.000 potings in nearly 9.000 topics and 11.000 private topics imported. All fine.

the only thing I note (and it seems to be by design): all polls start from 0, the old results get not transferd.
_________________________
my board: http://www.dragon-clan.de
my hobby: http://www.biker-reise.de
Ich kann bei Fragen zu UBBthreads in Deutsch weiterhelfen oder es zumindest versuchen

Top
#1453 - 07/19/06 02:03 PM Re: import from threads 6.5.4 problem [Re: Zarzal]
Rick Administrator Offline

*****

Registered: 06/04/06
Posts: 7883
Loc: Aberdeen, WA
Hmm, it is supposed to transfer the results. It's ok that they start from 0, but results should have been brought over as well. I'll need to debug this to get it fixed.
_________________________
UBB.threads™ Developer
My Personal Website · StogieSmokers.com

Top
#1483 - 07/19/06 09:38 PM Re: import from threads 6.5.4 problem [Re: Rick]
Mors Offline
addict

Registered: 06/26/06
Posts: 445
Loc: So. California
Originally Posted By: Rick
I think I found the problem, just a quick little change. If you edit your threads_import.php file line 773 has a block of code that looks like this:

Php Code:
$end = $end - (20 - $topic_count);
break; 


Change that, to this:

Php Code:
$end = $end - (20 - $topic_count);
$more = true;
break; 




This worked perfect for me today.. My conversion stopped at like 800 posts.. this fixed it.
_________________________
Happy Customer !!!

Top
#1508 - 07/20/06 07:48 AM Re: import from threads 6.5.4 problem [Re: Mors]
Zarzal Offline
old hand

Registered: 06/05/06
Posts: 1091
Loc: Berlin, Germany
Just a note:
Importet postings with included quotes looks different. I guess its related to the diffent styles from ubb6.5 and ubb7 and the handling of quotes. Postings will transfered and not modifed in its body so the new quote layout is not applied.
_________________________
my board: http://www.dragon-clan.de
my hobby: http://www.biker-reise.de
Ich kann bei Fragen zu UBBthreads in Deutsch weiterhelfen oder es zumindest versuchen

Top
Page 1 of 3 1 2 3 >