Site Links
Home
Features
Documentation
Pricing & Order
Members Area
Support Options
Who's Online
2 registered (driv, Ruben Rocha), 23 Guests and 25 Spiders online.
Key: Admin, Global Mod, Mod
Featured Member

LMG
Registered: 07/01/07
Posts: 5
Top Posters (30 Days)
Ruben Rocha 188
Gizmo 107
Rick 100
Thelockman 78
driv 39
AllenAyres 35
Sirdude 29
ntdoc 28
Ian 21
Wordz 18
Latest Photos
My Home System
test photo gallery
Bernese Mountain Dogs
My Daimler
Dorado and shark
Page 1 of 2 1 2 >
Topic Options
Rate This Topic
#3487 - 09/19/06 02:24 AM Import Utility - Any Chance of Speeding Up?
BellaOnline Offline
enthusiast

Registered: 06/12/06
Posts: 387
I'm doing a test of the upgrade utility on my threads forum. I took my existing forum down at 1am. Now it's 5am and it's still updating users -

Processing users 15001 - 15201 of 22333

I'm worried that it's going to be quite a while before this all imports and I can re-start the existing forum again. Is there any hope of speeding this process up? The forums are on a dedicated high speed server, maybe they can go in larger loops than just 200?
_________________________
Lisa Shea, owner, BellaOnline.com
BellaOnline Website
BellaOnline Forums

Top
#3488 - 09/19/06 02:28 AM Re: Import Utility - Any Chance of Speeding Up? [Re: BellaOnline]
BellaOnline Offline
enthusiast

Registered: 06/12/06
Posts: 387
OK just a quibble, in this line -

Importing Topic (Betta Fish Shows) and it's 4 replies.

it should be "its". The contraction "it's" is only for "It is". There is

his
hers
its

none have apostrophes.
_________________________
Lisa Shea, owner, BellaOnline.com
BellaOnline Website
BellaOnline Forums

Top
#3490 - 09/19/06 04:44 AM Re: Import Utility - Any Chance of Speeding Up? [Re: BellaOnline]
BellaOnline Offline
enthusiast

Registered: 06/12/06
Posts: 387
OK, well I stayed up until 7:44am to see this through and after all that it failed!!

Importing Moderator Permissions for (12106)
Script:
Line#:
SQL Error:
SQL Error #: 0
Query: insert into newubbt_MODERATOR_PERMISSIONS values ( '' , 0 , 1 , 1 , 1 , 1 , 1 , 1 )

Any hope you can email a fix that just starts from here, rather than me having to start this all over from scratch?
_________________________
Lisa Shea, owner, BellaOnline.com
BellaOnline Website
BellaOnline Forums

Top
#3491 - 09/19/06 04:51 AM Re: Import Utility - Any Chance of Speeding Up? [Re: BellaOnline]
Gizmo Moderator Offline

***

Registered: 06/04/06
Posts: 12010
Loc: Portland, OR; USA
The importer file itself should have an area to adjust the ammount it uses for procesing (i'm thinking back to the intial testing anyway); its set at 200 as thats what was decided as a good number to avoid timeouts.
_________________________
UGN Security, Elite Web Gamers & VNC Web Design Owner
Longtime UBB Supporter, UBB7 Beta Tester & Resident Post-A-Holic

Top
#3498 - 09/19/06 08:35 AM Re: Import Utility - Any Chance of Speeding Up? [Re: Gizmo]
Rick Administrator Offline

*****

Registered: 06/04/06
Posts: 7904
Loc: Aberdeen, WA
It looks like your old db may be a little out of whack and there is a permission entry with no user. I'll add a fix to check for this. Line 1180 of threads_import.php looks like this:

Code:
if (!isset($user_array[$perm['P_Uid']])) {
	$new_uid = get_new_uid($perm['P_Uid']);
} else {
	$new_uid = $user_array[$perm['P_Uid']];
}


Right after that, add this:

if (!$new_uid) continuel

_________________________
UBB.threads™ Developer
My Personal Website · StogieSmokers.com

Top
#3499 - 09/19/06 08:37 AM Re: Import Utility - Any Chance of Speeding Up? [Re: Rick]
Rick Administrator Offline

*****

Registered: 06/04/06
Posts: 7904
Loc: Aberdeen, WA
As for speeding it up, I can add some variables to the top of the script for how many of each object to import per loop, but what they should be set at on a per server basis is hard to say. If it's too high on a slow server then there could be many timeouts, as Gizmo stated, which could lead to a bad import.
_________________________
UBB.threads™ Developer
My Personal Website · StogieSmokers.com

Top
#3527 - 09/19/06 06:23 PM Re: Import Utility - Any Chance of Speeding Up? [Re: Rick]
BellaOnline Offline
enthusiast

Registered: 06/12/06
Posts: 387
OK,I can do that - but will it start the entire import again from scratch? I'm taking the live board down when I do this, and that gets a *lot* of traffic. So I'd rather not take it down again for another 6-7 hours for these tests if I don't have to ...? Will the import realize that some of the tables are already full and skip them?

I realize the server timeout issues - could the first page do a test import of say 100 rows, see how long it takes, and then come back with a recommendation of row count? That shouldn't be too hard I imagine ...?

In any case I do want to do my part here and get through a full test for you before the beta period ends so I'll start it up again around 1am when the boards are at least relatively quiet.
_________________________
Lisa Shea, owner, BellaOnline.com
BellaOnline Website
BellaOnline Forums

Top
#3528 - 09/19/06 06:26 PM Re: Import Utility - Any Chance of Speeding Up? [Re: BellaOnline]
BellaOnline Offline
enthusiast

Registered: 06/12/06
Posts: 387
I don't mean to be trouble but I imagine you meant the line should be

if (!$new_uid) continue;

yes?
_________________________
Lisa Shea, owner, BellaOnline.com
BellaOnline Website
BellaOnline Forums

Top
#3529 - 09/19/06 08:07 PM Re: Import Utility - Any Chance of Speeding Up? [Re: BellaOnline]
Rick Administrator Offline

*****

Registered: 06/04/06
Posts: 7904
Loc: Aberdeen, WA
Woops, yes that line should end with a semi-colon.

If you go to threads_import.php?ubb=mods then it should be able to pick up since it died in a relatively safe spot but there isn't a guarantee on that since if it tries to import a duplicate mod then it might error with a duplicate key error. In that case it will probably require a fresh import unfortunately.
_________________________
UBB.threads™ Developer
My Personal Website · StogieSmokers.com

Top
#3534 - 09/19/06 11:15 PM Re: Import Utility - Any Chance of Speeding Up? [Re: Rick]
BellaOnline Offline
enthusiast

Registered: 06/12/06
Posts: 387
I had to delete the rows out of newubbt_MODERATOR_PERMISSIONS but once I did it did keep running past that point, starting from the ubb=mods URL.

On the polls import you don't say "out of X" to give a sense of how long that will take smile

Oddly on PMs it said -

Processing Private Messages 13501 - 13600 of 14697.

then on that same page it claimed it was done, and next went to an Import Complete page. What happened to the rest of the PMs? smile
_________________________
Lisa Shea, owner, BellaOnline.com
BellaOnline Website
BellaOnline Forums

Top
#3537 - 09/20/06 03:05 AM Re: Import Utility - Any Chance of Speeding Up? [Re: BellaOnline]
DebbieH103 Offline
newbie

Registered: 08/05/06
Posts: 27
Mine finished after 42 hours for 94,000 posts. I see a couple of issues, will start a new topic.

Top
#3557 - 09/20/06 08:31 PM Re: Import Utility - Any Chance of Speeding Up? [Re: DebbieH103]
BellaOnline Offline
enthusiast

Registered: 06/12/06
Posts: 387
We have 266,795 posts and it only took 7 hrs or so - and that includes the time to do a full backup of the existing system first. What kind of a system are you running on??
_________________________
Lisa Shea, owner, BellaOnline.com
BellaOnline Website
BellaOnline Forums

Top
Page 1 of 2 1 2 >


Shout Box

Today's Birthdays
No Birthdays
Recent Topics
PDF attachment file bug (Gizmo)
by cass
12/04/08 07:27 AM
Issue mass-emailing
by Mitch P.
12/03/08 12:55 PM
Inclusion of Locked/Closed thread capabilities
by QSS Tim
12/03/08 11:17 AM
Contact Page Problem
by David DelMonte
12/03/08 09:05 AM
FAQ bug,
by BreeOge
12/03/08 08:36 AM
Forum Stats
4261 Members
33 Forums
30540 Topics
155023 Posts

Max Online: 978 @ 06/24/07 08:19 PM