Site Links
Home
Features
Documentation
Pricing & Order
Members Area
Support Options
Who's Online
1 registered (Gizmo), 20 Guests and 15 Spiders online.
Key: Admin, Global Mod, Mod
Featured Member
Registered: 02/15/08
Posts: 17
Top Posters (30 Days)
Ruben Rocha 103
Rick 81
Mark S 72
Thelockman 56
Gizmo 54
driv 35
ntdoc 32
Sirdude 29
packlite 24
AllenAyres 22
Latest Photos
bear test
Beach Barbie-Q
Sunset
Accept the challenge!
Trees
Page 1 of 2 1 2 >
Topic Options
Rate This Topic
#3487 - 09/19/06 02:24 AM Import Utility - Any Chance of Speeding Up?
BellaOnline Offline
enthusiast

Registered: 06/12/06
Posts: 394
I'm doing a test of the upgrade utility on my threads forum. I took my existing forum down at 1am. Now it's 5am and it's still updating users -

Processing users 15001 - 15201 of 22333

I'm worried that it's going to be quite a while before this all imports and I can re-start the existing forum again. Is there any hope of speeding this process up? The forums are on a dedicated high speed server, maybe they can go in larger loops than just 200?
_________________________
Lisa Shea, owner, BellaOnline.com
BellaOnline Website
BellaOnline Forums

Top
#3488 - 09/19/06 02:28 AM Re: Import Utility - Any Chance of Speeding Up? [Re: BellaOnline]
BellaOnline Offline
enthusiast

Registered: 06/12/06
Posts: 394
OK just a quibble, in this line -

Importing Topic (Betta Fish Shows) and it's 4 replies.

it should be "its". The contraction "it's" is only for "It is". There is

his
hers
its

none have apostrophes.
_________________________
Lisa Shea, owner, BellaOnline.com
BellaOnline Website
BellaOnline Forums

Top
#3490 - 09/19/06 04:44 AM Re: Import Utility - Any Chance of Speeding Up? [Re: BellaOnline]
BellaOnline Offline
enthusiast

Registered: 06/12/06
Posts: 394
OK, well I stayed up until 7:44am to see this through and after all that it failed!!

Importing Moderator Permissions for (12106)
Script:
Line#:
SQL Error:
SQL Error #: 0
Query: insert into newubbt_MODERATOR_PERMISSIONS values ( '' , 0 , 1 , 1 , 1 , 1 , 1 , 1 )

Any hope you can email a fix that just starts from here, rather than me having to start this all over from scratch?
_________________________
Lisa Shea, owner, BellaOnline.com
BellaOnline Website
BellaOnline Forums

Top
#3491 - 09/19/06 04:51 AM Re: Import Utility - Any Chance of Speeding Up? [Re: BellaOnline]
Gizmo Moderator Online   sleepy

***

Registered: 06/04/06
Posts: 12089
Loc: Portland, OR; USA
The importer file itself should have an area to adjust the ammount it uses for procesing (i'm thinking back to the intial testing anyway); its set at 200 as thats what was decided as a good number to avoid timeouts.
_________________________
UGN Security, Elite Web Gamers & VNC Web Design Owner
Longtime UBB Supporter, UBB7 Beta Tester & Resident Post-A-Holic

Top
#3498 - 09/19/06 08:35 AM Re: Import Utility - Any Chance of Speeding Up? [Re: Gizmo]
Rick Administrator Online   content

*****

Registered: 06/04/06
Posts: 7993
Loc: Aberdeen, WA
It looks like your old db may be a little out of whack and there is a permission entry with no user. I'll add a fix to check for this. Line 1180 of threads_import.php looks like this:

Code:
if (!isset($user_array[$perm['P_Uid']])) {
	$new_uid = get_new_uid($perm['P_Uid']);
} else {
	$new_uid = $user_array[$perm['P_Uid']];
}


Right after that, add this:

if (!$new_uid) continuel

_________________________
UBB.threads™ Developer
My Personal Website · StogieSmokers.com

Top
#3499 - 09/19/06 08:37 AM Re: Import Utility - Any Chance of Speeding Up? [Re: Rick]
Rick Administrator Online   content

*****

Registered: 06/04/06
Posts: 7993
Loc: Aberdeen, WA
As for speeding it up, I can add some variables to the top of the script for how many of each object to import per loop, but what they should be set at on a per server basis is hard to say. If it's too high on a slow server then there could be many timeouts, as Gizmo stated, which could lead to a bad import.
_________________________
UBB.threads™ Developer
My Personal Website · StogieSmokers.com

Top
#3527 - 09/19/06 06:23 PM Re: Import Utility - Any Chance of Speeding Up? [Re: Rick]
BellaOnline Offline
enthusiast

Registered: 06/12/06
Posts: 394
OK,I can do that - but will it start the entire import again from scratch? I'm taking the live board down when I do this, and that gets a *lot* of traffic. So I'd rather not take it down again for another 6-7 hours for these tests if I don't have to ...? Will the import realize that some of the tables are already full and skip them?

I realize the server timeout issues - could the first page do a test import of say 100 rows, see how long it takes, and then come back with a recommendation of row count? That shouldn't be too hard I imagine ...?

In any case I do want to do my part here and get through a full test for you before the beta period ends so I'll start it up again around 1am when the boards are at least relatively quiet.
_________________________
Lisa Shea, owner, BellaOnline.com
BellaOnline Website
BellaOnline Forums

Top
#3528 - 09/19/06 06:26 PM Re: Import Utility - Any Chance of Speeding Up? [Re: BellaOnline]
BellaOnline Offline
enthusiast

Registered: 06/12/06
Posts: 394
I don't mean to be trouble but I imagine you meant the line should be

if (!$new_uid) continue;

yes?
_________________________
Lisa Shea, owner, BellaOnline.com
BellaOnline Website
BellaOnline Forums

Top
#3529 - 09/19/06 08:07 PM Re: Import Utility - Any Chance of Speeding Up? [Re: BellaOnline]
Rick Administrator Online   content

*****

Registered: 06/04/06
Posts: 7993
Loc: Aberdeen, WA
Woops, yes that line should end with a semi-colon.

If you go to threads_import.php?ubb=mods then it should be able to pick up since it died in a relatively safe spot but there isn't a guarantee on that since if it tries to import a duplicate mod then it might error with a duplicate key error. In that case it will probably require a fresh import unfortunately.
_________________________
UBB.threads™ Developer
My Personal Website · StogieSmokers.com

Top
#3534 - 09/19/06 11:15 PM Re: Import Utility - Any Chance of Speeding Up? [Re: Rick]
BellaOnline Offline
enthusiast

Registered: 06/12/06
Posts: 394
I had to delete the rows out of newubbt_MODERATOR_PERMISSIONS but once I did it did keep running past that point, starting from the ubb=mods URL.

On the polls import you don't say "out of X" to give a sense of how long that will take smile

Oddly on PMs it said -

Processing Private Messages 13501 - 13600 of 14697.

then on that same page it claimed it was done, and next went to an Import Complete page. What happened to the rest of the PMs? smile
_________________________
Lisa Shea, owner, BellaOnline.com
BellaOnline Website
BellaOnline Forums

Top
Page 1 of 2 1 2 >


Shout Box

Today's Birthdays
GOTMYSELFA...., smilinjack
Recent Topics
New members don't get access and are not displayed in the config panel
by Yomar
Today at 03:32 AM
How to Change Link Color / Underline in styles?
by ECNet
Yesterday at 10:00 PM
Chaging the "max online" number and date
by wanted
Yesterday at 02:22 PM
7.4.1. In Threaded Mode - "Mark All Read" Doesn't Work
by packlite
Yesterday at 10:26 AM
Custom island with sql connection
by Robje01
Yesterday at 09:13 AM
Forum Stats
4296 Members
33 Forums
30687 Topics
156015 Posts

Max Online: 978 @ 06/24/07 08:19 PM