I'm doing a test of the upgrade utility on my threads forum. I took my existing forum down at 1am. Now it's 5am and it's still updating users -
Processing users 15001 - 15201 of 22333
I'm worried that it's going to be quite a while before this all imports and I can re-start the existing forum again. Is there any hope of speeding this process up? The forums are on a dedicated high speed server, maybe they can go in larger loops than just 200?
Express Hosting
"We are the official hosting company of UBB.threads. Ask us about our free migration services to migrate your UBB.threads installation."
#3488 - 09/19/0605:28 AMRe: Import Utility - Any Chance of Speeding Up?
[Re: BellaOnline]
Registered: 06/05/06
Posts: 14995
Loc: Portland, OR; USA
The importer file itself should have an area to adjust the ammount it uses for procesing (i'm thinking back to the intial testing anyway); its set at 200 as thats what was decided as a good number to avoid timeouts.
Registered: 06/04/06
Posts: 10164
Loc: Aberdeen, WA
It looks like your old db may be a little out of whack and there is a permission entry with no user. I'll add a fix to check for this. Line 1180 of threads_import.php looks like this:
Registered: 06/04/06
Posts: 10164
Loc: Aberdeen, WA
As for speeding it up, I can add some variables to the top of the script for how many of each object to import per loop, but what they should be set at on a per server basis is hard to say. If it's too high on a slow server then there could be many timeouts, as Gizmo stated, which could lead to a bad import.
OK,I can do that - but will it start the entire import again from scratch? I'm taking the live board down when I do this, and that gets a *lot* of traffic. So I'd rather not take it down again for another 6-7 hours for these tests if I don't have to ...? Will the import realize that some of the tables are already full and skip them?
I realize the server timeout issues - could the first page do a test import of say 100 rows, see how long it takes, and then come back with a recommendation of row count? That shouldn't be too hard I imagine ...?
In any case I do want to do my part here and get through a full test for you before the beta period ends so I'll start it up again around 1am when the boards are at least relatively quiet.
Registered: 06/04/06
Posts: 10164
Loc: Aberdeen, WA
Woops, yes that line should end with a semi-colon.
If you go to threads_import.php?ubb=mods then it should be able to pick up since it died in a relatively safe spot but there isn't a guarantee on that since if it tries to import a duplicate mod then it might error with a duplicate key error. In that case it will probably require a fresh import unfortunately.