|
Joined: Jun 2006
Posts: 693
Addict
|
Addict
Joined: Jun 2006
Posts: 693 |
I'm doing a test of the upgrade utility on my threads forum. I took my existing forum down at 1am. Now it's 5am and it's still updating users -
Processing users 15001 - 15201 of 22333
I'm worried that it's going to be quite a while before this all imports and I can re-start the existing forum again. Is there any hope of speeding this process up? The forums are on a dedicated high speed server, maybe they can go in larger loops than just 200?
|
|
|
|
Joined: Jun 2006
Posts: 693
Addict
|
Addict
Joined: Jun 2006
Posts: 693 |
OK just a quibble, in this line -
Importing Topic (Betta Fish Shows) and it's 4 replies.
it should be "its". The contraction "it's" is only for "It is". There is
his hers its
none have apostrophes.
|
|
|
|
Joined: Jun 2006
Posts: 693
Addict
|
Addict
Joined: Jun 2006
Posts: 693 |
OK, well I stayed up until 7:44am to see this through and after all that it failed!!
Importing Moderator Permissions for (12106) Script: Line#: SQL Error: SQL Error #: 0 Query: insert into newubbt_MODERATOR_PERMISSIONS values ( '' , 0 , 1 , 1 , 1 , 1 , 1 , 1 )
Any hope you can email a fix that just starts from here, rather than me having to start this all over from scratch?
|
|
|
|
Joined: Jun 2006
Posts: 16,299 Likes: 116
|
Joined: Jun 2006
Posts: 16,299 Likes: 116 |
The importer file itself should have an area to adjust the ammount it uses for procesing (i'm thinking back to the intial testing anyway); its set at 200 as thats what was decided as a good number to avoid timeouts.
|
|
|
|
Joined: Jun 2006
Posts: 9,242 Likes: 1
Former Developer
|
Former Developer
Joined: Jun 2006
Posts: 9,242 Likes: 1 |
It looks like your old db may be a little out of whack and there is a permission entry with no user. I'll add a fix to check for this. Line 1180 of threads_import.php looks like this:
if (!isset($user_array[$perm['P_Uid']])) {
$new_uid = get_new_uid($perm['P_Uid']);
} else {
$new_uid = $user_array[$perm['P_Uid']];
}
Right after that, add this: if (!$new_uid) continuel
|
|
|
|
Joined: Jun 2006
Posts: 9,242 Likes: 1
Former Developer
|
Former Developer
Joined: Jun 2006
Posts: 9,242 Likes: 1 |
As for speeding it up, I can add some variables to the top of the script for how many of each object to import per loop, but what they should be set at on a per server basis is hard to say. If it's too high on a slow server then there could be many timeouts, as Gizmo stated, which could lead to a bad import.
|
|
|
|
Joined: Jun 2006
Posts: 693
Addict
|
Addict
Joined: Jun 2006
Posts: 693 |
OK,I can do that - but will it start the entire import again from scratch? I'm taking the live board down when I do this, and that gets a *lot* of traffic. So I'd rather not take it down again for another 6-7 hours for these tests if I don't have to ...? Will the import realize that some of the tables are already full and skip them?
I realize the server timeout issues - could the first page do a test import of say 100 rows, see how long it takes, and then come back with a recommendation of row count? That shouldn't be too hard I imagine ...?
In any case I do want to do my part here and get through a full test for you before the beta period ends so I'll start it up again around 1am when the boards are at least relatively quiet.
|
|
|
|
Joined: Jun 2006
Posts: 693
Addict
|
Addict
Joined: Jun 2006
Posts: 693 |
I don't mean to be trouble but I imagine you meant the line should be
if (!$new_uid) continue;
yes?
|
|
|
|
Joined: Jun 2006
Posts: 9,242 Likes: 1
Former Developer
|
Former Developer
Joined: Jun 2006
Posts: 9,242 Likes: 1 |
Woops, yes that line should end with a semi-colon.
If you go to threads_import.php?ubb=mods then it should be able to pick up since it died in a relatively safe spot but there isn't a guarantee on that since if it tries to import a duplicate mod then it might error with a duplicate key error. In that case it will probably require a fresh import unfortunately.
|
|
|
|
Joined: Jun 2006
Posts: 693
Addict
|
Addict
Joined: Jun 2006
Posts: 693 |
I had to delete the rows out of newubbt_MODERATOR_PERMISSIONS but once I did it did keep running past that point, starting from the ubb=mods URL. On the polls import you don't say "out of X" to give a sense of how long that will take Oddly on PMs it said - Processing Private Messages 13501 - 13600 of 14697. then on that same page it claimed it was done, and next went to an Import Complete page. What happened to the rest of the PMs?
|
|
|
|
Joined: Aug 2006
Posts: 29
newbie
|
newbie
Joined: Aug 2006
Posts: 29 |
Mine finished after 42 hours for 94,000 posts. I see a couple of issues, will start a new topic.
|
|
|
|
Joined: Jun 2006
Posts: 693
Addict
|
Addict
Joined: Jun 2006
Posts: 693 |
We have 266,795 posts and it only took 7 hrs or so - and that includes the time to do a full backup of the existing system first. What kind of a system are you running on??
|
|
|
Bots
by Outdoorking - 04/13/2024 5:08 PM
|
|
|
|
|
|
1 members (1 invisible),
702
guests, and
193
robots. |
Key:
Admin,
Global Mod,
Mod
|
|
|
|