Previous Thread
Next Thread
Print Thread
Hop To
#166769 10/21/2006 4:42 PM
Joined: Sep 2006
Posts: 120
member
member
Joined: Sep 2006
Posts: 120
Is there a way or does anyone have a feel for how long it will take to import a Classic 6.7.2 into Threads 7.0??
There are:
Forums = 29
Topics = 2983
Posts = 18,574

Thanks Larry

Joined: Jun 2006
Posts: 16,299
Likes: 116
UBB.threads Developer
UBB.threads Developer
Joined: Jun 2006
Posts: 16,299
Likes: 116
It really varies on enviroment a well, probably be 3-6 hours


I am a Web Development Contractor, I do not work for UBBCentral. I have provided free User to User Support since the beginning of these support forums.
Do you need Forum Install or Upgrade Services?
Forums: A Gardeners Forum, Scouters World
UBB.threads: UBBWiki, UBB Styles, UBB.Sitemaps
Longtime Supporter & Resident Post-A-Holic
VNC Web Services: Code Modifications, Upgrades, Styling, Coding Services, Disaster Recovery, and more!
Joined: Aug 2006
Posts: 1,649
Likes: 1
Pooh-Bah
Pooh-Bah
Joined: Aug 2006
Posts: 1,649
Likes: 1
Mine took about 8+ hours with:

4,518 Members
16 Forums
13,908 Topics
335,346 Posts



GangsterBB.NET (Ver. 7.6.1.1)
PHP Version 5.6.40 / MySQL 5.7.23-23 (was 5.6.41-84.1) / Apache 2.4.54
2007 Content Rulez Contest - Hon Mention
UBB.classic 6.7.2 - RIP
Joined: Sep 2006
Posts: 120
member
member
Joined: Sep 2006
Posts: 120
Thanks guys.
Server seems pretty fast and ddoesn't appear loaded.
I have just under 800 users registered.
Server is Apache 1.3.36(unix) x86-64
So i'm guess it should go fairly fast.

Thanks for the input.


Joined: Jun 2006
Posts: 16,299
Likes: 116
UBB.threads Developer
UBB.threads Developer
Joined: Jun 2006
Posts: 16,299
Likes: 116
Yeh I'd think that it should go fairly well; my server was b0ged for my import so things took a whiel wink...

I tested my forums during private beta on the importer at anywhere from 2-6 hours, and my site has a good ammount of content on her wink.


I am a Web Development Contractor, I do not work for UBBCentral. I have provided free User to User Support since the beginning of these support forums.
Do you need Forum Install or Upgrade Services?
Forums: A Gardeners Forum, Scouters World
UBB.threads: UBBWiki, UBB Styles, UBB.Sitemaps
Longtime Supporter & Resident Post-A-Holic
VNC Web Services: Code Modifications, Upgrades, Styling, Coding Services, Disaster Recovery, and more!
Joined: Jan 2004
Posts: 2,474
Likes: 3
D
Pooh-Bah
Pooh-Bah
D Offline
Joined: Jan 2004
Posts: 2,474
Likes: 3
22 forums
3500 users
3000 topics
22000 posts

approx - 1hr 45mins

(give or take 15 mins as I went out and when I returned was surprised to see it finished already...)

Joined: Nov 2006
Posts: 3,095
Likes: 1
Carpal Tunnel
Carpal Tunnel
Joined: Nov 2006
Posts: 3,095
Likes: 1
Wow - I sure hope it doesn't take anywhere near 8+ hours to import.


Server 2003 Standard w/SP1
Total topics: 23218
Total posts: 169849
1.8Ghz P4
1.5MB RAM

The total database size with all tables is about 162MB currently in size.

Joined: Jan 2004
Posts: 2,474
Likes: 3
D
Pooh-Bah
Pooh-Bah
D Offline
Joined: Jan 2004
Posts: 2,474
Likes: 3
Originally Posted by ntdoc
1.5MB RAM

Really? Wow, see you in the year 3000 wink

Joined: Jun 2006
Posts: 811
old hand
old hand
Joined: Jun 2006
Posts: 811
Just curious...did most of you alert your hosting company about your import? It would stink to have it stopped mid-stream. Does the import place a big load on the server?

Joined: Nov 2006
Posts: 3,095
Likes: 1
Carpal Tunnel
Carpal Tunnel
Joined: Nov 2006
Posts: 3,095
Likes: 1
oops.... typo. Good catch, at least someone is reading stuff.

The system has 1.5GB of RAM

Joined: Jun 2006
Posts: 16,299
Likes: 116
UBB.threads Developer
UBB.threads Developer
Joined: Jun 2006
Posts: 16,299
Likes: 116
Mitch, the default settings in the importer should at the most, be kind to your isp (as well as your browser if using IE), you can increase and decrease the speed in the importer file itself (threads per refresh i believe it is).

It may be a good idea to tell your hosting company ahead of time that you're planning an import to a faster and more optimized version of the UBB, I'm sure they'll understand...

But then again, it is usually easier to ask forgiveness than to ask permission...


I am a Web Development Contractor, I do not work for UBBCentral. I have provided free User to User Support since the beginning of these support forums.
Do you need Forum Install or Upgrade Services?
Forums: A Gardeners Forum, Scouters World
UBB.threads: UBBWiki, UBB Styles, UBB.Sitemaps
Longtime Supporter & Resident Post-A-Holic
VNC Web Services: Code Modifications, Upgrades, Styling, Coding Services, Disaster Recovery, and more!
Joined: Jun 2006
Posts: 811
old hand
old hand
Joined: Jun 2006
Posts: 811
Thanks, yeah they'll be happy I'm going to SQL-based board.

Joined: Jun 2006
Posts: 16,299
Likes: 116
UBB.threads Developer
UBB.threads Developer
Joined: Jun 2006
Posts: 16,299
Likes: 116
They'll likely tell you to do it at off-peak hours, so be prepaired to start 8pm and roll onto the morning hours! :x...


I am a Web Development Contractor, I do not work for UBBCentral. I have provided free User to User Support since the beginning of these support forums.
Do you need Forum Install or Upgrade Services?
Forums: A Gardeners Forum, Scouters World
UBB.threads: UBBWiki, UBB Styles, UBB.Sitemaps
Longtime Supporter & Resident Post-A-Holic
VNC Web Services: Code Modifications, Upgrades, Styling, Coding Services, Disaster Recovery, and more!
Joined: Jan 2004
Posts: 2,474
Likes: 3
D
Pooh-Bah
Pooh-Bah
D Offline
Joined: Jan 2004
Posts: 2,474
Likes: 3
I've just imported again (see earlier post).

Last time it was around an hour and a half - this time, less than 30 minutes laugh

3146 Members
17 Forums
3346 Topics
21471 Posts

Joined: Jun 2006
Posts: 3,837
I
Ian Offline
Carpal Tunnel
Carpal Tunnel
I Offline
Joined: Jun 2006
Posts: 3,837
Can make a difference on time of day. depending upon what else is running on the server. smile

Joined: Aug 2006
Posts: 29
D
newbie
newbie
D Offline
Joined: Aug 2006
Posts: 29
I went to bed on mine after 4 hours, and it did nothing the 7 hours I was in bed. I hit go button and it started again. It is on forum 9 out of 82. Importing the 3200 plus members took about 1 hour. I am now over 12 hours on the posts with no end in site. At this rate, it will take 2 or 3 days.

Joined: Nov 2006
Posts: 3,095
Likes: 1
Carpal Tunnel
Carpal Tunnel
Joined: Nov 2006
Posts: 3,095
Likes: 1
Well can't speak for UBB Classic as I upgraded from 6.5.1 Threads to 7.02

11666 Members
11 Forums
23482 Topics
170759 Posts

I also have a dedicated Server 2003 w/1GB RAM and P4 3.0Ghz

My upgrade took just under an hour.

A few hiccups along the way mainly due to my non-familiarity with the software and processes.


As always, make sure you have a valid backup of MySQL, PHP, Website, and UBB before attempting the upgrade.

Then take another backup once you've completed the upgrade and before you start to customize it too much.


Joined: Jun 2006
Posts: 16,299
Likes: 116
UBB.threads Developer
UBB.threads Developer
Joined: Jun 2006
Posts: 16,299
Likes: 116
Classic will take longer than threads; also yout servers available resources plys a good factor as well.


I am a Web Development Contractor, I do not work for UBBCentral. I have provided free User to User Support since the beginning of these support forums.
Do you need Forum Install or Upgrade Services?
Forums: A Gardeners Forum, Scouters World
UBB.threads: UBBWiki, UBB Styles, UBB.Sitemaps
Longtime Supporter & Resident Post-A-Holic
VNC Web Services: Code Modifications, Upgrades, Styling, Coding Services, Disaster Recovery, and more!
Joined: Nov 2006
Posts: 3,095
Likes: 1
Carpal Tunnel
Carpal Tunnel
Joined: Nov 2006
Posts: 3,095
Likes: 1
Totally agree, and probably most don't have a dedicated server.

As some have posted already showing that on their shared server with many, many other sites, have run out of memory for MySQL or other resources that highly impact or even halt the upgrade process.

I count myself among the lucky ones...


Joined: Jun 2006
Posts: 16,299
Likes: 116
UBB.threads Developer
UBB.threads Developer
Joined: Jun 2006
Posts: 16,299
Likes: 116
One has to wonder what a freaked out webhost is capable of, which is why I highly advise alerting yoru host to your overnight activities of upgrading your forums... :x

Last edited by Gizmo; 11/27/2006 10:20 PM.

I am a Web Development Contractor, I do not work for UBBCentral. I have provided free User to User Support since the beginning of these support forums.
Do you need Forum Install or Upgrade Services?
Forums: A Gardeners Forum, Scouters World
UBB.threads: UBBWiki, UBB Styles, UBB.Sitemaps
Longtime Supporter & Resident Post-A-Holic
VNC Web Services: Code Modifications, Upgrades, Styling, Coding Services, Disaster Recovery, and more!
Joined: Aug 2006
Posts: 29
D
newbie
newbie
D Offline
Joined: Aug 2006
Posts: 29
my 85,000 went a day, and I wish I had thought of alerting webhost. Seems so obvious now.

Joined: Jun 2006
Posts: 16,299
Likes: 116
UBB.threads Developer
UBB.threads Developer
Joined: Jun 2006
Posts: 16,299
Likes: 116
Webhost:
. Apache and MySQL are going APE!
.. Fix: Restart them both.

User:
. My import keeps stopping
.. Restart it!

Webhost:
. Apache and MySQL are going ape again, apache listing shows www.thissite.tld.
.. Fix: Suspend www.thissite.tld


I am a Web Development Contractor, I do not work for UBBCentral. I have provided free User to User Support since the beginning of these support forums.
Do you need Forum Install or Upgrade Services?
Forums: A Gardeners Forum, Scouters World
UBB.threads: UBBWiki, UBB Styles, UBB.Sitemaps
Longtime Supporter & Resident Post-A-Holic
VNC Web Services: Code Modifications, Upgrades, Styling, Coding Services, Disaster Recovery, and more!
Joined: Jun 2006
Posts: 142
G
member
member
G Offline
Joined: Jun 2006
Posts: 142
I started a test import of a very old version of my database, because I wanted to try it out before I tried it on a newer version and because that copy was already upgraded to 6.5.x.

Almost 20 hours later it's still not finished. It's on topic 26000 out of 33000, and the live database has over 41000 topics, I wonder how long that's going to take. Granted, the live server is quite a bit faster than the test server, but still it seems a bit insane. This is on a Pentium 3 700 MHz with 256MB memory, but the load is around 5% normally (with peaks up to 60%) so it's hardly a performance problem.

Had a look at the code to see if it was easy to change the number of topics per page load, but the numbers were hard coded. It would be nice if it was a variable set at the top so that there is only one place to change. Less risk of mistakes. The load won't be a problem, neither is an overzealous server admin, as it's my own dedicated server and I plan on shutting down the site for a weekend to do the upgrade. Especially since it will take me the better part of a day just to upgrade the database from v6.1 to v6.5...

Last edited by Gardener; 11/28/2006 7:40 AM.

aka Olle Johansson
Joined: Nov 2006
Posts: 3,095
Likes: 1
Carpal Tunnel
Carpal Tunnel
Joined: Nov 2006
Posts: 3,095
Likes: 1
Is this on Linux or Windows? Flat file transfers are a bit SLOW on most systems. Are you sure RAM and Swap are not being fully utilized?


Joined: Jun 2006
Posts: 142
G
member
member
G Offline
Joined: Jun 2006
Posts: 142
It's Fedora Linux, there is no significant swap usage. Raised it to 50 topics per page load, but I don't really think it affected the time/topic by much. I'm closing in on 30 hours now and Iä've got 1000 topics to go.

The MySQL isn't tuned, and it's on v4.1.20, but I can't see that it would affect this that much.


aka Olle Johansson
Joined: Nov 2006
Posts: 3,095
Likes: 1
Carpal Tunnel
Carpal Tunnel
Joined: Nov 2006
Posts: 3,095
Likes: 1
It's difficult to say without doing some real analysis.

It could be that the code to do the import is just not well written. It could be your Disks are old and slow. Probably nothing you're going to be able to quickly do except maybe check and see if RAM is an issue. The other items you probably just can't really fix without a lot of time / cost or both.

If your database is 150+MB then you have to be low on memory usage with 256MB for the entire system. If the database is less than that then memory might be okay.



Joined: Jun 2006
Posts: 9,242
Likes: 1
R
Former Developer
Former Developer
R Offline
Joined: Jun 2006
Posts: 9,242
Likes: 1
That's definitely slower than normal. The longest import I've had yet has been about 24 hours from a classic board that has 1.1 million posts and about 80k users.

Memory *could* come into play if you have a number of topics with a large number of replies as when it imports them, it reads all of the replies of a topic into memory and then writes them to the new database.

The biggest factor is probably disk speed as there are a large number of database queries done on each refresh, so if your disk speed is slow it will definitely lead to a slow import.

Joined: Jun 2006
Posts: 142
G
member
member
G Offline
Joined: Jun 2006
Posts: 142
It took about 31 hours before it finally finished. Certainly won't do that again on the test server, next time will be on the production server for sure. I haven't checked, but I don't think I have that many really long threads.

Don't really know what kind of disks are in the test server, but the server is quite old so it's probably no speed freaks.

A CLI version of the importer script would be quite nice though, would feel a bit safer than having to rely on the browser, and it wouldn't need to be done in steps either.

Now I'm off to have a look at all the new features and to start tweaking.


aka Olle Johansson

Link Copied to Clipboard
ShoutChat
Comment Guidelines: Do post respectful and insightful comments. Don't flame, hate, spam.
Recent Topics
Bots
by Outdoorking - 04/13/2024 5:08 PM
Can you add html to language files?
by Baldeagle - 04/07/2024 2:41 PM
Do I need to rebuild my database?
by Baldeagle - 04/07/2024 2:58 AM
This is not a bug, but a suggestion
by Baldeagle - 04/05/2024 11:25 PM
Is UBB.threads still going?
by Aaron101 - 04/01/2022 8:18 AM
Who's Online Now
2 members (DennyP, 1 invisible), 972 guests, and 155 robots.
Key: Admin, Global Mod, Mod
Random Gallery Image
Latest Gallery Images
Los Angeles
Los Angeles
by isaac, August 6
3D Creations
3D Creations
by JAISP, December 30
Artistic structures
Artistic structures
by isaac, August 29
Stones
Stones
by isaac, August 19
Powered by UBB.threads™ PHP Forum Software 8.0.0
(Preview build 20230217)