Site Links
Home
Features
Documentation
Pricing & Order
Members Area
Support Options
UBBDev.com
UBBWiki.com
Who's Online
2 registered (SteveS, Jake), 47 Guests and 15 Spiders online.
Key: Admin, Global Mod, Mod
Featured Member
Registered: 06/05/06
Posts: 709
Top Posters (30 Days)
Ruben 51
Gizmo 24
DennyP 24
Dunny 15
SteveS 13
AllenAyres 12
SD 10
dbremer 10
drkknght00 9
doug 8
Latest Photos
OK Corral Shoot Out
Testing
Basildon Train Station
Basildon Town Centre looking from the rounderbout
Basildon Town Square
Page 2 of 3 < 1 2 3 >
Topic Options
#227433 - 07/01/09 03:45 AM Re: Generation times and Ubbthreads logo appear in header, not footer - screenshot [Re: Ruben]
Rick Offline
Post-a-holic
Registered: 06/04/06
Posts: 10164
Loc: Aberdeen, WA
If the number you're searching for is longer than the minimum character limit, then it should just work. For example, doing a fulltext search here, looking for 1234

Sql Query:
SELECT POST_ID FROM ubbt_POSTS WHERE MATCH (POST_BODY) against ('1234' in boolean mode)


Comes up with several results, including:

http://www.ubbcentral.com/forums/ubbthreads.php/topics/151140#Post151140
http://www.ubbcentral.com/forums/ubbthreads.php/topics/150457#Post150457
Top
Express Hosting
Express Hosting "We are the official hosting company of UBB.threads. Ask us about our free migration services to migrate your UBB.threads installation."
#227435 - 07/01/09 01:22 PM Re: Generation times and Ubbthreads logo appear in header, not footer - screenshot [Re: Rick]
24hourcampfire Offline
journeyman
Registered: 11/02/06
Posts: 91
Guys:

I'm still having a lot of trouble with 7.53 since I upgraded last week.

Normally, server load is between 0.10 and 0.50. Then, all of a sudden, load spikes to 3, 4, and this morning at 7:25-7:30 (far from peak time), to 6.20, and generation times to 300-400 seconds.

Here's what the slow query log says:

Code:
ORDER BY p.POST_POSTED_TIME DESC
LIMIT 200;
# Time: 090701  7:27:20
# User@Host: XXXXXXXXXXXXXXXXXX @ XXXXXXXXXXXXXXXX []
# Query_time: 337  Lock_time: 322  Rows_sent: 1  Rows_examined: 272558
SELECT count(p.POST_ID)
		FROM ubbt_POSTS p,
				 ubbt_TOPICS t
		WHERE p.USER_ID IN ( 2, 247, 260, 289, 694, 1087, 1245, 2437, 2891, 3411, 6493, 6930, 7152, 8172, 8207, 8711, 11852, 12183, 12873, 14652, 14703, 22110, 22362 )
			AND	p.TOPIC_ID = t.TOPIC_ID
		and t.FORUM_ID not in ('42','66','69');


Here's another at the same time:

Code:
# Time: 090701  7:27:05
# User@Host:XXXXXXXXXXXXXXXXXXXX @ XXXXXXXXXXXXXXXXXX []
# Query_time: 322  Lock_time: 0  Rows_sent: 200  Rows_examined: 3315585
SELECT p.POST_ID
		FROM 	ubbt_POSTS p LEFT JOIN ubbt_POSTS pp on p.POST_ID=pp.POST_ID,
					ubbt_TOPICS t
		WHERE p.POST_IS_APPROVED = '1'
			AND t.TOPIC_STATUS <> 'M'
			AND t.FORUM_ID IN ('1','2','3','4','5','6','7','8','9','10','11','12','13','14','15','16','17','18','20','21','22','23','24','25','26','27','28','29','30','31','32','33','34','35','36','37','38','39','40','41','43','44','45','46','47','48','49','50','51','52','53','55','56','57','58','59','61','62','63','64','65','67','68','70')
			AND p.TOPIC_ID = t.TOPIC_ID
		AND MATCH p.POST_SUBJECT AGAINST ('Columbia' IN BOOLEAN MODE)
		
		AND p.POST_POSTED_TIME > '1183386103'



I have the mysql search enabled, not internal, I have results limited to 200, and the weird thing is, a week ago when I was still on 7.1, I did not have these spikes. Something happened when I went from 7.1 to 7.53, and now, intermittently, but regularly throughout the day, the board will go from humming along with a very low load to basically being locked down for minutes at a time.

It's feast or famine!

Server is a dual Opteron, 4 GB of RAM, 4 15K RPM SCSI with RAID 10.

I'll take any help I can get. I'm willing to upgrade the server if necessary, but I can't believe that everything was humming along just fine with 7.1 and that 7.53 can't do the same with this server. Something, somewhere is not set right, I suspect, and I appreciate any help you fine folks can provide in helping me ID the problem.
_________________________
Rick Bin
24hourcampfire.com

http://www.24hourcampfire.com/ubbthreads/ubbthreads.php
Top
#227436 - 07/01/09 01:22 PM Re: Generation times and Ubbthreads logo appear in header, not footer - screenshot [Re: 24hourcampfire]
24hourcampfire Offline
journeyman
Registered: 11/02/06
Posts: 91
Geez guys, I'm in the middle of a spike, and server load is 34.19!!!!
_________________________
Rick Bin
24hourcampfire.com

http://www.24hourcampfire.com/ubbthreads/ubbthreads.php
Top
#227437 - 07/01/09 01:26 PM Re: Generation times and Ubbthreads logo appear in header, not footer - screenshot [Re: 24hourcampfire]
24hourcampfire Offline
journeyman
Registered: 11/02/06
Posts: 91
Here's the current mytop status :

MySQL on localhost (4.1.22-standard-log) up 0+00:53:46 [10:06:38]
Queries: 385.4k qps: 122 Slow: 27.0 Se/In/Up/De(%): 45/02/08/00
qps now: 1 Slow qps: 0.0 Threads: 392 ( 391/ 0) 33/00/00/00
Cache Hits: 132.4k Hits/s: 42.0 Hits now: 0.0 Ratio: 76.1% Ratio now: 0.0%
Key Efficiency: 99.5% Bps in/out: 14.1k/257.3k Now in/out: 321.9/44.8k

Id User Host/IP DB Time Cmd Query or State
-- ---- ------- -- ---- --- ----------
57689 root localhost mysql 0 Query show full processlist
57715 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 2 Query SELECT t2.USER_TOPIC_VIEW_TYPE, t2.USER_TOPICS_PER_PAGE, t2.USE
57714 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 5 Query SELECT USER_TEXT_EDITOR,USER_TOPICS_PER_PAGE,USER_POSTS_PER_TOP
57713 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 9 Query SELECT t2.USER_TOPIC_VIEW_TYPE, t2.USER_TOPICS_PER_PAGE, t2.USE
57711 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 11 Query select t1.TOPIC_ID,t1.POST_ID,t2.USER_DISPLAY_NAME,t1.TOPIC_CRE
57712 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 11 Query SELECT t2.USER_TOPIC_VIEW_TYPE, t1.USER_ID, t1.USER_DISPLAY_NAM
57710 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 14 Query SELECT t2.USER_TOPIC_VIEW_TYPE, t1.USER_ID, t1.USER_DISPLAY_NAM
57708 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 15 Query SELECT t.TOPIC_REPLIES, t.TOPIC_VIEWS, t.TOPIC_LAST_REPLY_TIME,
57709 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 15 Query SELECT t2.USER_TOPIC_VIEW_TYPE, t1.USER_ID, t1.USER_DISPLAY_NAM
57698 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 18 Query select t1.TOPIC_ID,t1.POST_ID,t2.USER_DISPLAY_NAME,t1.TOPIC_CRE
57688 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 20 Query SELECT t2.USER_SHOW_AVATARS, t2.USER_TIME_FORMAT, t2.USER_IGNOR
57661 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 22 Query update ubbt_USERS set USER_SESSION_ID = '98dce83da57b0395e16346
57687 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 22 Query SELECT t2.USER_TOPIC_VIEW_TYPE, t2.USER_TOPICS_PER_PAGE, t2.USE
57662 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 27 Sleep
57669 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 27 Query SELECT t2.USER_TOPIC_VIEW_TYPE, t1.USER_ID, t1.USER_DISPLAY_NAM
57658 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 29 Query SELECT t.TOPIC_REPLIES, t.TOPIC_VIEWS, t.TOPIC_LAST_REPLY_TIME,
57659 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 29 Query SELECT t2.USER_TOPIC_VIEW_TYPE, t1.USER_ID, t1.USER_DISPLAY_NAM
57660 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 29 Query SELECT t2.USER_TOPIC_VIEW_TYPE, t1.USER_ID, t1.USER_DISPLAY_NAM
57656 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 30 Query SELECT t2.USER_TOPIC_VIEW_TYPE, t2.USER_TOPICS_PER_PAGE, t2.USE
57657 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 30 Query SELECT t2.USER_TOPIC_VIEW_TYPE, t2.USER_TOPICS_PER_PAGE, t2.USE
57646 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 32 Query SELECT t2.USER_TOPIC_VIEW_TYPE, t1.USER_ID, t1.USER_DISPLAY_NAM
57636 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 33 Query SELECT t2.USER_SHOW_AVATARS, t2.USER_TIME_FORMAT, t2.USER_IGNOR
57629 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 35 Query select t1.TOPIC_ID,t1.POST_ID,t2.USER_DISPLAY_NAME,t1.TOPIC_CRE
57618 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 37 Query select t1.USER_DISPLAY_NAME, t3.USER_LAST_VISIT_TIME, t1.USER_P
57613 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 39 Query SELECT t.TOPIC_REPLIES, t.TOPIC_VIEWS, t.TOPIC_LAST_REPLY_TIME,
57614 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 39 Query SELECT t.TOPIC_REPLIES, t.TOPIC_VIEWS, t.TOPIC_LAST_REPLY_TIME,
57611 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 41 Query SELECT t2.USER_SHOW_AVATARS, t2.USER_TIME_FORMAT, t2.USER_IGNOR
57612 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 41 Query SELECT t2.USER_TOPIC_VIEW_TYPE, t1.USER_ID, t1.USER_DISPLAY_NAM
57609 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 42 Query SELECT t2.USER_TOPIC_VIEW_TYPE, t1.USER_ID, t1.USER_DISPLAY_NAM
57610 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 42 Query SELECT t.TOPIC_REPLIES, t.TOPIC_VIEWS, t.TOPIC_LAST_REPLY_TIME,
57566 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 48 Query SELECT t2.USER_TOPIC_VIEW_TYPE, t1.USER_ID, t1.USER_DISPLAY_NAM
_________________________
Rick Bin
24hourcampfire.com

http://www.24hourcampfire.com/ubbthreads/ubbthreads.php
Top
#227438 - 07/01/09 01:35 PM Re: Generation times and Ubbthreads logo appear in header, not footer - screenshot [Re: 24hourcampfire]
24hourcampfire Offline
journeyman
Registered: 11/02/06
Posts: 91
Finally back up. 25-minute gap between postings during the spike.

No more than a two-minute gap for ten consecutive posts on either side of the spike.

This is killing me.

Help please.
_________________________
Rick Bin
24hourcampfire.com

http://www.24hourcampfire.com/ubbthreads/ubbthreads.php
Top
#227439 - 07/01/09 01:40 PM Re: Generation times and Ubbthreads logo appear in header, not footer - screenshot [Re: 24hourcampfire]
24hourcampfire Offline
journeyman
Registered: 11/02/06
Posts: 91
OK, and here's what my server admin says:

Rick

We have completed the databases check and tweaked a little more the apache / mysql settings.
The server load is better now and the forum is working, but still a lot of sleep connections to the forum as you can see below :

1163 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 1 Sleep
995 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 2 Sleep
2365 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 2 Sleep
6635 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 3 Sleep
5715 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 4 Sleep
4680 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 5 Sleep
6602 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 5 Sleep
2187 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 6 Sleep
4344 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 6 Sleep
5346 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 6 Sleep
692 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 7 Sleep
4915 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 7 Sleep
5485 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 7 Sleep
5714 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 7 Sleep
3474 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 10 Sleep
4618 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 12 Sleep
3663 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 13 Sleep
5548 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 14 Sleep
6285 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 14 Sleep
6475 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 14 Sleep
3661 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 15 Sleep
5365 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 15 Sleep
6465 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 15 Sleep
5157 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 16 Sleep
640 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 17 Sleep
6415 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 18 Sleep
6391 XXXXXXXXXXXXXXXXXX localhost XXXXXXXXXXXXXXXXXX 19 Sleep

You should really contact UBBThreads about this.

--
Thank you,
_________________________
Rick Bin
24hourcampfire.com

http://www.24hourcampfire.com/ubbthreads/ubbthreads.php
Top
#227441 - 07/01/09 01:53 PM Re: Generation times and Ubbthreads logo appear in header, not footer - screenshot [Re: 24hourcampfire]
Rick Offline
Post-a-holic
Registered: 06/04/06
Posts: 10164
Loc: Aberdeen, WA
I don't believe you need to upgrade the server, as that should be plenty to run what you have. And the only way you're going to benefit from more memory is moving to a 64-bit OS since you already have 4 megs.

The slow queries look like they are definitely causing some issues. Not sure if we've touched on this yet, but the best place to start is with a couple things.

Sas your MySQL server been optimized at all? Also with the number of posts that you have, you probably need to look at the individual tables as well if they haven't been optimized lately.

I'd grab mysqltuner and run it if you haven't done so. This will at least tell you if there are any variables that are severely out of whack and how many of your tables are fragmented.
Top
#227442 - 07/01/09 01:54 PM Re: Generation times and Ubbthreads logo appear in header, not footer - screenshot [Re: Rick]
Rick Offline
Post-a-holic
Registered: 06/04/06
Posts: 10164
Loc: Aberdeen, WA
The sleep connections sounds like you might still be running with persistent connections turned on? You shouldn't be seeing any of those, as when the PHP script finishes executing the connection should close along with the webserver process.

So, if you still have persistent connections turned on, I'd turn them off.


Edited by Rick (07/01/09 01:57 PM)
Top
#227445 - 07/01/09 02:14 PM Re: Generation times and Ubbthreads logo appear in header, not footer - screenshot [Re: Rick]
24hourcampfire Offline
journeyman
Registered: 11/02/06
Posts: 91
Will do, Rick. Thanks. Will get mysqltuner hooked up asap.
_________________________
Rick Bin
24hourcampfire.com

http://www.24hourcampfire.com/ubbthreads/ubbthreads.php
Top
#227447 - 07/01/09 03:26 PM Re: Generation times and Ubbthreads logo appear in header, not footer - screenshot [Re: 24hourcampfire]
24hourcampfire Offline
journeyman
Registered: 11/02/06
Posts: 91
Mysql tuner:

[--] Up for: 2m 0s (17K q [144.108 qps], 2K conn, TX: 37M, RX: 2M)
[--] Reads / Writes: 53% / 47%
[--] Total buffers: 1.1G global + 5.4M per thread (600 max threads)
[!!] Allocating > 2GB RAM on 32-bit systems can cause system instability
[!!] Maximum possible memory usage: 4.3G (107% of installed RAM)
[OK] Slow queries: 0% (0/17K)
[OK] Highest usage of available connections: 1% (7/600)
[OK] Key buffer size / total MyISAM indexes: 900.0M/880.9M
[OK] Key buffer hit rate: 96.2% (212K cached / 8K reads)
[OK] Query cache efficiency: 71.9% (5K cached / 7K selects)
[OK] Query cache prunes per day: 0
[OK] Sorts requiring temporary tables: 0% (0 temp sorts / 464 sorts)
[OK] Temporary tables created on disk: 1% (6 on disk / 367 total)
[OK] Thread cache hit rate: 99% (7 created / 2K connections)
[OK] Table cache hit rate: 91% (61 open / 67 opened)
[OK] Open file limit used: 3% (113/3K)
[OK] Table locks acquired immediately: 99% (5K immediate / 5K locks)
_________________________
Rick Bin
24hourcampfire.com

http://www.24hourcampfire.com/ubbthreads/ubbthreads.php
Top
Page 2 of 3 < 1 2 3 >



Moderator:  AllenAyres, Harold, Ian, Ron M 
Shout Box

Today's Birthdays
No Birthdays
Recent Topics
Temporary Password email not being received
by
05/24/12 10:02 PM
Ability to "like" individual posts (not Facebook "likes)
by doug
05/23/12 09:03 AM
Island Permissions
by ThreadsUser
05/22/12 03:03 PM
streaming video
by prkrgrp
05/20/12 07:02 PM
New Posts Corrupted? Can someone help?
by PianoWorld
05/19/12 09:41 AM
Forum Stats
10492 Members
36 Forums
33842 Topics
181709 Posts

Max Online: 978 @ 06/24/07 11:19 PM
Random Image