Previous Thread
Next Thread
Print Thread
Hop To
Joined: Oct 2007
Posts: 426
Likes: 11
Addict
Addict
Joined: Oct 2007
Posts: 426
Likes: 11
I brought this issue up before, but it's still bugging us. I have written a sql query that cleans them up, so keeping them out of the forums is no longer an issue. But, I'd like to figure out the cause, if I could, so we can find a permanent solution.

Today, one of our moderators pointed out that another forum was suffering from the same issue. Since you won't have access to that particular forum, I'm posting the actual post here.
Quote
We are not the only forum with this problem. see this link:
Grumpy's Performance
I asked if the poster was a member of that forum, and he said he was not but pointed out that that forum developer had a bug report on it and had found a solution.
Quote
Not a member of Grumpy's forum. There was a mention of a similar issue in their host's (Xenforo) bug reports:
Bug reports

Discussion
I was surprised because I assumed that if this problem reared its ugly head in two entirely different software bases that the problem was not likely the forum software's fault.

However, it looks like this might be an issue with php coding. So, I'm posting it here in the hope that it might be helpful.

Quote
To fix this, in template log_moderator_list change {$entry.action_text|strip_tags} to {$entry.action_text|raw|strip_tags} or similar. Not sure if two pipes are allowed.

Is it possible that this is an issue with php coding? Have any other UBB forum owners experienced this issue?

I greped for strip_tags and found several instances of it in the UBB code. I have no idea if that means anything.

Please note that while we are on mysql 8.0, we are still using php 7.4.


The Stovebolt Geek
https://www.stovebolt.com/ubbthreads/ubbthreads.php

Server Information
UBB.threads Version 8.0.0
Release 20201027
Server OS Linux
Server Load 0.16
Web Server Apache/2.4.37
PHP Version 8.3.11
MYSQL Version 8.0.39
Database Size 1.82 GB
Joined: Dec 2003
Posts: 6,617
Likes: 84
Joined: Dec 2003
Posts: 6,617
Likes: 84
I guess you are talking about people that copy paste from say windows notepad or word that has been advised not to do?
Even though we know members still do it


Blue Man Group
There is no such thing as stupid questions. Just stupid answers
Joined: Oct 2007
Posts: 426
Likes: 11
Addict
Addict
Joined: Oct 2007
Posts: 426
Likes: 11
I really don't know, but I don't think so.


The Stovebolt Geek
https://www.stovebolt.com/ubbthreads/ubbthreads.php

Server Information
UBB.threads Version 8.0.0
Release 20201027
Server OS Linux
Server Load 0.16
Web Server Apache/2.4.37
PHP Version 8.3.11
MYSQL Version 8.0.39
Database Size 1.82 GB
Joined: Apr 2004
Posts: 1,963
Likes: 153
UBB.threads Developer
UBB.threads Developer
Joined: Apr 2004
Posts: 1,963
Likes: 153
I checked your discussion links and they are all from about 2010, nearly 15 years ago. thats a lot of time to be sitting on their database without properly upgrading it from Windows-1252 to UTF-8, which is internet standard.

in 2012, two years after the linked posts were created, Windows-1252's usage was only 1.5% across the internet
[Linked Image]

2024. less than 0.3% usage
source: https://w3techs.com/technologies/details/en-windows1252
[Linked Image]


further reading here
https://www.ubbcentral.com/forums/u...ging-from-iso-8859-1-to-utf-8#Post263058
a guide on how to manually convert your database here
https://www.ubbcentral.com/forums/u...an-we-finally-switch-to-utf-8#Post255103


ubbt 7.7.4 introduces a conversion tool
https://www.ubbcentral.com/forums/u...ue/7-7-4-changelog-discussion#Post263542
Quote
[NEW] CP: Content Rebuilder can now help transition your forum tables for full unicode support (utf8mb4) which will allow for Asian characters and Emojis to be used. 4-Byte UTF-8 Unicode requires MySQL 5.5.3 or above. It is highly recommend to create a database backup as the process cannot be undone.

directions on how to use this built in conversion tool is further down in that thread here:
https://www.ubbcentral.com/forums/u...re-7-7-4-changelog-discussion#Post263563


current developer of UBB.threads php forum software
current release: UBB.threads 8.0.0 // wip release: n/a
isaac @ id242.com // my forum @ CelicaHobby.com
Joined: Dec 2003
Posts: 6,617
Likes: 84
Joined: Dec 2003
Posts: 6,617
Likes: 84
You mean you have not converted the database to utf8mb4 yet?
If true no wonder the question


Blue Man Group
There is no such thing as stupid questions. Just stupid answers
Joined: Oct 2007
Posts: 426
Likes: 11
Addict
Addict
Joined: Oct 2007
Posts: 426
Likes: 11
Originally Posted by Ruben
You mean you have not converted the database to utf8mb4 yet?
If true no wonder the question
I updated the db to utf8mb4 a few months ago. More recently, the db was upgraded to 8.0, and I have confirmed that all tables are utf8mb4. Yet the problem persists.

Code
SELECT DEFAULT_CHARACTER_SET_NAME, DEFAULT_COLLATION_NAME, COUNT(0) AS COUNT FROM information_schema.SCHEMATA GROUP BY DEFAULT_CHARACTER_SET_NAME, DEFAULT_COLLATION_NAME;
Quote
DEFAULT_CHARACTER_SET_NAME DEFAULT_COLLATION_NAME COUNT
utf8mb3 utf8mb3_general_ci 2
latin1 latin1_swedish_ci 1
utf8mb4 utf8mb4_general_ci

Code
SELECT TABLE_SCHEMA, TABLE_NAME, TABLE_COLLATION FROM information_schema.TABLES WHERE TABLE_COLLATION IS NOT NULL AND TABLE_COLLATION NOT LIKE '%utf8%';
Quote
0 row(s) affected by your query.

Code
SELECT CHARACTER_SET_NAME, COLLATION_NAME, COUNT(0) AS COUNT FROM information_schema.COLUMNS WHERE CHARACTER_SET_NAME IS NOT NULL AND COLLATION_NAME IS NOT NULL GROUP BY CHARACTER_SET_NAME, COLLATION_NAME;

Quote
CHARACTER_SET_NAME COLLATION_NAME COUNT
utf8mb3 utf8mb3_general_ci 212
utf8mb3 utf8mb3_bin 155
utf8mb3 utf8mb3_tolower_ci 19
utf8mb4 utf8mb4_0900_ai_ci 14
utf8mb4 utf8mb4_general_ci 270
ascii ascii_general_ci 4
utf8mb4 utf8mb4_bin

There are four databases. The test db is a leftover that I should probably drop. It's the one that's inlatin1_swedish_ci 1
Quote
nformation_schema
performance_schema
test
ubbthreads


The Stovebolt Geek
https://www.stovebolt.com/ubbthreads/ubbthreads.php

Server Information
UBB.threads Version 8.0.0
Release 20201027
Server OS Linux
Server Load 0.16
Web Server Apache/2.4.37
PHP Version 8.3.11
MYSQL Version 8.0.39
Database Size 1.82 GB
Joined: Jun 2006
Posts: 16,347
Likes: 122
UBB.threads Developer
UBB.threads Developer
Joined: Jun 2006
Posts: 16,347
Likes: 122
What does this setting show for your forums?
CP -> Master Settings -> Paths & Databases -> Databases Tab -> "MySQL Full Unicode Support (utf8mb4)"
Attachments
mb4.png


I am a Web Development Contractor, I do not work for UBBCentral. I have provided free User to User Support since the beginning of these support forums.
Do you need Forum Install or Upgrade Services?
Forums: A Gardeners Forum, Scouters World
UBB.threads: UBBWiki, UBB Styles, UBB.Sitemaps
Longtime Supporter & Resident Post-A-Holic
VNC Web Services: Code Modifications, Upgrades, Styling, Coding Services, Disaster Recovery, and more!
Joined: Oct 2007
Posts: 426
Likes: 11
Addict
Addict
Joined: Oct 2007
Posts: 426
Likes: 11
The screenshot is attached.
Attachments
Screenshot 2024-08-08 at 10.11.15 PM.png


The Stovebolt Geek
https://www.stovebolt.com/ubbthreads/ubbthreads.php

Server Information
UBB.threads Version 8.0.0
Release 20201027
Server OS Linux
Server Load 0.16
Web Server Apache/2.4.37
PHP Version 8.3.11
MYSQL Version 8.0.39
Database Size 1.82 GB
Joined: Apr 2004
Posts: 1,963
Likes: 153
UBB.threads Developer
UBB.threads Developer
Joined: Apr 2004
Posts: 1,963
Likes: 153
Originally Posted by Ruben
You mean you have not converted the database to utf8mb4 yet?
If true no wonder the question

It looks like the links he's posted links are to XenForo forum software from 2010. Not UBB.threads.

he also mentioned that he updated his forums to utf8mb4 a few months ago (in 2024) but has not said how.
https://www.ubbcentral.com/forums/u...52-characters-instead-of-utf8#Post266154

@BaldEagle, when you updated your database, did you just change the collation, or did you actually change the data as well, by using UBB.thread's built in conversion upgrade tool (available since UBBT 7.7.4)


current developer of UBB.threads php forum software
current release: UBB.threads 8.0.0 // wip release: n/a
isaac @ id242.com // my forum @ CelicaHobby.com
Joined: Oct 2007
Posts: 426
Likes: 11
Addict
Addict
Joined: Oct 2007
Posts: 426
Likes: 11
Originally Posted by isaac
Originally Posted by Ruben
You mean you have not converted the database to utf8mb4 yet?
If true no wonder the question

It looks like the links he's posted links are to XenForo forum software from 2010. Not UBB.threads.

he also mentioned that he updated his forums to utf8mb4 a few months ago (in 2024) but has not said how.
https://www.ubbcentral.com/forums/u...52-characters-instead-of-utf8#Post266154

@BaldEagle, when you updated your database, did you just change the collation, or did you actually change the data as well, by using UBB.thread's built in conversion upgrade tool (available since UBBT 7.7.4)
I used the conversion tool provided by the UBB software.


The Stovebolt Geek
https://www.stovebolt.com/ubbthreads/ubbthreads.php

Server Information
UBB.threads Version 8.0.0
Release 20201027
Server OS Linux
Server Load 0.16
Web Server Apache/2.4.37
PHP Version 8.3.11
MYSQL Version 8.0.39
Database Size 1.82 GB

Link Copied to Clipboard
ShoutChat
Comment Guidelines: Do post respectful and insightful comments. Don't flame, hate, spam.
Recent Topics
Test instance works fine
by Baldeagle - 09/09/2024 7:15 PM
How do I edit this line of text?
by ThreadsUser - 09/09/2024 9:07 AM
UBB 8.0.0 Bugs Found
by whk - 09/06/2024 10:53 AM
Avatar letters
by Baldeagle - 09/05/2024 5:42 PM
Who's Online Now
4 members (Baldeagle, toner, Mender, 1 invisible), 315 guests, and 116 robots.
Key: Admin, Global Mod, Mod
Random Gallery Image
Latest Gallery Images
Los Angeles
Los Angeles
by isaac, August 6
3D Creations
3D Creations
by JAISP, December 30
Artistic structures
Artistic structures
by isaac, August 29
Stones
Stones
by isaac, August 19
Powered by UBB.threads™ PHP Forum Software 8.0.0