Previous Thread
Next Thread
Print Thread
Hop To
#264014 07/21/2020 3:06 PM
Joined: Dec 2003
Posts: 6,210
Likes: 31
Ruben Online Yawn OP
OP Online Yawn
Joined: Dec 2003
Posts: 6,210
Likes: 31
This is a continuation of post:
https://www.ubbcentral.com/forums/u...-cant-delete-or-add-new-forum#Post264008

After getting forum deletes and creates working.
I decided to run the re builders starting with Posts.
Well I get a error on some very large posts.
Path was edited for security.
Code
Script: content_rebuild.inc.php - Line: 89
UPDATE ubbt_POSTS

Data too long for column 'POST_BODY' at row 1

Yes strict mode is enabled.
In phpmyadmin in variables I see for sql mode:
Code
ONLY_FULL_GROUP_BY,​STRICT_TRANS_TABLES,​NO_ZERO_IN_DATE,​NO_ZERO_DATE,​ERROR_FOR_DIVISION_BY_ZERO,​NO_AUTO_CREATE_USER,​NO_ENGINE_SUBSTITUTION
7/15/2020 change
​NO_ENGINE_SUBSTITUTION
I am not sure if I can edit that setting.

Posts table post_body as well as post default body is set to
Code
type text
length/values
Default NULL
Collation utf8mb4_general_ci
Attributes
NULL checked
A_I unchecked
Comments
Viruality
Move column
All values with no entry are blank

Now I did use the built in tool to convert to utf8mb4

There is more than one post because I deleted the first two.
And I still get the error after it passes the last one I deleted.
But there are unknown more of them.
Post count is 415506 and I only get to like 185.000 when the error occurs.
As I said they are extremely long posts.

At this point I am not sure if this is a bug or hosting issue or operator error or changing to utf8mb4..

All I know is this site has been upgraded over the years and it is now on UBB7.7.4 and it has a lot of posts to run through.

If you want to see the full error it is very long, but I can post it.
Did I say the posts are large?


Blue Man Group
There is no such thing as stupid questions. Just stupid answers
Joined: Jun 2006
Posts: 15,973
Likes: 38
UBB.threads Developer
Online Tapedshut
UBB.threads Developer
Joined: Jun 2006
Posts: 15,973
Likes: 38
If you cannot disable strict mode (you must be root to edit the my.cnf file) you might be able to change the column type from a TEXT to a LONGTEXT to support absurdly large posts... You'd want to do both POST_BODY and POST_DEFAULT_BODY, after making sure to make a backup before making any unsupported changes.

Please note that the vendor cannot support any changes to the stock behavior of UBB.threads.


I am a Web Development Contractor, I do not work for UBBCentral. I have provided free User to User Support since the beginning of these support forums.
Do you need Forum Install or Upgrade Services?
Forums: A Gardeners Forum, Scouters World
UBB.threads: UBBWiki, UBB Styles, UBB.Sitemaps
Longtime Supporter & Resident Post-A-Holic
VNC Web Services: Code Modifications, Upgrades, Styling, Coding Services, Disaster Recovery, and more!
Joined: Dec 2003
Posts: 6,210
Likes: 31
Ruben Online Yawn OP
OP Online Yawn
Joined: Dec 2003
Posts: 6,210
Likes: 31
Which do you suggest I try first?
As I said my only access to strict mode is via phpmyadmin.for this site
I have never tried to edit that setting that way.
If I can I do not know if a server reboot is needed which also I DO NOT HAVE ACCESS TO.


Blue Man Group
There is no such thing as stupid questions. Just stupid answers
Joined: Jun 2006
Posts: 15,973
Likes: 38
UBB.threads Developer
Online Tapedshut
UBB.threads Developer
Joined: Jun 2006
Posts: 15,973
Likes: 38
Originally Posted by Ruben
Which do you suggest I try first?
Not one or the other, if you change one type you need to change the other; one is processed markup (bbcode as HTML) the other is the bbcode only version of a post.


I am a Web Development Contractor, I do not work for UBBCentral. I have provided free User to User Support since the beginning of these support forums.
Do you need Forum Install or Upgrade Services?
Forums: A Gardeners Forum, Scouters World
UBB.threads: UBBWiki, UBB Styles, UBB.Sitemaps
Longtime Supporter & Resident Post-A-Holic
VNC Web Services: Code Modifications, Upgrades, Styling, Coding Services, Disaster Recovery, and more!
Joined: Dec 2003
Posts: 6,210
Likes: 31
Ruben Online Yawn OP
OP Online Yawn
Joined: Dec 2003
Posts: 6,210
Likes: 31
I was talking about turn off strict mode or ignore it..
Edit the table to longtext or edit variables.

Last edited by Ruben; 07/21/2020 3:48 PM.

Blue Man Group
There is no such thing as stupid questions. Just stupid answers
Joined: Jun 2006
Posts: 15,973
Likes: 38
UBB.threads Developer
Online Tapedshut
UBB.threads Developer
Joined: Jun 2006
Posts: 15,973
Likes: 38
Turning off strict mode should work, but iirc this may need to be done via a server modification you might not have access to (read)


I am a Web Development Contractor, I do not work for UBBCentral. I have provided free User to User Support since the beginning of these support forums.
Do you need Forum Install or Upgrade Services?
Forums: A Gardeners Forum, Scouters World
UBB.threads: UBBWiki, UBB Styles, UBB.Sitemaps
Longtime Supporter & Resident Post-A-Holic
VNC Web Services: Code Modifications, Upgrades, Styling, Coding Services, Disaster Recovery, and more!
Joined: Dec 2003
Posts: 6,210
Likes: 31
Ruben Online Yawn OP
OP Online Yawn
Joined: Dec 2003
Posts: 6,210
Likes: 31
Okay I will try the variables first.
I am thinking edit it to:
NO_ENGINE_SUBSTITUTION

or at least attempt to


Blue Man Group
There is no such thing as stupid questions. Just stupid answers
Joined: Jun 2006
Posts: 15,973
Likes: 38
UBB.threads Developer
Online Tapedshut
UBB.threads Developer
Joined: Jun 2006
Posts: 15,973
Likes: 38
Modifying server configurations is out of my wheelhouse, and defiantly outside of official support (UBB.threads is a web script, it assumes the server is configured to function only); all that I can do is relay information I found from Google.


I am a Web Development Contractor, I do not work for UBBCentral. I have provided free User to User Support since the beginning of these support forums.
Do you need Forum Install or Upgrade Services?
Forums: A Gardeners Forum, Scouters World
UBB.threads: UBBWiki, UBB Styles, UBB.Sitemaps
Longtime Supporter & Resident Post-A-Holic
VNC Web Services: Code Modifications, Upgrades, Styling, Coding Services, Disaster Recovery, and more!
Joined: Dec 2003
Posts: 6,210
Likes: 31
Ruben Online Yawn OP
OP Online Yawn
Joined: Dec 2003
Posts: 6,210
Likes: 31
I would hate to change the database with 7.5.5 on the horizon and find I need to edit it again after the upgrade.
Since I do not know of any altertable scripts.


Blue Man Group
There is no such thing as stupid questions. Just stupid answers
Joined: Jun 2006
Posts: 15,973
Likes: 38
UBB.threads Developer
Online Tapedshut
UBB.threads Developer
Joined: Jun 2006
Posts: 15,973
Likes: 38
The upgrades rarely change the column type


I am a Web Development Contractor, I do not work for UBBCentral. I have provided free User to User Support since the beginning of these support forums.
Do you need Forum Install or Upgrade Services?
Forums: A Gardeners Forum, Scouters World
UBB.threads: UBBWiki, UBB Styles, UBB.Sitemaps
Longtime Supporter & Resident Post-A-Holic
VNC Web Services: Code Modifications, Upgrades, Styling, Coding Services, Disaster Recovery, and more!
Joined: Dec 2003
Posts: 6,210
Likes: 31
Ruben Online Yawn OP
OP Online Yawn
Joined: Dec 2003
Posts: 6,210
Likes: 31
Okay here we go.


Blue Man Group
There is no such thing as stupid questions. Just stupid answers
Joined: Jun 2006
Posts: 15,973
Likes: 38
UBB.threads Developer
Online Tapedshut
UBB.threads Developer
Joined: Jun 2006
Posts: 15,973
Likes: 38
If you want everything to remain stock you could insist that they not create single absurdly long posts and instead post replies to a primary topic... Its how most of us end up doing it vs allowing a book of data to go into one post.


I am a Web Development Contractor, I do not work for UBBCentral. I have provided free User to User Support since the beginning of these support forums.
Do you need Forum Install or Upgrade Services?
Forums: A Gardeners Forum, Scouters World
UBB.threads: UBBWiki, UBB Styles, UBB.Sitemaps
Longtime Supporter & Resident Post-A-Holic
VNC Web Services: Code Modifications, Upgrades, Styling, Coding Services, Disaster Recovery, and more!
Joined: Jun 2006
Posts: 15,973
Likes: 38
UBB.threads Developer
Online Tapedshut
UBB.threads Developer
Joined: Jun 2006
Posts: 15,973
Likes: 38
Per the MySQL8 Documentation, lengths of various text types are:
Type | Maximum length
-----------+-------------------------------------
TINYTEXT | 255 (2 8−1) bytes
TEXT | 65,535 (216−1) bytes = 64 KiB
MEDIUMTEXT | 16,777,215 (224−1) bytes = 16 MiB
LONGTEXT | 4,294,967,295 (232−1) bytes = 4 GiB


I am a Web Development Contractor, I do not work for UBBCentral. I have provided free User to User Support since the beginning of these support forums.
Do you need Forum Install or Upgrade Services?
Forums: A Gardeners Forum, Scouters World
UBB.threads: UBBWiki, UBB Styles, UBB.Sitemaps
Longtime Supporter & Resident Post-A-Holic
VNC Web Services: Code Modifications, Upgrades, Styling, Coding Services, Disaster Recovery, and more!
Joined: Dec 2003
Posts: 6,210
Likes: 31
Ruben Online Yawn OP
OP Online Yawn
Joined: Dec 2003
Posts: 6,210
Likes: 31
Okay I tried the variables and it barked with I am not a super admin.
So I edited post body and post default body it is running now.
It will take a bit
I am at 200,000 out of 400,00 posts


Blue Man Group
There is no such thing as stupid questions. Just stupid answers
Joined: Jun 2006
Posts: 15,973
Likes: 38
UBB.threads Developer
Online Tapedshut
UBB.threads Developer
Joined: Jun 2006
Posts: 15,973
Likes: 38
Yes, editing the my.cnf file affects the entire server, so you would need root rights in order to make modifications.


I am a Web Development Contractor, I do not work for UBBCentral. I have provided free User to User Support since the beginning of these support forums.
Do you need Forum Install or Upgrade Services?
Forums: A Gardeners Forum, Scouters World
UBB.threads: UBBWiki, UBB Styles, UBB.Sitemaps
Longtime Supporter & Resident Post-A-Holic
VNC Web Services: Code Modifications, Upgrades, Styling, Coding Services, Disaster Recovery, and more!
Joined: Dec 2003
Posts: 6,210
Likes: 31
Ruben Online Yawn OP
OP Online Yawn
Joined: Dec 2003
Posts: 6,210
Likes: 31
which this account does not allow access.
So now re builders is close to 300,000


Blue Man Group
There is no such thing as stupid questions. Just stupid answers
Joined: Dec 2003
Posts: 6,210
Likes: 31
Ruben Online Yawn OP
OP Online Yawn
Joined: Dec 2003
Posts: 6,210
Likes: 31
okay I ran rebuild posts,topics,forums and all others except for Rebuild Post Counts
Without error.
After modifying post body and post default body to longtext.
With success I hope the big posts are intact still.
They are from 2008 to 2009.
So I do not know how to find them all.
But anyway should this not be a bug report even though rare,


Blue Man Group
There is no such thing as stupid questions. Just stupid answers
Joined: Jun 2006
Posts: 15,973
Likes: 38
UBB.threads Developer
Online Tapedshut
UBB.threads Developer
Joined: Jun 2006
Posts: 15,973
Likes: 38
Well, its definitely not a bug; its simply the users massive posts hitting the hard limit of a text type. The official recommendation would be to break up future posts vs attempting to put a book worth of data in a single post.


I am a Web Development Contractor, I do not work for UBBCentral. I have provided free User to User Support since the beginning of these support forums.
Do you need Forum Install or Upgrade Services?
Forums: A Gardeners Forum, Scouters World
UBB.threads: UBBWiki, UBB Styles, UBB.Sitemaps
Longtime Supporter & Resident Post-A-Holic
VNC Web Services: Code Modifications, Upgrades, Styling, Coding Services, Disaster Recovery, and more!
Joined: Dec 2003
Posts: 6,210
Likes: 31
Ruben Online Yawn OP
OP Online Yawn
Joined: Dec 2003
Posts: 6,210
Likes: 31
I agree to a point.
But past versions allowed a post that big and now it is a issue.


Blue Man Group
There is no such thing as stupid questions. Just stupid answers
Joined: Apr 2004
Posts: 1,746
Likes: 72
UBB.threads Developer
Offline
UBB.threads Developer
Joined: Apr 2004
Posts: 1,746
Likes: 72
Originally Posted by Ruben
I agree to a point.
But past versions allowed a post that big and now it is a issue.

For many years, nothing was changed with that regard, except your server side database (MySQL) and your scripting language (PHP) versions and their configurations.

For example, within the php config of UBBCentral's server, 65,380 is the char limit for the display of posts (txt blobs), even though a higher number of chars can be stored within the database. an example post within a private forum

Something that I do not believe existed previously, but can be added for a future version, is an "overflow trigger." One that will warn the user of their post being too large. Also adding content-truncation during the post content rebuild process (admin tools)


Current developer of UBB.threads PHP Forum Software // 7.7.4 released!
isaac @ id242.com // my forum @ CelicaHobby.com
1 member likes this: Gizmo
Joined: Dec 2003
Posts: 6,210
Likes: 31
Ruben Online Yawn OP
OP Online Yawn
Joined: Dec 2003
Posts: 6,210
Likes: 31
I can say it appears there is a warning after editing a post but not prior to submit.
I picked one post from the error and deleted all the line feeds and white space.
Hoping it would fit
But when I submitted the edit I got the same error.
Data too long for column 'POST_BODY' at row 1

I appeared as if it came from UBB because it had the same scheme as the default style.


Blue Man Group
There is no such thing as stupid questions. Just stupid answers
Joined: Apr 2004
Posts: 1,746
Likes: 72
UBB.threads Developer
Offline
UBB.threads Developer
Joined: Apr 2004
Posts: 1,746
Likes: 72
Originally Posted by Ruben
Hoping it would fit
But when I submitted the edit I got the same error.
Data too long for column 'POST_BODY' at row 1

I was easily able to create a text (UBBCode Only) post over 16 MB on stock PHP 7.4 and MySQL/MariaDB 10.4.13 server settings.

Over 16 MB on my Linux DEV site
Over 20 MB on my Windows DEV site
Limited to only 64 KB on Linux UBBCentral.com

Test/confirm the following items:
1/ the database you've updated multiple times over the past decade, was updated correctly and matches stock UBBT 7.7.4 data types and sizes
2/ the server you're working on has its php -OR- mysql config settings configured correctly for your needs. there are many possible things to search your customized settings for, two of them could be "page-size" and "buffer".

Gizmo mentioned point 1 earlier in this topic. For point 2 you need to confirm your settings are stock or within range for your specific needs:

I dont know anything about your server's exact customizations, but I would sugest you either revert those settings to stock and test again, or perform further research on what is needed. Custom server tuning is beyond the scope of the the ubbcentral support forums.


Current developer of UBB.threads PHP Forum Software // 7.7.4 released!
isaac @ id242.com // my forum @ CelicaHobby.com
Joined: Dec 2003
Posts: 6,210
Likes: 31
Ruben Online Yawn OP
OP Online Yawn
Joined: Dec 2003
Posts: 6,210
Likes: 31
I will try to evaluate but I kinda walked into this.
This is a shared hosting account. So I do not have access to everything I would like.
And of course I have no history on what the host has done.
I also have no idea who or what was changed over the years.
All I know is it was updated over the years per the owner.
And I did the current update to 7.7.4 from 7.6X
The only modifications I did was shorten the refresh time for the wol page and changing post body and post default body in the posts table to longtext..
So the re builders would complete.
Of course I did have to do some DB diving to fix the corrupted/orphaned forums from past deletions that were never successful

It appears it is working correctly for now and not causing any issues with the various functions.

Since I am not getting any errors now it is difficult to find those huge posts now.


Blue Man Group
There is no such thing as stupid questions. Just stupid answers
1 member likes this: isaac

Link Copied to Clipboard
ShoutChat Box
Comment Guidelines: Do post respectful and insightful comments. Don't flame, hate, spam.
Recent Topics
Individual Post Count Adjustments?
by FREAK - 09/25/2020 11:17 PM
Like unlike bug?
by Morgan - 09/24/2020 5:03 PM
looking to renew :)
by Mors - 09/23/2020 7:52 PM
test
by Mors - 09/23/2020 7:51 PM
What triggers page view numbers
by Morgan - 09/21/2020 10:31 AM
Who's Online Now
4 members (Ruben, FREAK, Gizmo, 1 invisible), 60 guests, and 46 robots.
Key: Admin, Global Mod, Mod
Random Gallery Image
Latest Gallery Images
gallery test
gallery test
by Mors, September 23
Los Angeles
Los Angeles
by isaac, August 6
3D Creations
3D Creations
by JAISP, December 30
Artistic structures
Artistic structures
by isaac, August 29
Powered by UBB.threads™ PHP Forum Software 7.7.5
(Snapshot build 20200925)