|
Joined: Dec 2003
Posts: 6,562 Likes: 78
|
Joined: Dec 2003
Posts: 6,562 Likes: 78 |
This is a continuation of post: https://www.ubbcentral.com/forums/u...-cant-delete-or-add-new-forum#Post264008After getting forum deletes and creates working. I decided to run the re builders starting with Posts. Well I get a error on some very large posts. Path was edited for security. Script: content_rebuild.inc.php - Line: 89
UPDATE ubbt_POSTS
Data too long for column 'POST_BODY' at row 1 Yes strict mode is enabled. In phpmyadmin in variables I see for sql mode: ONLY_FULL_GROUP_BY,STRICT_TRANS_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION
7/15/2020 change
NO_ENGINE_SUBSTITUTION I am not sure if I can edit that setting. Posts table post_body as well as post default body is set to type text
length/values
Default NULL
Collation utf8mb4_general_ci
Attributes
NULL checked
A_I unchecked
Comments
Viruality
Move column All values with no entry are blank Now I did use the built in tool to convert to utf8mb4 There is more than one post because I deleted the first two. And I still get the error after it passes the last one I deleted. But there are unknown more of them. Post count is 415506 and I only get to like 185.000 when the error occurs. As I said they are extremely long posts. At this point I am not sure if this is a bug or hosting issue or operator error or changing to utf8mb4.. All I know is this site has been upgraded over the years and it is now on UBB7.7.4 and it has a lot of posts to run through. If you want to see the full error it is very long, but I can post it. Did I say the posts are large?
Blue Man Group There is no such thing as stupid questions. Just stupid answers
|
|
|
|
Joined: Jun 2006
Posts: 16,299 Likes: 116
|
Joined: Jun 2006
Posts: 16,299 Likes: 116 |
If you cannot disable strict mode (you must be root to edit the my.cnf file) you might be able to change the column type from a TEXT to a LONGTEXT to support absurdly large posts... You'd want to do both POST_BODY and POST_DEFAULT_BODY, after making sure to make a backup before making any unsupported changes.
Please note that the vendor cannot support any changes to the stock behavior of UBB.threads.
|
|
|
|
Joined: Dec 2003
Posts: 6,562 Likes: 78
|
Joined: Dec 2003
Posts: 6,562 Likes: 78 |
Which do you suggest I try first? As I said my only access to strict mode is via phpmyadmin.for this site I have never tried to edit that setting that way. If I can I do not know if a server reboot is needed which also I DO NOT HAVE ACCESS TO.
Blue Man Group There is no such thing as stupid questions. Just stupid answers
|
|
|
|
Joined: Jun 2006
Posts: 16,299 Likes: 116
|
Joined: Jun 2006
Posts: 16,299 Likes: 116 |
Which do you suggest I try first? Not one or the other, if you change one type you need to change the other; one is processed markup (bbcode as HTML) the other is the bbcode only version of a post.
|
|
|
|
Joined: Dec 2003
Posts: 6,562 Likes: 78
|
Joined: Dec 2003
Posts: 6,562 Likes: 78 |
I was talking about turn off strict mode or ignore it.. Edit the table to longtext or edit variables.
Last edited by Ruben; 07/21/2020 3:48 PM.
Blue Man Group There is no such thing as stupid questions. Just stupid answers
|
|
|
|
Joined: Jun 2006
Posts: 16,299 Likes: 116
|
Joined: Jun 2006
Posts: 16,299 Likes: 116 |
Turning off strict mode should work, but iirc this may need to be done via a server modification you might not have access to ( read)
|
|
|
|
Joined: Dec 2003
Posts: 6,562 Likes: 78
|
Joined: Dec 2003
Posts: 6,562 Likes: 78 |
Okay I will try the variables first. I am thinking edit it to: NO_ENGINE_SUBSTITUTION
or at least attempt to
Blue Man Group There is no such thing as stupid questions. Just stupid answers
|
|
|
|
Joined: Jun 2006
Posts: 16,299 Likes: 116
|
Joined: Jun 2006
Posts: 16,299 Likes: 116 |
Modifying server configurations is out of my wheelhouse, and defiantly outside of official support (UBB.threads is a web script, it assumes the server is configured to function only); all that I can do is relay information I found from Google.
|
|
|
|
Joined: Dec 2003
Posts: 6,562 Likes: 78
|
Joined: Dec 2003
Posts: 6,562 Likes: 78 |
I would hate to change the database with 7.5.5 on the horizon and find I need to edit it again after the upgrade. Since I do not know of any altertable scripts.
Blue Man Group There is no such thing as stupid questions. Just stupid answers
|
|
|
|
Joined: Jun 2006
Posts: 16,299 Likes: 116
|
Joined: Jun 2006
Posts: 16,299 Likes: 116 |
The upgrades rarely change the column type
|
|
|
|
Joined: Dec 2003
Posts: 6,562 Likes: 78
|
Joined: Dec 2003
Posts: 6,562 Likes: 78 |
Blue Man Group There is no such thing as stupid questions. Just stupid answers
|
|
|
|
Joined: Jun 2006
Posts: 16,299 Likes: 116
|
Joined: Jun 2006
Posts: 16,299 Likes: 116 |
If you want everything to remain stock you could insist that they not create single absurdly long posts and instead post replies to a primary topic... Its how most of us end up doing it vs allowing a book of data to go into one post.
|
|
|
|
Joined: Jun 2006
Posts: 16,299 Likes: 116
|
Joined: Jun 2006
Posts: 16,299 Likes: 116 |
Per the MySQL8 Documentation, lengths of various text types are: Type | Maximum length -----------+------------------------------------- TINYTEXT | 255 (2 8−1) bytes TEXT | 65,535 (216−1) bytes = 64 KiB MEDIUMTEXT | 16,777,215 (224−1) bytes = 16 MiB LONGTEXT | 4,294,967,295 (232−1) bytes = 4 GiB
|
|
|
|
Joined: Dec 2003
Posts: 6,562 Likes: 78
|
Joined: Dec 2003
Posts: 6,562 Likes: 78 |
Okay I tried the variables and it barked with I am not a super admin. So I edited post body and post default body it is running now. It will take a bit I am at 200,000 out of 400,00 posts
Blue Man Group There is no such thing as stupid questions. Just stupid answers
|
|
|
|
Joined: Jun 2006
Posts: 16,299 Likes: 116
|
Joined: Jun 2006
Posts: 16,299 Likes: 116 |
Yes, editing the my.cnf file affects the entire server, so you would need root rights in order to make modifications.
|
|
|
|
Joined: Dec 2003
Posts: 6,562 Likes: 78
|
Joined: Dec 2003
Posts: 6,562 Likes: 78 |
which this account does not allow access. So now re builders is close to 300,000
Blue Man Group There is no such thing as stupid questions. Just stupid answers
|
|
|
|
Joined: Dec 2003
Posts: 6,562 Likes: 78
|
Joined: Dec 2003
Posts: 6,562 Likes: 78 |
okay I ran rebuild posts,topics,forums and all others except for Rebuild Post Counts Without error. After modifying post body and post default body to longtext. With success I hope the big posts are intact still. They are from 2008 to 2009. So I do not know how to find them all. But anyway should this not be a bug report even though rare,
Blue Man Group There is no such thing as stupid questions. Just stupid answers
|
|
|
|
Joined: Jun 2006
Posts: 16,299 Likes: 116
|
Joined: Jun 2006
Posts: 16,299 Likes: 116 |
Well, its definitely not a bug; its simply the users massive posts hitting the hard limit of a text type. The official recommendation would be to break up future posts vs attempting to put a book worth of data in a single post.
|
|
|
|
Joined: Dec 2003
Posts: 6,562 Likes: 78
|
Joined: Dec 2003
Posts: 6,562 Likes: 78 |
I agree to a point. But past versions allowed a post that big and now it is a issue.
Blue Man Group There is no such thing as stupid questions. Just stupid answers
|
|
|
|
Joined: Apr 2004
Posts: 1,945 Likes: 145
|
Joined: Apr 2004
Posts: 1,945 Likes: 145 |
I agree to a point. But past versions allowed a post that big and now it is a issue. For many years, nothing was changed with that regard, except your server side database (MySQL) and your scripting language (PHP) versions and their configurations. For example, within the php config of UBBCentral's server, 65,380 is the char limit for the display of posts (txt blobs), even though a higher number of chars can be stored within the database. an example post within a private forumSomething that I do not believe existed previously, but can be added for a future version, is an "overflow trigger." One that will warn the user of their post being too large. Also adding content-truncation during the post content rebuild process (admin tools)
|
1 member likes this:
Gizmo |
|
|
|
Joined: Dec 2003
Posts: 6,562 Likes: 78
|
Joined: Dec 2003
Posts: 6,562 Likes: 78 |
I can say it appears there is a warning after editing a post but not prior to submit. I picked one post from the error and deleted all the line feeds and white space. Hoping it would fit But when I submitted the edit I got the same error. Data too long for column 'POST_BODY' at row 1
I appeared as if it came from UBB because it had the same scheme as the default style.
Blue Man Group There is no such thing as stupid questions. Just stupid answers
|
|
|
|
Joined: Apr 2004
Posts: 1,945 Likes: 145
|
Joined: Apr 2004
Posts: 1,945 Likes: 145 |
Hoping it would fit But when I submitted the edit I got the same error. Data too long for column 'POST_BODY' at row 1 I was easily able to create a text (UBBCode Only) post over 16 MB on stock PHP 7.4 and MySQL/MariaDB 10.4.13 server settings. Over 16 MB on my Linux DEV site Over 20 MB on my Windows DEV site Limited to only 64 KB on Linux UBBCentral.com Test/confirm the following items: 1/ the database you've updated multiple times over the past decade, was updated correctly and matches stock UBBT 7.7.4 data types and sizes 2/ the server you're working on has its php -OR- mysql config settings configured correctly for your needs. there are many possible things to search your customized settings for, two of them could be "page-size" and "buffer". Gizmo mentioned point 1 earlier in this topic. For point 2 you need to confirm your settings are stock or within range for your specific needs: I dont know anything about your server's exact customizations, but I would sugest you either revert those settings to stock and test again, or perform further research on what is needed. Custom server tuning is beyond the scope of the the ubbcentral support forums.
|
|
|
|
Joined: Dec 2003
Posts: 6,562 Likes: 78
|
Joined: Dec 2003
Posts: 6,562 Likes: 78 |
I will try to evaluate but I kinda walked into this. This is a shared hosting account. So I do not have access to everything I would like. And of course I have no history on what the host has done. I also have no idea who or what was changed over the years. All I know is it was updated over the years per the owner. And I did the current update to 7.7.4 from 7.6X The only modifications I did was shorten the refresh time for the wol page and changing post body and post default body in the posts table to longtext.. So the re builders would complete. Of course I did have to do some DB diving to fix the corrupted/orphaned forums from past deletions that were never successful
It appears it is working correctly for now and not causing any issues with the various functions.
Since I am not getting any errors now it is difficult to find those huge posts now.
Blue Man Group There is no such thing as stupid questions. Just stupid answers
|
1 member likes this:
isaac |
|
|
Bots
by Outdoorking - 04/13/2024 5:08 PM
|
|
|
|
|
|
1 members (Ruben),
1,248
guests, and
268
robots. |
Key:
Admin,
Global Mod,
Mod
|
|
|
|