Thread Like Summary
Gizmo, Z65Paul
Total Likes: 3
Original Post (Thread Starter)
by Z65Paul
Z65Paul
Hey Y'all, Happy New Year.

Here's an interesting one. Still running V7.7.5 (old PHP still) with plans to upgrade the server and board software in the future.

About a week ago the board locked up with the "SQL Error: The table 'ubbt_ONLINE' is full". Clearing the cache brought the board back up, but it soon crashed again with the same error. A quick search here in this forum lead me to the thread about this error and the solution to change this data table entry from Memory to MyISAM (disk). This is the default setting in V8, not so in V7. That change solved the issue. I find it interesting that another board admin here experienced the same error on their forum about the same time and reported it here in the Version 7/8 Support forum.

While dealing with this issue I took a closer look at my Who's Online list. I suspected there were far more bots crawling my forum than were listed (tons of guests, few robots listed). I decided to look for an updated robot / crawler list (which I hadn't updated in many many years). Over on the UBBDev message board, I found the newest version of the robots list was from 2022. I installed that, but it did not drastically reduce the number of 'Guests'. So I decided to create an updated list, using the resources listed on the UBBDev thread to identify all known robots / crawlers as of today. I uploaded my updated version of the robots / crawlers text file to that UBBDev thread, and installed it on my forum. Again, it helped expand the robots listed on Who's Online, but I I'm still getting inundated with 'guest users'. As an example, with a 10 minute view period set for Who's Online, I'm seeing almost 500 guests, and over 60 robots.

Here's the interesting part.... Looking at the Guest Users, I see multiple instances from different IP address (all with a standard user type user agent), simultaneously reading a thread from 14 years ago. Sometimes 5 or more 'Guests' are reading the same thread from different IPs. These are obviously not normal human users / guests. Each instance carries a different browser type user-agent, and none look like robots.

Does anyone have any insight into what's going on here?

My forum just past 25 years old... and like most, the online activity has dwindled over the years in favor of other social media outlets. But we have a small loyal following and 25 years of archived technical information that can't be duplicated anywhere else. Even so, it's interesting to see almost 500 'visits' in a 10 minute period, most not identified as a web crawler / robot.

I'm curious if anyone else is experiencing inundation of 'Guests'.

Thanks all.

PaulC
MonteCarloSS.com
Liked Replies
by isaac
isaac
I see a lot of bots as well. They mostly look like deep crawlers, looking to cache data. Possibly for additional AI training (?) since I have a niche topic site, also with information progressing back about 25 years. About 25% of my crawler/bot activity lately has been just from Facebook's "Meta Web Crawler." The rest with similar IP addresses, i assume are also either content bots or users on VPNs, which are attempting to pre-fetch data by downloading everything attached to the page they are visiting.
2 members like this
by Gizmo
Gizmo
Pretty common everywhere I access...
UBBCentral: 2 members, 167 guests, and 162 robots.
UBBDev: 2 Members, 380 Guests, and 587 Robots
AGF: 3 Members, 2152 Guests, 249 Robots

UBBDev and AGF has the guest timeframe set to 720 minutes (12 hours)
1 member likes this
ShoutChat
Comment Guidelines: Do post respectful and insightful comments. Don't flame, hate, spam.
Recent Topics
Who's Online Now
0 members (), 268 guests, and 112 robots.
Key: Admin, Global Mod, Mod
Random Gallery Image
Latest Gallery Images
Ride safe!
Ride safe!
by Morgan, December 7
Los Angeles
Los Angeles
by isaac, August 6
3D Creations
3D Creations
by JAISP, December 30
Artistic structures
Artistic structures
by isaac, August 29
Powered by UBB.threads™ PHP Forum Software 8.1.0
(Snapshot build 20250209)