|
|
Re: Bots
Gizmo
04/14/2024 11:12 AM
Well, both methods display their .htaccess input code, the first would be (Blocking by user agent): # Block aggressive Chinese crawlers/scrapers/bots
# https://www.johnlarge.co.uk/blocking-aggressive-chinese-crawlers-scrapers-bots/
Options +FollowSymLinks
RewriteEngine On
RewriteBase /
RewriteCond %{HTTP_USER_AGENT} ahrefsbot|Baiduspider|BLEXBot|Bytespider|BuckyOHare|dotbot|exabot|gigabot|Goodzer|gsa-crawler|Kinza|LieBaoFast|LinkFeatureBot|MauiBot|Mb2345Browser|MicroMessenger|mj12bot|musobot|rogerbot|rushBot|semrushbot|serpstatbot|sitebot|Sogou|SputnikBot|VelenPublicWebCrawler|WBSearchBot|WPSpider|zh-CN|zh_CN [NC]
RewriteRule ^ - [F,L]The second method (IP2Location Firewall List by Country) you'd take the .htaccess coding from their list for an Apache2 server and insert it as (the list is huge, I'm only including a couple of lines): <Limit GET HEAD POST>
order allow,deny
allow from all
deny from 1.0.1.0/24
deny from 1.0.2.0/23
deny from 1.0.8.0/21
deny from 1.0.32.0/19
deny from 1.1.0.0/24
deny from 1.1.2.0/23
deny from 1.1.4.0/22
deny from 1.1.8.0/21
deny from 1.1.16.0/20
deny from 1.1.32.0/19
...
deny from 223.252.168.0/21
deny from 223.252.177.0/24
deny from 223.252.178.0/23
deny from 223.252.180.0/22
deny from 223.252.184.0/21
deny from 223.252.192.0/18
deny from 223.254.0.0/16
deny from 223.255.0.0/17
deny from 223.255.236.0/22
deny from 223.255.252.0/23
</Limit>
6
267
Read More
|
|
Re: Bots
Outdoorking
04/14/2024 8:59 AM
Thanks Gizmo,
I would really like to know what code that I need to put into the htaccess file because it appears that what I have placed in the robot.txt file is not working unless I have to wait longer.
6
267
Read More
|
|
Re: Bots
Outdoorking
04/14/2024 3:13 AM
Thanks for the reply. This is what I placed in the robot text file: User-agent: Baiduspider User-agent: 360Spider User-agent: Yisouspider User-agent: PetalBot Disallow: / User-agent: Bytespider Disallow: / User-agent: Sogou web spider Disallow: / User-agent: Sogou inst spider Disallow: / Does this look correct and how long would it take before it starts to work?
6
267
Read More
|
|
Re: Bots
Gizmo
04/13/2024 10:48 PM
FYI, if the bot visits the login page the Who's Online page will say that it's trying to login, since that's the wording for that system.
6
267
Read More
|
|
Bots
Outdoorking
04/13/2024 9:08 PM
Hi all,
I have noticed this in the Whos online Bytespider (bad_bot) has over 100 entries.
Another one is MJ12bot which is trying to login.
Should I do something about these two and if so what code do I need to run and where please.
I have noticed that if you have a lot it can cause issues slowing the forum down.
Any assistance would be appreciated.
6
267
Read More
|
|
Re: Do I need to rebuild my database?
Baldeagle
04/08/2024 6:14 AM
I only have five: POST_ID, POSTER_ID, TOPIC_ID, USER_ID, TIMESTAMP. Looks like I'm missing LIKE_ID and TYPE. I'm running 7.7.5. Did I miss a step during an upgrade? If so, is there a way to fix it?
6
304
Read More
|
|
Re: Do I need to rebuild my database?
Gizmo
04/08/2024 4:33 AM
Do you have a _LIKES table? LIKE_ID is the row column; it should have been added as a part of the v7.7.4 install (step 6 of the alter table). It should have 7 columns, LIKE_ID TYPE POST_ID POSTER_ID TOPIC_ID USER_ID TIMESTAMP
6
304
Read More
|
|
Can you add html to language files?
Baldeagle
04/07/2024 6:41 PM
The owners of the site have asked me to add a link to a specific page to the WEL_MSG of adduser.php. I noticed that the PM in my test account (which retained a copy of the welcome message) dispplays the <br> code (included in the language file) as plain text. This leads me to believe that the language file will ignore any html added to it. IOW, I want to add <a href="url here">go here</a> but I suspect that this will simply be displayed as plain text, which many new registratns will find confusing. (Our forum attracts a large number of retired folk that are not very computer savvy.) Is there a way to add a viable link to a language file? Or do I have to do this some other way? (Or it's not even possible.)
2
666
Read More
|
|
Do I need to rebuild my database?
Baldeagle
04/07/2024 6:58 AM
I tried to prune orphaned likes and got this error: Script: /var/www/html/ubbthreads/admin/dorebuildcontent.php
Line: 856
SQL Error: Unknown column 'LIKE_ID' in 'field list'
SQL Error: 1054
Query:
SELECT
COUNT(LIKE_ID) AS COUNT
FROM sbf_LIKES
GROUP BY
TYPE, POST_ID, POSTER_ID, TOPIC_ID, USER_ID
HAVING
COUNT(TYPE) > 1
AND COUNT(POST_ID) > 1
AND COUNT(POSTER_ID) > 1
AND COUNT(TOPIC_ID) > 1
AND COUNT(USER_ID) > 1
6
304
Read More
|
|
This is not a bug, but a suggestion
Baldeagle
04/06/2024 3:25 AM
I noticed today that we have almost 57,000 attachments in our attachments folder. That number of files in a single folder can make for some interesting problems on unix. I'm wondering if it would be possible to program the attachment folder in such a way that the images placed in it would be in separate folders, perhaps by day, week, or month? It would make it easier to locate problem files and allow ls to work without complaining about too many files.
Just a thought. Certainly not a high priority item.
1
293
Read More
|
|
Bots
by Outdoorking - 04/13/2024 5:08 PM
|
|
|
|
|
|
|
|
|
|
|
|
|
|
