Originally Posted by Ruben
If the bot honers it you can create a robots.txt file in your root folder and exclude by agent, ip etc
https://en.wikipedia.org/wiki/Robots.txt
https://ubbdev.com/wiki/view/7/ubb-sitemaps.html

If they do not honor the robots file you can ban them via the htaccess file or the UBB control panel using ip.

If it becomes a ddos attack you need to use something like cloudflare or ask your host about ddos protection.

Thanks for the reply. This is what I placed in the robot text file:

User-agent: Baiduspider
User-agent: 360Spider
User-agent: Yisouspider
User-agent: PetalBot
Disallow: /

User-agent: Bytespider
Disallow: /

User-agent: Sogou web spider
Disallow: /

User-agent: Sogou inst spider
Disallow: /

Does this look correct and how long would it take before it starts to work?

Last edited by Outdoorking; 04/13/2024 11:14 PM.