|
|
|
|
Joined: Dec 2003
Posts: 6,634 Likes: 87
|
|
Joined: Dec 2003
Posts: 6,634 Likes: 87 |
I have a site that is just crawled to death by AhrefsBot.
Every day when I view WOL at least 300 minimum by the same bot.
I looked them up
They do respect robots.txt.
But it appears it is a bot for marketing research only
Does this bot do any good for me?
Seems to me it does not help for search engine indexing for visitor traffic.
Thoughts..
FWIW,
This site has the bulk of the bots as AhrefsBot..
Last edited by Ruben; 04/27/2019 12:47 PM. Reason: Added comment.
Blue Man Group
There is no such thing as stupid questions. Just stupid answers
|
|
|
|
|
Joined: Jun 2006
Posts: 16,447 Likes: 141
|
|
Joined: Jun 2006
Posts: 16,447 Likes: 141 |
They're basically scanning your site for pages/sites you link to, and displaying data to their subscribers; it's likely not much benefit to you or your site, but to advertisers or your competitors it could be an SEO marketing tool.
It won't affect your search engine ranking anywhere to ban them, and may even speed up your site by not having them wasting your bandwidth for their service that you'll likely never use.
|
|
|
|
|
Joined: Dec 2003
Posts: 6,634 Likes: 87
|
|
Joined: Dec 2003
Posts: 6,634 Likes: 87 |
That's what I found out from my research.
Thanks.
Blue Man Group
There is no such thing as stupid questions. Just stupid answers
|
|
|
|
1 members (Conrad),
19,085
guests, and
358
robots. |
|
Key:
Admin,
Global Mod,
Mod
|
|
|
|
|
|
