Previous Thread
Next Thread
Print Thread
Hop To
#227108 06/10/2009 9:34 PM
Joined: Apr 2009
Posts: 12
C
stranger
stranger
C Offline
Joined: Apr 2009
Posts: 12
I have noticed this spider listed in the "whose online" section of spiders and I wanted to ask first if the yahoo spider is suppose to show up with inktomi? I have looked at a number of UBB boards and I see Yahoo! and Google but our boards seem to have MSN, Google, and then the rest this spider. The other thing I am not sure about is the length of stay. Most are over 8 minutes. Is that normal?

Right now I am counting 49 inktomi spiders and about 5 from other sources.

Any advice?

Thanks,
Helen

cpohelen #227110 06/10/2009 10:29 PM
Joined: Jun 2006
Posts: 16,299
Likes: 116
UBB.threads Developer
UBB.threads Developer
Joined: Jun 2006
Posts: 16,299
Likes: 116
Well, the Yahoo! trigger in the search engines page is "Yahoo! Slurp" whereas Inktomi is "Slurp"; so that'd be why both show differently, because when Yahoo crawls for Yahoo it crawls with a specific user agent.

And spiders work in different ways, some send several bots at once and ping specific pages, only to come back another day and grab more; whereas some come once, ping a set number, then leave; and others come, crawl, and leave at their leisure.

normal, yes.


I am a Web Development Contractor, I do not work for UBBCentral. I have provided free User to User Support since the beginning of these support forums.
Do you need Forum Install or Upgrade Services?
Forums: A Gardeners Forum, Scouters World
UBB.threads: UBBWiki, UBB Styles, UBB.Sitemaps
Longtime Supporter & Resident Post-A-Holic
VNC Web Services: Code Modifications, Upgrades, Styling, Coding Services, Disaster Recovery, and more!

Link Copied to Clipboard
ShoutChat
Comment Guidelines: Do post respectful and insightful comments. Don't flame, hate, spam.
Recent Topics
Bots
by Outdoorking - 04/13/2024 5:08 PM
Can you add html to language files?
by Baldeagle - 04/07/2024 2:41 PM
Do I need to rebuild my database?
by Baldeagle - 04/07/2024 2:58 AM
This is not a bug, but a suggestion
by Baldeagle - 04/05/2024 11:25 PM
Is UBB.threads still going?
by Aaron101 - 04/01/2022 8:18 AM
Who's Online Now
0 members (), 797 guests, and 200 robots.
Key: Admin, Global Mod, Mod
Random Gallery Image
Latest Gallery Images
Los Angeles
Los Angeles
by isaac, August 6
3D Creations
3D Creations
by JAISP, December 30
Artistic structures
Artistic structures
by isaac, August 29
Stones
Stones
by isaac, August 19
Powered by UBB.threads™ PHP Forum Software 8.0.0
(Preview build 20230217)