MSN Search bot
Fri Feb 4 11:56:15 2005 EST (-0500 GMT)My web site used to get along pretty well with Google. They searched my web site a lot and I gaind some pretty good rankings. I couls just mention some one I know in my blog…. say…. Chris Court A.K.A. Monkey, and pretty soon I was the number one Google result for that person.
Well now that MSN has revamped their search engine it’s been getting a little greedy. As per this thread over on , the bot which Microsoft uses to index the world’s web pages appears to needlesly index all kinds of content.
Here’s what it’s been doing to this site in the last four days, versus all the other search engine bots:
Robots/Spiders visitors (Top 25) | |||||||||||||||||||||||||||||||||||||||||
|
* Robots shown here gave hits or traffic “not viewed” by visitors, so they are not included in other charts. Numbers after + are successful hits on “robots.txt” files