Yahoo Search Launches New Slurp Crawler

July 28th, 2006 by Loren Baker, Editor | No Comments

Yahoo Search Launches New Slurp Crawler

Yahoo Search has updated its Slurp Crawler to crawl web sites faster and more efficient. Yahoo’s David Simpson says on the Yahoo Search Blog that the result will be a “25% reduction in the number of requests and bandwidth consumed by the crawler.”

Reductions in bandwidth is good news to this publisher and the new Yahoo Slurp should be more than welcome to the web publishing and blogging community who do struggle with bandwidth. More from the Yahoo Slurp and Search Team:

While transitioning to the new crawler over the past few weeks, we had been running both crawlers in tandem. In some cases, this increased the frequency of Yahoo Search requests to websites. Now, with the new crawler in full production, we have turned off the old crawler and site owners should see a much lower crawl load without a loss in content coverage.

With this change of behavior in the crawler, you may see some shuffling of the pages that are included in the index and some changes in ranking as well.

Vote for this post : 0