August 22, 2007
Yahoo Slurp Gets More Efficient & New Index Update
The Yahoo Search Blog announced that they have made major changes to their crawling process, plus rolled out a new update to their "crawl, index and ranking systems."
Recently, there have been many complaints that Yahoo's crawler, Yahoo Slurp, is crawling a site to heavily. Yahoo has taken this feedback and has improved their crawl process to have less of an impact on your server. You should notice a "significant reduction in crawl load from" Slurp "with fewer machine IP addresses hitting you over the last few days."
Filed under Search Engines by Barry Schwartz
