Home » Google Webmaster Central Adds robots.txt Feature

August 16, 2007

Google Webmaster Central Adds robots.txt Feature

Google Webmaster Central’s robots.txt analysis tool has been improved to recognize sitemap declarations and relative urls.

Google says that previous versions “weren’t aware of sitemaps at all, and understood only absolute URLs; anything else was reported as Syntax not understood.

Improvements include :

  • System now tells webmaster whether sitemap’s URL and scope are valid.
  • Webmaster can also test against relative URLs with a lot less typing.
  • Reporting is better : webmaster now alerted of multiple problems per line if they exist, unlike earlier versions which only reported the first problem encountered.

More information from the Google Webmaster Central Blog.

Filed under Search Engines by Loren Baker, Editor

Permalink Print
All trademarks and copyrights owned by their respective owners and are used for illustration only
Kokopelli Creative Web Design
SEOverboard | Site Marketing USA
Made with WordPress and a healthy dose of Semiologic • Bankers Hours Plum skin by TC for Myrna