The Hash Agency

Robots.txt Analyzer

Robots.txt Analyzer reads and parses your robots.txt file the same way Google would, to find sitemaps and rules.

How does this tool work?

  • Step 1: Type or paste your website URL— for example,
  • Step 2: Press Enter
  • Step 3: Be calm! The tool is now processing your data and will return the output after a few seconds

@ 2020 The Hash Agency