1. Input
Paste the rules and enter the exact path a crawler should access.
2. Read the result
See the longest matching Allow or Disallow rule and its line number.
3. Take action
Correct accidental blocks, publish the file at the domain root and test the live path.
Scope
Generate a safe robots.txt file or test which rule applies to a URL path for a selected crawler.
Important limit
The tester applies common robots.txt matching rules and identifies the controlling line. Disallow controls crawling; it is not a reliable removal or noindex method.