Robots.txt tester

Tool description for robots-txt-tester

Site URL — fetches /robots.txt from the server

robots.txt contents

Fetch or paste a robots.txt

Validates the structure, separates crawler groups, and lets you test any path against the rules.