Free tools
Robots.txt Checker
Fetch robots.txt, list user-agent groups, rules and declared sitemaps.
Limits
Parses the standard directives (RFC 9309). Engine-specific extensions are shown but not interpreted.
Free tools
Fetch robots.txt, list user-agent groups, rules and declared sitemaps.
Parses the standard directives (RFC 9309). Engine-specific extensions are shown but not interpreted.