Free tools

Robots.txt Checker

Fetch robots.txt, list user-agent groups, rules and declared sitemaps.