Technical SEO
Robots.txt Checker
Check whether a public site exposes robots.txt, sitemap hints, broad disallow rules, and crawl guidance worth reviewing.
Tool mode
Crawl access check
Proof angle
Fetches only the site robots.txt through the public-safe wrapper.
Data handling
Browser-first or public-safe wrapper
Public-safe wrapper: http/https only, private networks blocked, redirects limited, timeout enforced, and oversized responses rejected.
How to interpret it
Treat the result as a planning signal, not a final quote or guarantee. The strongest next move is the one that improves both the business number and the user experience behind it.
Privacy and scope
This MVP runs in the browser and does not send your calculator inputs to PiB. If you ask us to review the result, we will scope that as a separate conversation.
Is a missing robots.txt always bad?
Not always. Many simple sites work without one, but a deliberate file helps communicate sitemap locations and crawl rules.
Can this prove Google indexes the site?
No. It checks crawl guidance only. Search Console and live index checks are needed for indexing proof.