Blog
Updates and posts from the team.
How to audit my website's sitemap for hidden pages
A practical audit: find sitemap URLs that are disallowed, noindex, or unlinked so you can fix conflicts and clean up.
How to audit my website for secret pages
A structured audit to find pages that are blocked, noindexed, unlinked, or otherwise hidden—and what to do with them.
What pages exist on my site that aren't linked from anywhere?
How to get a list of every URL on your site that doesn't appear as a link on any other page—and what to do with it.
How do I see every URL that's disallowed in my robots.txt?
robots.txt shows Disallow patterns, not a URL list. Here's how to get a concrete list of every URL (or path) that's disallowed.
How to find hidden pages on any website
A practical guide to discovering URLs that are blocked, noindexed, unlinked, or otherwise hidden from normal crawling and navigation.
How to find noindex pages on your site
A practical method to list every URL on your site that sends noindex (meta or header), and what to do with the list.
How to find orphaned pages on your website
A practical way to discover URLs that exist but aren't linked from anywhere on your site, and what to do with them.
How to find pages blocked by robots.txt
A practical guide to discovering every URL blocked by your robots.txt Disallow rules, and why it matters for SEO and audits.
Welcome to Hidden Pages
Who Hidden Pages is for, what the tool does, and how to try it.