The technical SEO checklist every crawl should cover
A technical SEO checklist is only as good as the crawler running it. Before you trust any tool's output, it helps to know what a thorough crawl should actually be checking—so you can tell a shallow scan from a real audit.
Status codes and indexability
Every crawled URL should be checked for its HTTP status code (200, 301/302, 404, 5xx) and whether it's actually indexable—no noindex tag, not blocked by robots.txt, and canonicalized correctly. Redirect chains and loops belong here too: a chain of three or four redirects wastes crawl budget and dilutes link equity, even if the final page loads fine.
On-page tags
Titles and meta descriptions should be checked for presence, length, and duplication across the site—not just existence. The same goes for H1s: missing, duplicate, or multiple H1s on one page are all common technical issues a good crawler flags automatically instead of making you eyeball every page.
Links
- Internal links: broken links, orphan pages (no internal links pointing to them), and pages buried too many clicks from the homepage.
- External links: broken outbound links hurt user trust even if they don't directly affect rankings.
- Redirect targets: links pointing to a redirect instead of the final URL add unnecessary hops.
Content and duplication
Thin content (very low word count) and duplicate content (near-identical pages, often from URL parameters or pagination) both dilute a site's relevance signals. A crawler should flag both, and ideally show you which pages are near-duplicates of each other, not just that duplication exists somewhere.
Sitemaps and crawlability
The XML sitemap should be checked against what the crawler actually discovered—URLs in the sitemap that 404, or crawlable pages missing from the sitemap, are both worth fixing. This is also where robots.txt rules get validated against real crawl behavior instead of just read as text.
Why prioritization matters more than the list
A full technical SEO checklist run against a mid-size site can easily surface hundreds of individual issues. The checklist itself isn't the hard part—deciding what to fix first is. That's why Frog Radar pairs every crawl with a Fix Plan that ranks issues by impact and effort, so the checklist above turns into a short, ordered list of what to do next instead of a spreadsheet nobody opens twice.