Does the crawler use Google or a paid SEO API?

No. It uses direct public HTTP, HTTPS, DNS, robots.txt, sitemap, and HTML inspection from the Next.js server runtime.

Does the report guarantee that Google will index a page?

No. The report evaluates public technical signals such as status, robots rules, noindex directives, canonicals, and response content. Search engines make their own indexing decisions.

Does the crawler render JavaScript?

No. This edition analyzes server-delivered HTML and headers, and clearly labels that limitation.

Rex Technical SEO Toolkit

URL & Crawl Inspector

Audit redirects, HTTP status, indexability, robots.txt, XML sitemaps, internal links, duplicates, metadata, and crawl architecture from one evidence-based report.

SSRF protectedNo commercial APIsPoint-in-time scan

Website URL

Safe by default

Every hostname is resolved and validated before a DNS-pinned connection. Private networks, credentials, custom ports, oversized responses, and unbounded redirects are blocked.

Standards-aware

Robots rules use longest-match precedence, XML sitemap indexes are traversed separately, and status checks account for servers that reject HEAD requests.

Evidence, not guarantees

The report explains what was observed, what was capped, and what still needs browser testing, manual review, or search-engine verification.