Generate search engine crawl rules and robots.txt directives.
Execution runs 100% locally inside the browser sandbox using HTML5 Canvas, Web Cryptography Subtle API, and Web Workers. Zero egress.
Zero network latency. Operates completely offline with zero dependencies on third-party backend servers or cloud services.
Built according to official RFC specifications, cryptographic test vectors, and enterprise-grade data transformation standards.
Specify User-agent rules (*, Googlebot, Bingbot) with Allow and Disallow paths.
Enter your full sitemap.xml URL to help search bots locate all indexable pages.
Copy or export the generated robots.txt file and place it in your web server root directory.
It must be accessible at the top-level root of your domain (e.g., https://example.com/robots.txt).
Disallow prevents crawling, but to ensure a page is never indexed, use the 'noindex' meta tag instead.
Zero-egress companion tools in the SEO & Web suite
Generate geotargeting (geo.region, geo.placename, geo.position) meta tags for local SEO.
Generate rich audio OpenGraph metadata for Spotify, Apple Music, and podcast embeds.
Generate Google Knowledge Graph Schema.org Organization structured data.
Generate Pinterest Rich Pin metadata for automated product stock and article sync.
