SEO & Web Tools
Robots.txt Generator
Build a valid robots.txt file with your allow, disallow, and sitemap rules.
robots.txt
User-agent: * Disallow: /admin Disallow: /api Sitemap: https://example.com/sitemap.xml
Frequently asked questions
It must be placed at the root of your domain — for example, https://example.com/robots.txt — for search engines to find it.