Robots.txt Generator
Create a robots.txt file to control how search engine crawlers access your site. Support for Googlebot, Bingbot, GPTBot, and more.
*
Googlebot
Bingbot
GPTBot
CCBot
ChatGPT-User
Google-Extended
Slurp
DuckDuckBot
Generated robots.txt
User-agent: * Allow: /
How to Use Robots.txt Generator
- Select which crawlers you want to configure (Googlebot, Bingbot, GPTBot, etc.).
- For each crawler, choose whether to allow or disallow access.
- Add specific paths to allow or disallow if needed.
- Enter your sitemap URL to include it in the robots.txt.
- Copy or download the generated robots.txt file.