Atelier
Tools
Account
Robots.txt Generator
Create and validate robots.txt files
Rule Group 1
Remove Rule Group
User-Agent
*
Googlebot
Bingbot
GPTBot
ChatGPT-User
CCBot
Bytespider
Disallow Paths
+ Add Disallow Path
Allow Paths
+ Add Allow Path
Crawl-Delay
+ Add Rule Group
Sitemaps
Add Sitemap
Import Paths
PRO
Load Template
PRO
Preview
Validation
Bot Simulator
PRO
Wildcards
PRO
History
PRO
# Robots.txt
# Generated by Atelier Tools
User-agent:
*
Select Bot
* (All robots)
Googlebot
Bingbot
GPTBot
ChatGPT-User
CCBot
Bytespider
YandexBot
Baiduspider
DuckDuckBot
Test a URL Path
Test Path
Wildcard Pattern
Test Paths (one per line)
Test Pattern
Copy to Clipboard
Download robots.txt
Import Paths
X
Paste paths, one per line
Add as
Disallow
Allow
Target Rule Group
Cancel
Import
Template Library
X
WordPress
Blocks wp-admin, wp-includes, login, feeds, and search. Allows admin-ajax.
Shopify
Blocks checkout, cart, admin, orders, and account pages. Allows collections.
Next.js
Blocks internal data routes and API endpoints. Allows static assets.
Laravel
Blocks storage, vendor, and admin panel. Allows public storage.
Static Site
Minimal configuration. Allows all crawling with sitemap reference.
Strict
Blocks all bots from all paths. Maximum restriction.
Open
Allows everything for all bots. No restrictions.
Upgrade to Pro
X
+
Batch path import from URL lists
+
Bot interpretation simulator
+
Platform template library
+
Wildcard pattern testing
+
Version history with diff comparison
+
Unlimited rule groups
Help & Guides
How to Use This Tool
FAQ
Related Tools
Canonical Tag Generator
Free online tool for your workflow
Faq Schema Generator
Free online tool for your workflow
Free online tool for your workflow
Open Graph Debugger
Free online tool for your workflow