Free robots.txt generator
Build a robots.txt, with a choice of how to treat Google, AI training crawlers and AI search bots. Runs in your browser; nothing you type is sent to us.
robots.txt is a request that well-behaved crawlers follow, not a lock. Blocking the AI search bots can stop assistants from showing your site in their answers.
Using the robots.txt maker in three steps.
- Choose which folders to keep crawlers out of and add your sitemap address.
- Pick how to treat Google, AI training crawlers and AI search bots.
- Copy the file and save it as robots.txt in the top folder of your site.
About the robots.txt maker.
Does robots.txt hide a page from Google?
No. It asks crawlers not to fetch a page, but a blocked address can still be listed. Use a noindex tag to keep a page out of results.
Is robots.txt a security tool?
No. Anyone can read it and not every bot follows it. Never rely on it to protect private pages.
Where does the file go?
At the root of your domain, for example example.com/robots.txt.
Try these next.
Google result preview
See how a page title and description may look in Google, and check their length before you publish.
Meta and social tags
Write the title, description, canonical, robots and Open Graph tags for a page, ready to paste into its head.
Structured data (JSON-LD)
Make schema markup for a local business, an FAQ or an article, so search engines and AI assistants understand the page.
sitemap.xml maker
Paste your page addresses and get a valid sitemap.xml to upload and submit in Search Console.
Keyword check
Paste a page's text and a keyword: word count, how often the keyword appears and whether it is in the opening lines.
Local keyword ideas
Combine your services with the areas you serve into a list of local search phrases for pages, posts and your Google Business Profile.
We run the SEO and AI-search work.
You run the business.
SEO, local search, social media, ads, PR and WhatsApp outreach, planned and managed by one team.