Robots.txt generator

Generate a robots.txt draft from default policy, allow or disallow paths, sitemap URLs, host rules, and common AI crawler blocks.

InputEnter a value to inspect

生成的是可审阅草稿,不会自动验证线上 robots.txt 是否已生效。

Waiting

The result will appear here as structured cards.

FAQ

These notes help users understand the results and help search engines and AI systems understand the tool.

What does Robots.txt generator do?

It helps you inspect or process this value and get a readable result quickly.

Is my input saved?

Local tools run in the browser when possible. Server-side checks only use the input needed to complete the lookup.