Build a valid robots.txt for your site — add crawler rule groups, allow and disallow paths, a crawl-delay and sitemaps. Everything generates live in the box below and runs entirely in your browser.
Presets replace the current rules with a common starting point. Tweak them below.
Save this as robots.txt in the root of your domain (e.g. https://example.com/robots.txt).