# robots.txt for magicrep.net User-agent: * Allow: / # Avoid indexing build/system paths if any Disallow: /admin/ Disallow: /private/ Disallow: /_internal/ # Crawl hygiene # (Google ignores crawl-delay; Bing/Yandex may honor it) Crawl-delay: 5 # Hints for some crawlers Host: magicrep.net # Sitemaps Sitemap: https://magicrep.net/sitemap-index.xml