By Smart Web Tools / March 21, 2025 Smart Web Tools – Robots.txt Generator Robots.txt Generator Create a robots.txt file for your website in minutes! Website Settings Website URL Sitemap URL User Agent Rules User Agent All robots (*) Googlebot Bingbot Yandex DuckDuckBot Custom User Agent Custom User Agent Name Path Rule Type Allow Disallow Add Rule Common Settings Add Crawl-delay (10) No Index No Follow No Archive Download robots.txt Copy to Clipboard
