robots.txt: no indexing

Posted on by

To disallow any bot from crawling your site, add the following to robots.txt

robotUser-Agent: *
Disallow: /

Leave a Reply

Your email address will not be published. Required fields are marked *