robots.txt: no indexing Posted byRamoonus 08/12/201303/01/2016 Leave a comment on robots.txt: no indexing To disallow any bot from crawling your site, add the following to robots.txt robotUser-Agent: * Disallow: / Dit delen:TwitterFacebookLinkedIn