# robots.txt for andonyar.com User-agent: wget Disallow: # If someone wants to fetch a part of my website (including the # /temp/ directory), this is OK. User-agent: * Disallow: /temp/ # There is really no reason in indexing /temp/. However, if someone # wants to fetch a part of /temp/, I have nothing against it. Disallow: /test/