# Exclude Files From All Robots: User-agent: * Disallow: /cgi-bin Disallow: /dwscroll Disallow: /layers # Disallow Internet Archiver User-agent: ia_archiver Disallow: / # End robots.txt file