# Robots.txt file from http://www.kyeagifts.com # All robots will spider the domain User-agent: * Disallow: /admin/ Allow: /file.html Allow: / Disallow: /file.asp Disallow: /count/ Disallow: /inc/