# All search engine robots will spider the domain and all its files using User-agent: * # If you dont want to allow files being spidered use Disallow: filename.htm User-agent: * Disallow: /ei/ Disallow: /ep/ Disallow: /emailedImages.aspx Disallow: /emailedPortfolio.aspx Disallow: /image/