User-agent: * Disallow: /directory.htm Disallow: /error.html