User-agent: * Disallow: /_ Disallow: /asp Disallow: /data/ Disallow: /errormsg/ Disallow: /ftp Disallow: /instant_ Disallow: /manage/ Disallow: /scripts/ Disallow: /ssl User-Agent: W3C-checklink Disallow: