User-agent: * Disallow: /404/ Disallow: /crossdomain.xml Disallow: /inc/ Disallow: /mt/ Disallow: /xml/ Disallow: /cmn/ Disallow: /css/ Disallow: /services/