# All robots will spider the domain User-agent: * Disallow: /css/ Disallow: /lj/ Disallow: /album/ Disallow: /mindterm/ Disallow: /errors/