User-agent: * Disallow: /_ Disallow: /admin Disallow: /webalizer Disallow: /.ini Disallow: /.xls Disallow: /.csv Disallow: /.txt