User-agent: *
Allow: /
Disallow: /assets/   
Disallow: /logs/
Disallow: /usage/