User-Agent: *
Allow: /
Disallow: /logs/
Disallow: /common/
Disallow: /assets/