User-agent: * Allow: / Disallow: /admin Disallow: /*? Disallow: /*.html$ Disallow: /*.xml$