User-Agent: * Allow: / Disallow: /api/ Disallow: /admin Disallow: /login Disallow: /catalog/preview/