User-agent: * Disallow: /admin/ Disallow: /user/ Disallow: /api/ Allow: /