User-Agent: * Disallow: /pages/ Disallow: /static/ Disallow: /api/