User-agent: * Disallow: /admin/ Disallow: /gateways/ Disallow: /resources/ Disallow: /routines/ Disallow: /stats/