User-agent: * Disallow: /admin Disallow: /vault Disallow: /api_version1_sitefiles Disallow: /api_version2_sitefiles