User-agent: * Disallow: /api/ User-agent: Googlebot Disallow: /*/feed/ Disallow: /search/* Disallow: /?s=* Sitemap: https://cybernews.com/sitemap_index.xml