# www.robotstxt.org/ # www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449 # User-agent: * Disallow: */3055-* Disallow: */3001-* Disallow: *?sort=* Disallow: /download-launch?* User-agent: GPTBot Disallow: / Sitemap: https://download.cnet.com/sitemaps/products_index.xml Sitemap: https://download.cnet.com/sitemaps/cat_listings.xml Sitemap: https://download.cnet.com/sitemaps/alternatives.xml