# Begin robots.txt file Sitemap: http://www.rheumatology.org/sitemap.aspx User-agent: SirdataBot Disallow: / User-agent: SEMrushBot Disallow: / User-agent: weborama Disallow: / User-agent: SemanticScholarBot Disallow: / User-agent: mj12bot Disallow: / UserAgent: bingbot Disallow: / UserAgent: facebook Disallow: / UserAgent: facebot Disallow: / UserAgent: facebookexternalhit/1.0 (+http://www.facebook.com/externalhit_uatext.php) Disallow: / UserAgent: facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php) Disallow: / UserAgent: diffbot Disallow: / UserAgent: yandex Disallow: / UserAgent: Sogou Pic Spider/3.0( http://www.sogou.com/docs/help/webmasters.htm#07) Disallow: / UserAgent: Sogou head spider/3.0( http://www.sogou.com/docs/help/webmasters.htm#07) Disallow: / UserAgent: Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07) Disallow: / UserAgent: Sogou Orion spider/3.0( http://www.sogou.com/docs/help/webmasters.htm#07) Disallow: / UserAgent: Sogou-Test-Spider/4.0 (compatible; MSIE 5.5; Windows 98) Disallow: / UserAgent: trendkite-akashic-crawler Disallow: / UserAgent: SeznamBot Disallow: / UserAgent: napoveda Disallow: / UserAgent: mopub Disallow: / # End of robots.txt file