# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file User-agent: baiduspider Disallow: / User-agent: BaiduMobaider Disallow: / User-agent: Yeti Disallow: / User-agent: NaverBot Disallow: / User-agent: BecomeJPBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: Sogou Disallow: / User-agent: Grub Disallow: / User-agent: Mail.Ru Disallow: / User-agent: Twiceler Disallow: / User-agent: FAST Enterprise Crawler Disallow: / User-Agent: * Disallow: /lookup Disallow: /m/lookup/ Disallow: /print/ Disallow: /qrcode/ Disallow: /books/ Disallow: /doko_ads_lineup/ Disallow: /mutter_entry Disallow: /javascripts/ Disallow: /stylesheets/ Disallow: /nbh/