# # robots.txt for xkb # User-agent: * Crawl-delay: 20 Disallow: /admin/ Disallow: /item/ Disallow: /gogo/ Disallow: /includes/ Disallow: /customavatars/ Disallow: /images/ Disallow: /includes/ Disallow: /templates/ Disallow: /xkb_images/ User-agent: YodaoBot-News Disallow: / User-agent: YodaoBot Disallow: /