# Robots.txt file from http://www.tuchong.com # All robots will spider the domain User-agent: YandexBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: Purebot Disallow: / User-agent: psbot Disallow: / User-agent: * Disallow: /admin/ Disallow: /api/