User-Agent: * Crawl-delay: 10 Disallow: /gblog/admin/ Disallow: /gblog/template/ Disallow: /cgi-bin/ Disallow: /logs/ Disallow: /AnsMk/ User-agent: dotbot Disallow: / User-agent: MJ12bot Disallow: / User-agent: BecomeJPBot Crawl-Delay: 120 User-agent: Twiceler Disallow: / User-agent: twiceler. Disallow: / User-agent: yetibot Disallow: / User-agent: yeti Disallow: / # User-agent: Y!J-* Disallow: / # User-agent: psbot Disallow: / # User-agent: e-SocietyRobot Disallow: / User-agent: Yahoo! Slurp #User-agent: UbiCrawler Disallow: /cgi-bin/ Disallow: /logs/ Disallow: /jawa/ Disallow: /Angkor/pre-rup/ Disallow: /Angkor/bakhend/ Disallow: /Angkor/banteay-kdei/ Disallow: /Angkor/preah-khan/ Disallow: /Angkor/kbal-spean/ Disallow: /Angkor/tonle-sap/ Disallow: /Angkor/ta-som/ Disallow: /Angkor/angkor/ Disallow: /Angkor/bayon/ Disallow: /Angkor/wat/ Disallow: /Angkor/etc/ Disallow: /Angkor/sun/ Disallow: /Angkor/thom/ Disallow: /Srilanka/Matale/ Disallow: /SriLanka/etc/ Disallow: /SriLanka/Mihin/ Disallow: /SriLanka/Last/ Disallow: /SriLanka/Dambulla/ Disallow: /SriLanka/food_35/ Disallow: /SriLanka/Anura/ Disallow: /SriLanka/Kandy/ Disallow: /SriLanka/Lady/ Disallow: /SriLanka/Poron/ Disallow: /SriLanka/safari/ Disallow: /SriLanka/Sigiriya/ Disallow: /SriLanka/Sigiriya2/ Disallow: /SriLanka/photo/ Disallow: /SriLanka/hotel/ Disallow: /Thai/ # User-agent: baiduspider Disallow: / User-agent: baidu Disallow: / User-agent:baiduspider Disallow: / User-agent:baidu Disallow: / User-agent: Steeler Disallow: / User-Agent: NaverBot* Disallow: / User-agent: ZyBorg Disallow: /Angkor/ Disallow: /Thai/ Disallow: /cgi-bin/ Disallow: /logs/ User-agent: Ask Jeeves/Teoma Disallow: / User-agent: 218.145.25. Disallow: / User-agent: 61.78.61. Disallow: / User-agent: 210.177.255.41 Disallow: /