# All agents User-agent: * Disallow: /account/ Disallow: /login/ Disallow: /password/ Disallow: /buy/ Disallow: /order/ Disallow: /purchase/ Disallow: /php/ Disallow: /zoom/ Disallow: /images/ User-agent: msnbot Disallow: /account/ Disallow: /login/ Disallow: /password/ Disallow: /buy/ Disallow: /order/ Disallow: /purchase/ Disallow: /currency/ Disallow: /shop/group/ Disallow: /shop/brand/ Disallow: /search/ Disallow: /*?* Disallow: /*.jpg$ Disallow: /*.gif$ Disallow: /*.png$ Allow: /shop/*?from* User-agent: bingbot Disallow: /account/ Disallow: /login/ Disallow: /password/ Disallow: /buy/ Disallow: /order/ Disallow: /purchase/ Disallow: /currency/ Disallow: /shop/group/ Disallow: /shop/brand/ Disallow: /search/ Disallow: /*?* Disallow: /*.jpg$ Disallow: /*.gif$ Disallow: /*.png$ Allow: /shop/*?from* User-agent: AhrefsBot Disallow: / User-agent: Baiduspider Disallow: / User-agent: Baiduspider-image Disallow: / User-agent: Baiduspider-video Disallow: / User-agent: Baiduspider-news Disallow: / User-agent: Baiduspider-favo Disallow: / User-agent: Baiduspider-cpro Disallow: / User-agent: Baiduspider-ads Disallow: / User-agent: bidswitchbot Disallow: / User-agent: BLEXBot Disallow: / User-agent: Yahoo-MMCrawler Disallow: / User-agent: TjoosBot Disallow: / User-agent: trunk.ly Disallow: / User-agent: Charlotte Disallow: / User-agent: Charlotte/1.0b Disallow: / User-agent: 360Spider Disallow: / User-agent: 008 Disallow: / User-agent: 192.comAgent Disallow: / User-agent: Accoona-AI-Agent Disallow: / User-agent: Acoon-Robot Disallow: / User-agent: aipbot/1.0 Disallow: / User-agent: BecomeBot Disallow: / User-agent: boitho.com-dc Disallow: / User-agent: bot/1.0 Disallow: / User-agent: CatchBot Disallow: / User-agent: CazoodleBot Disallow: / User-agent: CMS Crawler Disallow: / User-agent: ConveraCrawler Disallow: / User-agent: CopyRightCheck Disallow: / User-agent: cosmos Disallow: / User-agent: daumoa Disallow: / User-agent: DiamondBot Disallow: / User-agent: disco/Nutch-1.0-dev Disallow: / User-agent: discobot/1.0 Disallow: / User-agent: DittoSpyder Disallow: / User-agent: Ditto Image Search Disallow: / User-agent: dotbot Disallow: / User-agent: DotBot Disallow: / User-agent: Dumbot Disallow: / User-agent: EmeraldShield.com Web Spider Disallow: / User-agent: EasouSpider Disallow: / User-agent: EnaBot/1.0 Disallow: / User-agent: Exabot Disallow: / User-agent: Exabot-Images Disallow: / User-agent: e-SocietyRobot Disallow: / User-agent: fastcrawler Disallow: / User-agent: FAST-WebCrawler Disallow: / User-agent: Fasterfox Disallow: / User-agent: Faxobot Disallow: / User-agent: findlinks Disallow: / User-agent: FollowSite Bot Disallow: / User-agent: Gaisbot Disallow: / User-agent: Gaisbot/3.0 Disallow: / User-agent: GetURL Disallow: / User-agent: Gigabot Disallow: / User-agent: Gigabot/3.0 Disallow: / User-agent: Gigablast Disallow: / User-agent: Gigablast Search Engine Disallow: / User-agent: Gnomit Disallow: / User-agent: Grub/2.0 Disallow: / User-agent: GurujiBot Disallow: / User-agent: hbtronix.spider Disallow: / User-agent: httplib Disallow: / User-agent: ichiro Disallow: / User-agent: IconSurf Disallow: / User-agent: ilial Disallow: / User-agent: IlseBot Disallow: / User-agent: image.kapsi.net Disallow: / User-agent: InfoNaviRobot Disallow: / User-agent: Iron33 Disallow: / User-agent: JetBot Disallow: / User-agent: Java/1 Disallow: / User-agent: Jyxobot/1 Disallow: / User-agent: kalooga Disallow: / User-agent: libWeb/clsHTTP Disallow: / User-agent: LieBaoFast Disallow: / User-agent: LinkextractorPro Disallow: / User-agent: LinkScan Disallow: / User-agent: LinkpadBot Disallow: / User-agent: LinkWalker Disallow: / User-agent: LNSpiderguy Disallow: / User-agent: libwww-perl Disallow: / User-agent: LocalcomBot Disallow: / User-agent: ltx71 Bot Disallow: / User-agent: lwp-trivial/1.34 Disallow: / User-agent: lwp-trivial Disallow: / User-agent: Mata Hari Disallow: / User-agent: magpie-crawler Disallow: / User-agent: meanpathbot Disallow: / User-agent: MegaIndex Bot Disallow: / User-agent: MegaIndex.ru Disallow: / User-agent: Metaspinner Disallow: / User-agent: MIIxpc Disallow: / User-agent: MIIxpc/4.2 Disallow: / User-agent: MJ12bot Disallow:/ User-agent: MLBot Disallow: / User-agent: moget Disallow: / User-agent: moget/2.1 Disallow: / User-agent: MQQBrowser Disallow: / User-agent: MSRBOT Disallow: / User-agent: NaverBot-1.0 Disallow: / User-Agent: Nelian Disallow: / User-agent: NetcraftSurveyAgent Disallow: / User-agent: NetResearchServer Disallow: / User-agent: NextGenSearchBot Disallow: / User-agent: NimbleCrawler Disallow: / User-agent: NG/2.0 Disallow: / User-agent: NoteworthyBot/0.1 Disallow: / User-agent: Nutch Disallow: / User-agent: NutchCVS/0.7.2 Disallow: / User-agent: oBot Disallow: / User-agent: OmniExplorer_Bot Disallow: / User-agent: OOZBOT Disallow: / User-agent: Openbot Disallow: / User-agent: Openfind data gathere Disallow: / User-agent: Openfind Disallow: / User-agent: OpenISearch Disallow: / User-agent: OutfoxBot/0.5 Disallow: / User-agent: PhpDig Disallow: / User-agent: Pingdom GIGRIB Disallow: / User-agent: Pinterest Disallow: / User-agent: Plonebot Disallow: / User-agent: Pimonster Disallow: / User-agent: psbot Disallow: / User-agent: pulseBot Disallow: / User-agent: Purebot Disallow: / User-agent: Python-urllib Disallow: / User-agent: RepoMonkey Disallow: / User-agent: rogerbot Disallow: / User-agent: RMA Disallow: / User-agent: SapphireWebCrawler Disallow: / User-agent: SBIder Disallow: / User-agent: ScoutJet Disallow: / User-agent: schibstedsokbot Disallow: / User-agent: ScSpider Disallow: / User-agent: Scooter Disallow: / User-agent: SearchmetricsBot Disallow: / User-agent: searchpreview Disallow: / User-agent: semanticdiscovery Disallow: / User-agent: SemrushBot Disallow: / User-agent: serpstatbot Disallow: / User-agent: Shelob Disallow: / User-agent: SEOprofiler Disallow: / User-agent: sp_auditbot Disallow: / User-agent: Shim-Crawler Disallow: / User-agent: Shopwiki Disallow: / User-agent: Sistrix Disallow: / User-agent: Snapbot/1.0 Disallow: / User-agent: Snoothbot Disallow: / User-agent: Sogou Pic Spider Disallow: / User-agent: sogou spider Disallow: / User-agent: sohu-search Disallow: / User-agent: Sosospider Disallow: / User-agent: Speedy Spider Disallow: / User-agent: Sproose Disallow: / User-agent: Storebot Disallow: / User-agent: SurveyBot Disallow: / User-agent: SurveyBot_IgnoreIP Disallow: / User-agent: suzuran Disallow: / User-agent: Szukacz Disallow: / User-agent: Teemer Disallow: / User-agent: The Informant Disallow: / User-agent: T-H-U-N-D-E-R-S-T-O-N-E Disallow: / User-agent: TightTwatBot Disallow: / User-agent: TMCrawler Disallow: / User-agent: toCrawl/UrlDispatcher Disallow: / User-agent: turingos Disallow: / User-agent: TurnitinBot Disallow: / User-agent: URL_Spider_Pro Disallow: / User-agent: URLy Warning Disallow: / User-agent: VCI WebViewer Disallow: / User-agent: VCI Disallow: / User-agent: VisBot Disallow: / User-agent: VoilaBot Disallow: / User-agent: voyager Disallow: / User-agent: vscooter Disallow: / User-agent: 3.3.vscooter Disallow: / User-agent: VWBot Disallow: / User-agent: WBSearchBot Disallow: / User-agent: WebAlta Crawler Disallow: / User-agent: WebarooBot Disallow: / User-agent: webinator Disallow: / User-agent: Website Quester Disallow: / User-agent: Webster Pro Disallow: / User-agent: WebZip Disallow: / User-agent: Web Image Collector Disallow: / User-agent: Wget/1.6 Disallow: / User-agent: Wget/1.8.2 Disallow: / User-agent: Wget Disallow: / User-agent: wume_crawler Disallow: / User-agent: wwwster Disallow: / User-agent: XoviBot Disallow: / User-agent: yacy Disallow: / User-agent: Yahoo! Slurp China Disallow: / User-agent: Yandex Disallow: / User-agent: Yanga Disallow: / User-agent: Yanga WorldSearch Bot Disallow: / User-agent: YebolBot Disallow: / User-agent: Yeti Disallow: / User-agent: YodaoBot Disallow: / User-agent: YodaoBot-Image Disallow: / User-agent: yoozBot Disallow: / User-agent: yodaoice Disallow: / User-agent: ZoominfoBot Disallow: / User-agent: ZyBorg Disallow: /