User-agent: Alexabot User-agent: ia_archiver User-agent: alexa site audit User-agent: Googlebot User-agent: Googlebot-News User-agent: Googlebot-Image User-agent: Googlebot-Mobile User-agent: Googlebot-Video User-agent: Mediapartners-Google User-agent: Adsbot-Google User-agent: msnbot User-agent: msnbot-media User-agent: Bingbot User-agent: adidxbot User-agent: Slurp User-Agent: Yahoo! Slurp User-agent: Yahoo-Blogs User-agent: Yahoo-MMCrawler User-agent: Baiduspider User-agent: Baiduspider-image User-agent: Baiduspider-video User-agent: Baiduspider-news User-agent: Baiduspider-favo User-agent: Baiduspider-cpro User-agent: Baiduspider-ads User-Agent: 360Spider User-Agent: Sogouspider #User-Agent: Yisouspider User-agent: AhrefsSiteAudit User-agent: AhrefsBot Crawl-delay: 3 # Directories Disallow: /Backend/ #User-agent: * #Allow: / #Crawl-delay: 3 # disallow all User-agent: * Disallow: / Crawl-delay: 600