Sitemap: https://ebikeoracle.com/sitemap.xml User-agent: * Allow: / # Block internal / non-content paths Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login # Block query-string crawl spam Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* # Search + AI engine allowlist (SEO/AEO/GEO discoverability) # Each gets explicit Allow: / so a future Disallow on User-agent: * # does not accidentally silence them. # # A named User-agent group REPLACES the `*` group outright โ€” it does not # merge with it (RFC 9309 ยง2.2.1). So every denylist path has to be # repeated inside each named group or the bot is free to crawl it. Until # 2026-08-02 they were not, and ClaudeBot/OAI-SearchBot/PerplexityBot/ # GPTBot crawled /go/ 210+ times โ€” affiliate redirects burning ~10% of AI # crawl budget on URLs that only ever bot-bounce. `Allow: /` still wins # for everything else: within a group the longest matching rule decides, # so `Disallow: /go/` (5 chars) beats `Allow: /` (1 char) on /go/* only. User-agent: Googlebot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: Googlebot-Image Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: Googlebot-Video Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: Googlebot-News Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: Storebot-Google Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: Google-InspectionTool Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: Bingbot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: msnbot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: adidxbot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: DuckDuckBot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: DuckAssistBot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: YandexBot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: YandexImages Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: YandexAccessibilityBot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: Bravebot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: Baiduspider Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: Baiduspider-image Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: Baiduspider-news Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: Baiduspider-video Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: Sogou web spider Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: Sogou inst spider Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: Sogou Pic Spider Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: 360Spider Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: HaoSouSpider Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: YisouSpider Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: Sosospider Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: Yeti Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: NaverBot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: SeznamBot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: Qwantify Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: Qwantbot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: Mojeek Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: MojeekBot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: MarginaliaBot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: YepBot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: StractBot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: AhrefsBot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: SemrushBot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: SemrushBot-SA Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: SemrushBot-OCOB Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: SemrushBot-SWA Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: MJ12bot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: DotBot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: rogerbot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: serpstatbot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: Google-Extended Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: GoogleOther Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: GoogleOther-Image Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: GoogleOther-Video Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: Google-NotebookLM Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: Gemini-Deep-Research Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: Google-CloudVertexBot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: Google-Agent Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: GPTBot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: OAI-SearchBot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: ChatGPT-User Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: ChatGPT Agent Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: ClaudeBot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: Claude-User Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: Claude-SearchBot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: PerplexityBot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: Perplexity-User Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: Applebot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: Applebot-Extended Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: MistralAI-User Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: cohere-ai Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: cohere-training-data-crawler Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: DeepSeekBot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: YouBot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: PhindBot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: Andibot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: iAskBot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: iaskspider Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: iaskspider/2.0 Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: kagi-fetcher Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: ExaBot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: TavilyBot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: LinkupBot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: LinerBot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: AzureAI-SearchBot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: Amazonbot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: Amzn-SearchBot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: Amzn-User Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: FacebookBot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: meta-externalagent Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: Meta-ExternalAgent Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: meta-externalfetcher Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: facebookexternalhit Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: Twitterbot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: LinkedInBot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: Pinterestbot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: Discordbot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: Slackbot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: Slackbot-LinkExpanding Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: TelegramBot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: WhatsApp Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: CCBot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: AI2Bot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: Ai2Bot-Dolma Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: FriendlyCrawler Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: WRTNBot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: Bytespider Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: PetalBot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: PanguBot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: BLEXBot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: DataForSeoBot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: Brightbot 1.0 Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* User-agent: TimpiBot Allow: / Disallow: /admin Disallow: /go/ Disallow: /api/ Disallow: /login Disallow: /ebikes?* Disallow: /compare?* Disallow: /best?* Disallow: /guides?* Disallow: /blog?* # Competitive SEO scrapers + aggregators (block โ€” no SEO upside, # allowing exposes content gaps to competitors) User-agent: omgili Disallow: / User-agent: omgilibot Disallow: / User-agent: Webzio-Extended Disallow: / User-agent: webzio-extended Disallow: / User-agent: Diffbot Disallow: / User-agent: img2dataset Disallow: / User-agent: ImagesiftBot Disallow: / User-agent: Scrapy Disallow: / User-agent: KlaviyoAIBot Disallow: / User-agent: wpbot Disallow: / User-agent: NetEstate Imprint Crawler Disallow: / # Yandex-specific canonical-host hint Host: ebikeoracle.com Sitemap: https://ebikeoracle.com/sitemap.xml