User-Agent: * Allow: / Allow: /_next/static/css/ Allow: /_next/static/chunks/ Allow: /_next/static/media/ Allow: /images/ Disallow: /api/ Disallow: /healthz Disallow: /*?* Disallow: *&* Disallow: /*.pdf$ Disallow: /*.doc$ Disallow: /*.docx$ Disallow: /*.xls$ Disallow: /*.xlsx$ Disallow: /*.ppt$ Disallow: /*.pptx$ Disallow: /*.zip$ Disallow: /*.rar$ Disallow: /_next/ User-Agent: Googlebot User-Agent: Bingbot User-Agent: DuckDuckBot User-Agent: Baiduspider User-Agent: YandexBot Allow: / User-Agent: OAI-SearchBot User-Agent: Claude-SearchBot User-Agent: PerplexityBot User-Agent: YouBot User-Agent: Applebot-Extended User-Agent: Google-Extended User-Agent: ExaBot Allow: / User-Agent: GPTBot User-Agent: ChatGPT-User User-Agent: Google-Extended User-Agent: ClaudeBot User-Agent: CCBot User-Agent: anthropic-ai User-Agent: cohere-ai User-Agent: FacebookBot User-Agent: Meta-ExternalAgent User-Agent: Bytespider User-Agent: ImagesiftBot User-Agent: Omgilibot User-Agent: diffbot User-Agent: Timpibot User-Agent: VelenPublicWebCrawler User-Agent: magpie-crawler User-Agent: AwarioRssBot User-Agent: AwarioSmartBot User-Agent: DataForSeoBot User-Agent: Scrapy User-Agent: PetalBot User-Agent: FyberBot User-Agent: YisouSpider User-Agent: Pinterestbot User-Agent: MegaIndex Disallow: / User-Agent: Googlebot-Image Allow: /_next/static/media/ Allow: /images/ Allow: /*.webp$ Allow: /*.png$ Allow: /*.jpg$ Allow: /*.jpeg$ Disallow: /api/ User-Agent: Googlebot-News Allow: /news/ Allow: /blogs/ Allow: /blogs-and-podcasts/ User-Agent: Googlebot-Video Allow: /courses/ Allow: /podcasts/ Host: deltakonkur.com Sitemap: https://deltakonkur.com/sitemap.xml