User-agent: * Disallow: /ac Disallow: /search Disallow: /powgen Disallow: /lilook Disallow: /tvacheck User-agent: meta-webindexer Disallow: / User-agent: meta-externalagent Disallow: / User-agent: PerplexityBot Disallow: / User-agent: bingbot Disallow: /search Crawl-delay: 10 User-agent: SERankingBacklinksBot Crawl-delay: 10 User-agent: meta-externalagent Disallow: / User-agent: ClaudeBot Disallow: / #User-agent: Claude-SearchBot #Disallow: / #User-agent: Claude-User #Disallow: / #User-agent: OAI-SearchBot #Disallow: / User-agent: GPTBot Disallow: / #User-agent: ChatGPT-User #Disallow: / User-agent: Amazonbot Disallow: / User-agent: UptimeRobot Disallow: / User-agent: SemrushBot-SI Disallow: / User-agent: SemrushBot-SWA Disallow: / User-agent: SemrushBot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: SEOkicks-Robot Disallow: / User-agent: SiteCheckerBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: Baiduspider Disallow: / User-agent: Bytespider Disallow: / User-agent: PetalBot Disallow: / User-agent: HaloBot Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: Sogou web spider User-agent: Sogou spider User-agent: Sogou inst spider Disallow: / User-agent: AliyunSecBot Disallow: / User-agent: Exabot Disallow: / User-agent: BLEXBot Disallow: / User-agent: DotBot Disallow: / User-agent: rogerbot Disallow: / User-agent: Screaming Frog Disallow: / User-agent: Wotbox Disallow: / User-agent: IbouBot Disallow: / User-agent: CensysInspect Disallow: / User-agent: Website-info.net-Robot Disallow: / User-agent: Barkrowler Disallow: / User-agent: WellKnownBot Disallow: / User-agent: AdkernelTopicCrawler Disallow: / User-agent: ips-agent Disallow: / User-agent: wpbot Disallow: / User-agent: SleepBot Disallow: / User-agent: HaloBot Disallow: / User-agent: coccocbot-web Disallow: / User-agent: HubSpot Crawler Disallow: / User-agent: ORT Disallow: / User-agent: YaK Disallow: / User-agent: FreePBX-Scanner Disallow: / User-agent: WebCrawler Disallow: / User-agent: Amazing-SearchBot Disallow: / User-agent: ev-crawler Disallow: / User-agent: SaaSBrowserBot Disallow: / User-agent: Dataprovider.com Disallow: / User-agent: VelenPublicWebCrawler Disallow: / User-agent: ShapBot Disallow: / User-agent: OpenClaw Disallow: / User-agent: BacklinksExtendedBot Disallow: / User-agent: URLSuMa Disallow: / User-agent: SiteAuditBot Disallow: / User-agent: Nmap Scripting Engine Disallow: / User-agent: Leikibot Disallow: / User-agent: AudigentAdBot Disallow: / User-agent: SpiderLing Disallow: / User-agent: SEOkicks Disallow: / User-agent: LumireurProspectEnrichment Disallow: / User-agent: LumireurEnrichmentEngine Disallow: / User-agent: Zoombot Disallow: / User-agent: DiffeoBot Disallow: /