User-agent: * Disallow: /backup/ Disallow: /cron/? Disallow: /front/ Disallow: /install/ Disallow: /panel/ Disallow: /tmp/ Disallow: /updates/ User-agent: SeekportBot Disallow: / User-agent: Bytespider Disallow: / User-agent: PetalBot Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: Go-http-client Disallow: / User-agent: Apache-HttpClient Disallow: / User-agent: VelenPublicWebCrawler Disallow: / User-agent: dataprovider Disallow: / User-agent: serpstatbot Disallow: / User-agent: GeedoBot Disallow: / User-agent: claudebot Disallow: /