User-agent: AhrefsBot
Disallow: /

User-agent: linkdexbot
Disallow: /

User-agent: bingbot
Crawl-Delay: 10

User-agent: Googlebot
Crawl-Delay: 10

User-agent: CCBot
Crawl-Delay: 120

User-agent: PiplBot
Crawl-Delay: 120

User-agent: dotbot
Crawl-delay: 30

User-agent: BLP_bbot
Crawl-delay: 30

User-agent: sogou spider
Crawl-delay: 120

User-agent: FemtosearchBot
Crawl-delay: 120

User-agent: SemrushBot
Crawl-delay: 120

Sitemap: https://www.clearygottlieb.com/sitemap.xml