#stop crawling for async endpoints
User-agent:*
Disallow: /cdn/
Disallow: /ui/
Disallow: /hook/