User-agent: *
Allow: /


User-agent: Yandex
Allow /
Crawl-delay: 0.5


User-agent: twiceler
Crawl-delay: 5


User-Agent: MJ12bot
Crawl-delay: 5


User-agent: Slurp
Crawl-delay: 5