User-agent: * Disallow: /admin Crawl-delay: 20 User-agent: Yandex Disallow: /admin Crawl-delay: 20