User-agent: * Crawl-delay: 1 Allow: /documentation/ Disallow: /stats/ Disallow: /limesurvey Disallow: /blog/ghost