User-agent: * Disallow: /ajax/ Disallow: /*/news/ Disallow: /forum/ Disallow: /thumb.php Disallow: /tourism/guide/bar-dubai-bastakiya/ Crawl-delay: 5 Host: www.onlinedubai.ru Sitemap: http://www.onlinedubai.ru/sitemapindex.xml User-agent: MSNbot Disallow: /