User-agent: * #Allow: / # Directories Disallow: /files/lessons/ Disallow: /files/video/ Disallow: /files/video_symptoms_symptoms/ Disallow: /files/video_treatments_diseases/ Disallow: /files/video_symptoms_diseases/ Disallow: /files/php/ Disallow: /libs/ Disallow: /myadm/ Disallow: /admin/ Disallow: /user/ Disallow: /system/ Disallow: /e_learning/ Disallow: /post/Diavhths_b Disallow: /post/Sakxarwdh-Diavhths # Files Disallow: /files/syn2.flv Disallow: /efim.php Sitemap: http://www.eumedline.eu/files/sitemap.xml.gz # CRAWLER RULES - please follow them; enforcement is automatic. # 1. Crawlers may use at most 5 simultaneous connections per server, all together. # Any extra connection is refused immediately. # 2. A crawler that keeps overloading a server is blocked temporarily. # Slow down and try again later. # 3. Opening too many simultaneous connections is blocked. # Requests to disallowed action URLs (add-to-cart, wishlist, login) are banned immediately. # CRAWLER RATE - a crawler that documents a Crawl-delay is asked to keep to it (seconds between requests). User-agent: serpstatbot Disallow: /files/lessons/ Disallow: /files/video/ Disallow: /files/video_symptoms_symptoms/ Disallow: /files/video_treatments_diseases/ Disallow: /files/video_symptoms_diseases/ Disallow: /files/php/ Disallow: /libs/ Disallow: /myadm/ Disallow: /admin/ Disallow: /user/ Disallow: /system/ Disallow: /e_learning/ Disallow: /post/Diavhths_b Disallow: /post/Sakxarwdh-Diavhths Disallow: /files/syn2.flv Disallow: /efim.php Crawl-delay: 20