From: Wolfram Schneider <wosch@indexdata.dk>
Date: Fri, 27 Jan 2012 11:58:48 +0000 (+0000)
Subject: block bot rogerbot for all URLs
X-Git-Url: http://git.indexdata.com/?p=irspy-moved-to-github.git;a=commitdiff_plain;h=59d43c7b86db6977d5e5f4e5507696ed98948e24;ds=sidebyside

block bot rogerbot for all URLs
---

diff --git a/web/htdocs/robots.txt b/web/htdocs/robots.txt
index fed2b3a..a0fdc6c 100644
--- a/web/htdocs/robots.txt
+++ b/web/htdocs/robots.txt
@@ -10,3 +10,6 @@ Disallow: /raw.html
 Disallow: /stats.html
 Disallow: /upload.html
 
+User-agent: rogerbot
+Disallow: /
+