X-Git-Url: http://git.indexdata.com/?p=irspy-moved-to-github.git;a=blobdiff_plain;f=web%2Fhtdocs%2Frobots.txt;h=fed2b3aa0b0eef4ff958c0a4dd54ea9d585e804e;hp=6299a1f489f3e01c61a5010583534a092448040f;hb=eaf6ff0997e5623feb58b621bafb38eca58b5160;hpb=3451995efd44aa1f5591f53c8ac6d17dba2b093b diff --git a/web/htdocs/robots.txt b/web/htdocs/robots.txt index 6299a1f..fed2b3a 100644 --- a/web/htdocs/robots.txt +++ b/web/htdocs/robots.txt @@ -1,7 +1,12 @@ User-agent: * -Disallow: /full.html -Disallow: /all.html +Disallow: /admin/ Disallow: /add.html +Disallow: /add_target.html +Disallow: /all.html +Disallow: /doc.html +Disallow: /find.html +Disallow: /full.html +Disallow: /raw.html +Disallow: /stats.html Disallow: /upload.html -Disallow: /admin/