From: Art Cancro <ajc@citadel.org>
Date: Tue, 22 Mar 2011 19:56:36 +0000 (-0400)
Subject: Added a few more Disallow: lines to robots.txt
X-Git-Tag: v8.11~804
X-Git-Url: https://code.citadel.org/?p=citadel.git;a=commitdiff_plain;h=d30d950660748da8a7c2d7e1a9dfba978d7c05ba

Added a few more Disallow: lines to robots.txt
---

diff --git a/webcit/static.c b/webcit/static.c
index 1113fd1d5..754cb5f0a 100644
--- a/webcit/static.c
+++ b/webcit/static.c
@@ -286,6 +286,9 @@ void robots_txt(void) {
 		"Disallow: /groupdav\r\n"
 		"Disallow: /do_template\r\n"
 		"Disallow: /static\r\n"
+		"Disallow: /display_page\r\n"
+		"Disallow: /readnew\r\n"
+		"Disallow: /display_enter\r\n"
 		"Sitemap: %s/sitemap.xml\r\n"
 		"\r\n"
 		,