From: Art Cancro <ajc@citadel.org>
Date: Wed, 15 Sep 2010 02:34:59 +0000 (-0400)
Subject: Revert "Return 404 for robots.txt"
X-Git-Tag: v8.01~712^2~5
X-Git-Url: https://code.citadel.org/?p=citadel.git;a=commitdiff_plain;h=45ba5fe490f4221ea01b6ff8b3e97258bb9e0502

Revert "Return 404 for robots.txt"

This reverts commit 7632402d82d9d7f7a4c20c1a3f5c0a3ea13c38b0.
---

diff --git a/webcit/context_loop.c b/webcit/context_loop.c
index 1f140184c..266b2f4c7 100644
--- a/webcit/context_loop.c
+++ b/webcit/context_loop.c
@@ -805,7 +805,6 @@ InitModule_CONTEXT
 	RegisterNamespace("NONCE", 0, 0, tmplput_nonce, NULL, 0);
 
 	WebcitAddUrlHandler(HKEY("404"), "", 0, do_404, ANONYMOUS|COOKIEUNNEEDED);
-	WebcitAddUrlHandler(HKEY("robots.txt"), "", 0, do_404, ANONYMOUS|COOKIEUNNEEDED);
 /*
  * Look for commonly-found probes of malware such as worms, viruses, trojans, and Microsoft Office.
  * Short-circuit these requests so we don't have to send them through the full processing loop.