Roxen.git / server / modules / misc / robots.txt.pike

version» Context lines:

Roxen.git/server/modules/misc/robots.txt.pike:1:   // This is a roxen module. Copyright © 2000 - 2009, Roxen IS.      inherit "module";    - constant cvs_version = "$Id: robots.txt.pike,v 1.6 2009/05/07 14:15:55 mast Exp $"; + constant cvs_version = "$Id$";   constant thread_safe = 1;   constant module_type = MODULE_FIRST;   constant module_name = "robots.txt generator";   constant module_doc = "Generates a robots.txt on demand from various information. "    "If there is a robots.txt file in the server root its information will be included "    "in the final robots.txt file. Other information incorporated is location modules "    "that does not support directory listings and paths entered under the settings tab.";      // TODO:   // - Incorporate security information, e.g. paths requiring autharization should be in