Changes between Version 9 and Version 10 of DeveloperInformation


Ignore:
Timestamp:
Jan 29, 2007, 1:28:16 PM (18 years ago)
Author:
Jari Häkkinen
Comment:

Adding web indexing robot repellent.

Legend:

Unmodified
Added
Removed
Modified

  • DeveloperInformation

    v9 v10  
    2626
    2727For more information about developing plugins see [http://base.thep.lu.se/chrome/site/doc/development/index.html#plugins Development information - Plug-ins].
     28
     29== robots.txt ==
     30
     31The web page indexing robots are killing the web server since the robots index '''every''' revision of the source. There is a RobotsTxt file with information to well behaved robots. The contents of RobotsTxt is the same traditional robots.txt, and the [http://trac-hacks.org/wiki/RobotsTxtPlugin RobotsTxtPlugin] plug-in will serve a http://base.thep.lu.se/robots.txt to the robots.