From: erik Date: Thu, 24 Aug 2006 21:14:02 +0000 (+0000) Subject: (no commit message) X-Git-Tag: BEFORE_MAVEN_MIGRATION~6 X-Git-Url: http://wamblee.org/gitweb/?a=commitdiff_plain;h=839a58a6cb0305e522a4f01a5d9ef82ca1a855b9;p=utils --- diff --git a/crawler/kiss/conf/kiss/programs.xml b/crawler/kiss/conf/kiss/programs.xml index a07c4c57..538ce257 100644 --- a/crawler/kiss/conf/kiss/programs.xml +++ b/crawler/kiss/conf/kiss/programs.xml @@ -66,6 +66,7 @@ + 8 little britain diff --git a/crawler/kiss/docs/content/xdocs/index.xml b/crawler/kiss/docs/content/xdocs/index.xml index ec17243e..03ed9eee 100644 --- a/crawler/kiss/docs/content/xdocs/index.xml +++ b/crawler/kiss/docs/content/xdocs/index.xml @@ -27,6 +27,25 @@
Changelog + +
+ 24 August 2006 +
    +
  • The crawler now uses desktop login for crawling. Also, it is much more efficient since + it no longer needs to crawl the individual programs. This is because the channel page + includes descriptions of programs in javascript popups which can be used by the crawler. + The result is a significant reduction of the load on the KiSS EPG site. Also, the delay + between requests has been increased to further reduce load on the KiSS EPG site.
  • +
  • + The crawler now crawls programs for tomorrow instead of for today. +
  • +
  • + The web based crawler is configured to run only between 7pm and 12pm. It used to run at + 5am. +
  • +
+
+
13-20 August 2006

@@ -276,7 +295,7 @@ General usage

When the crawler runs, it - retrieves the programs for today. As a result, it is advisable + retrieves the programs for tomorrow. As a result, it is advisable to run the program at an early point of the day as a scheduled task (e.g. cron on unix). For the web application this is preconfigured at 5AM. @@ -284,7 +303,7 @@ If you deploy the web application today, it will run automatically on the next (!) day. This even holds if you deploy the application - before 5AM in the morning. + before the normal scheduled time.