Automatic Recording for KiSS Hard Disk Recorders

+ Changelog + +

+ 31 August 2006 +

Added windows bat file for running the crawler under windows. + Very add-hoc, will be generalized.

+ 24 August 2006 +

The crawler now uses desktop login for crawling. Also, it is much more efficient since + it no longer needs to crawl the individual programs. This is because the channel page + includes descriptions of programs in javascript popups which can be used by the crawler. + The result is a significant reduction of the load on the KiSS EPG site. Also, the delay + between requests has been increased to further reduce load on the KiSS EPG site.
+ The crawler now crawls programs for tomorrow instead of for today. +
+ The web based crawler is configured to run only between 7pm and 12pm. It used to run at + 5am. +

+ +

+ 13-20 August 2006 +

+ There were several changes to the login procedure, requiring modifications to the crawler. +

The crawler now uses the 'Referer' header field correctly at login.
KiSS now uses hidden form fields in their login process which are now also handled correctly by the + crawler.

Overview @@ -258,11 +302,17 @@ General usage

When the crawler runs, it - retrieves the programs for today. As a result, it is advisable + retrieves the programs for tomorrow. As a result, it is advisable to run the program at an early point of the day as a scheduled task (e.g. cron on unix). For the web application this is preconfigured at 5AM.

+ + If you deploy the web application today, it will run automatically + on the next (!) day. This even holds if you deploy the application + before the normal scheduled time. + +

Modifying the program to allow it to investigate tomorrow's programs instead is easy as well but not yet implemented.