X-Git-Url: http://wamblee.org/gitweb/?a=blobdiff_plain;ds=inline;f=crawler%2FABOUT.txt;fp=crawler%2FABOUT.txt;h=ba9a7ad34a5085706ab85eddea6fe7fef0ba6da3;hb=a568b8d4bf3e277c31a63656f23ce59516ce3732;hp=0000000000000000000000000000000000000000;hpb=d4bb47fd284738756cd112b788a49caa1a9d5c38;p=utils diff --git a/crawler/ABOUT.txt b/crawler/ABOUT.txt new file mode 100644 index 00000000..ba9a7ad3 --- /dev/null +++ b/crawler/ABOUT.txt @@ -0,0 +1,2 @@ +This directory contains a generic web crawler (basic directory) and several useful implementations build on top of this. +