added support for configuring request headers.
[utils] / crawler / basic / test /
2006-03-16 Erik Brakkee(no commit message)