Re: Response content length is not known

[Gal Nitzan]

Andrzej Bialecki wrote:

gekkokid wrote:

might have been a large file size, too much to download maybe

No. This comes from the httpclient library, when the response length is not known ;-) i.e. when it is not reported in the server response, as it should. This means that there is a danger that the response size may exceed available resources or limits.

What does Nutch do? does it save it/index it ?

Beside that message nutch doesn't seem to be complaining

Thanks,

Gal