Michael Wechner wrote:
HiIt seems to me that Nutch does not send a HTTP Accept Header. Is that on purpose?I would have expected that Nutch tells the server which mime-types it accepts resp. is able to parse and index,but maybe I misunderstand something.
This sound like a good addition to me. Can you submit a patch? -- Sami Siren