Lazy Instanciation of Metadata in CrawlDatum
--------------------------------------------
Key: NUTCH-702
URL: https://issues.apache.org/jira/browse/NUTCH-702
Project: Nutch
Issue Type: Improvement
Affects Versions: 1.0.0
Reporter: julien nioche
CrawlDatum systematically instanciates its metadata, which is quite wasteful
especially in the case of CrawlDBReducer when it generates a new CrawlDatum for
each incoming link before storing it in a List.
Initial testing on the lazy instanciation shows an improvement in both speed
and memory consumption. I will generate a patch for it ASAP
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
