Re: What is the correct way to serialize a MapWritable to WebPage's metadata?

2014-01-23 Thread d_k
Hi Lewis, On Tue, Jan 21, 2014 at 9:03 PM, Lewis John Mcgibbney lewis.mcgibb...@gmail.com wrote: Hi d_k, On Tue, Jan 21, 2014 at 11:20 AM, dev-digest-h...@nutch.apache.orgwrote: I'm working on porting NUTCH-1622 to Nutch 2 Excellent and the path I took was to add a MapWritable field

Re: What is the correct way to serialize a MapWritable to WebPage's metadata?

2014-01-23 Thread Lewis John Mcgibbney
Hi d_k, On Thu, Jan 23, 2014 at 11:06 AM, dev-digest-h...@nutch.apache.org wrote: I attached the patch. If you think its ready I can add it to JIRA. Yes please open an issue and we can take the conversation there. dev@ is quite busy these days and some mail gets lost in the digest emails I

Re: What is the correct way to serialize a MapWritable to WebPage's metadata?

2014-01-21 Thread Lewis John Mcgibbney
Hi d_k, On Tue, Jan 21, 2014 at 11:20 AM, dev-digest-h...@nutch.apache.org wrote: I'm working on porting NUTCH-1622 to Nutch 2 Excellent and the path I took was to add a MapWritable field to the Outlink class to hold the metadata. So identical to approach implemented by Julien in

What is the correct way to serialize a MapWritable to WebPage's metadata?

2014-01-20 Thread d_k
I'm working on porting NUTCH-1622 to Nutch 2 and the path I took was to add a MapWritable field to the Outlink class to hold the metadata. In order to store the metadata in the WebPage so it will be passed along the mappers and reducers I used the metadata field of the WebPage class. Because the