This should be implemented in IndexerMapReduce. I haven't committed the patch yet that skips documents.
-----Original message----- > From:Lewis John Mcgibbney <[email protected]> > Sent: Tue 15-Jan-2013 19:23 > To: [email protected] > Subject: Re: pass null NutchDocument BasicIndexingFilter > > Hi, > > Although this is a trivial patch, if you could open a Jira issue so we can > track it this would be excellent. > Please also describe where you would like to add this to the code. > If you could submit a patch that would be excellent. > Thank you > Lewis > > On Mon, Jan 14, 2013 at 10:54 PM, feng lu <[email protected] > <mailto:[email protected]> > wrote: > Hi All > > In BasicIndexingFilter.java , it has not check the null of NutchDocument, > Shoud we add such code in the filter method in BasicIndexingFilter. > > // just in case > if (doc == null) > return doc; > > thanks all > > -- > Don't Grow Old, Grow Up... :-) > > > > -- > Lewis >
