I am able to get parsetext data structure.
But having trouble with parseData as it's constructor is asking for
parsestatus, outlinks, contentmeta and parsemeta.
Outlinks I can get from outlinkExtractor but what about other parameters?
And again getoutlinks is asking for configuration and i don't know, from
where I can get it?

On 6 Mar 2018 18:32, "Yossi Tamari" <yossi.tam...@pipl.com> wrote:

> You should go over each segment, and for each one produce a ParseText and
> a ParseData. This is basically what the HTML Parser does for the whole
> document, which is why I suggested you should dive into its code.
> A ParseText is basically just a String containing the actual content of
> the segment (after stripping the HTML tags). This is usually the document
> you want to index.
> The ParseData structure is a little more complex, but the main things it
> contains are the title of this segment, and the outlinks from the segment
> (for further crawling). Take a look at the code of both classes and it
> should be relatively clear.
> Finally, you need to build one ParseResult object, with the original URL,
> and for each of the ParseText/ParseData pairs, call the put method, with
> the internal URL of the segment as the key.
> > -----Original Message-----
> > From: Yash Thenuan Thenuan <rit2014...@iiita.ac.in>
> > Sent: 06 March 2018 14:45
> > To: user@nutch.apache.org
> > Subject: RE: Regarding Internal Links
> >
> > > I am able to get the content corresponding to each Internal link by
> > > writing a parse filter plugin. Now  I am  not getting how to proceed
> > > further. How can I parse them as separate document and what should
> > > my ParseResult filter return??

Reply via email to