Vinsil wrote: > Hi Andrzej, > > Thanks *a lot* for your prompt answer. > > >> You can use ScoringFilter.distributeScoreToOutlink to also modify the >> > target CrawlDatum, e.g. store some metadata. > > It sounds like a really nice solution but it seems like I cannot access the > surrounding page textual content (and ideally the associated DOM tree) > inside ScoringFilter.distributeScoreToOutlink, only its parsedata... > I would need that information to be able to compute the "relevance score" > for the outlinks. But maybe am i missing the point here? >
You are correct, DOM tree is not available through this API. You can use a workaround: prepare necessary metadata in a HtmlParseFilter, which has access to the full DOM tree, and put it into ParseData.metadata. -- Best regards, Andrzej Bialecki <>< ___. ___ ___ ___ _ _ __________________________________ [__ || __|__/|__||\/| Information Retrieval, Semantic Web ___|||__|| \| || | Embedded Unix, System Integration http://www.sigram.com Contact: info at sigram dot com ------------------------------------------------------------------------- Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 _______________________________________________ Nutch-general mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nutch-general
