Vinsil wrote:
Hi Andrzej,
Thanks *a lot* for your prompt answer.
You can use ScoringFilter.distributeScoreToOutlink to also modify the
target CrawlDatum, e.g. store some metadata.
It sounds like a really nice solution but it seems like I cannot access the
surrounding page textual content (and ideally the associated DOM tree)
inside ScoringFilter.distributeScoreToOutlink, only its parsedata...
I would need that information to be able to compute the "relevance score"
for the outlinks. But maybe am i missing the point here?
You are correct, DOM tree is not available through this API. You can use
a workaround: prepare necessary metadata in a HtmlParseFilter, which has
access to the full DOM tree, and put it into ParseData.metadata.
--
Best regards,
Andrzej Bialecki <><
___. ___ ___ ___ _ _ __________________________________
[__ || __|__/|__||\/| Information Retrieval, Semantic Web
___|||__|| \| || | Embedded Unix, System Integration
http://www.sigram.com Contact: info at sigram dot com
