Hi Shani
Tracking the seed URL which led to a given page is easy : you can add a
custom metadata to the seeds being the seed URL itself e.g.
*http://www.guardian.co.uk <http://www.guardian.co.uk>
seed=http://www.guardian.co.uk <http://www.guardian.co.uk>*
then specify 'seed' as a value for the config urlmeta.tags and configure it
for indexing. Look at the urlmeta plugin for that.
A slightly more elegant way of doing the same is to have a custom
scoringFilter
*final Text seedK = new Text("seed");// add seed metadata which is then
transfered to the outlinkspublic void injectedScore(Text url, CrawlDatum
datum)throws ScoringFilterException {datum.getMetaData().put(seedK, new
Text(url)); }*
which would create the custom metadata during the injection.
Tracking the immediate parent could also be done with a ScoringFilter,
probably in the method distributeScoreToOutlinks.
HTH
Julien
On 2 July 2015 at 09:01, Chaushu, Shani <[email protected]> wrote:
> Hi,
> I'm using Nutch 1.9 with Solr 4.10
> There is any way so see in solr for each page the parent/root page they
> came from?
>
> Thanks,
> Shani
>
> ---------------------------------------------------------------------
> Intel Electronics Ltd.
>
> This e-mail and any attachments may contain confidential material for
> the sole use of the intended recipient(s). Any review or distribution
> by others is strictly prohibited. If you are not the intended
> recipient, please contact the sender and delete all copies.
>
--
Open Source Solutions for Text Engineering
http://digitalpebble.blogspot.com/
http://www.digitalpebble.com
http://twitter.com/digitalpebble
