See Julien's comments on implementing a custom scoring filter.
-----Original message----- > From:SebaZ <[email protected]> > Sent: Mon 25-Jun-2012 11:29 > To: [email protected] > Subject: RE: HTTP REFERER is missing > > How can I add the referrer to the outlinks? Can I do it on schema or > something? Or I have to hack crawling code too like you wrote about protocol > plugin? > > > Markus Jelsma-2 wrote > > > > What you can try is to add the referrer to outlinks when parsing records. > > This outlink can be added to CrawlDatum's MetaData which you can then > > later use to set the referrer. To set the referrer you must hack your > > protocol plugin to add the heder. > > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/HTTP-REFERER-is-missing-tp3987967p3991147.html > Sent from the Nutch - User mailing list archive at Nabble.com. >
