How can I add the referrer to the outlinks? Can I do it on schema or something? Or I have to hack crawling code too like you wrote about protocol plugin?
Markus Jelsma-2 wrote > > What you can try is to add the referrer to outlinks when parsing records. > This outlink can be added to CrawlDatum's MetaData which you can then > later use to set the referrer. To set the referrer you must hack your > protocol plugin to add the heder. > -- View this message in context: http://lucene.472066.n3.nabble.com/HTTP-REFERER-is-missing-tp3987967p3991147.html Sent from the Nutch - User mailing list archive at Nabble.com.
