Julien Nioche-4 wrote > >> > >> > Nutch cannot do this by default and is tricky to make because there may >> > not be one unique referrer per page. >> > >> I don't realy need unique referrer. All I want is to inform requested >> server >> on which URL crawler found the link. >> > > You can write a custom scoringfilter to track the URL of the source, see > the one in urlmeta for an example. It should be fairly straightforward to > do > I'm not usind nutch index. Crawler is sending data to Solr.
-- View this message in context: http://lucene.472066.n3.nabble.com/HTTP-REFERER-is-missing-tp3987967p3990696.html Sent from the Nutch - User mailing list archive at Nabble.com.
