Hi Vicky, I have already written a plugin to send fetcher events to Kafka. You can have a look here - https://github.com/sujen1412/nutch/tree/kafka
I have to clean it up and push it upstream to Nutch. It would be great to get your inputs on the plugin. Thank you! Regards, Sujen Shah Data Scientist NASA Jet Propulsion Laboratory http://www.linkedin.com/in/sujenshah On Wed, Jan 4, 2017 at 9:29 AM, Furkan KAMACI <[email protected]> wrote: > Hi Vicky, > > Could you check this issue: https://issues.apache.org/ > jira/browse/NUTCH-2132 > > Kind Regards, > Furkan KAMACI > > On Wed, Jan 4, 2017 at 7:26 PM, vickyk <[email protected]> wrote: > > > We got a requirement to have the crawling pushing the data to the Kafka. > I > > have looked at the > > https://wiki.apache.org/nutch/AboutPlugins > > > > I am planning to write a custom plugin of type Parser to push messages > into > > the Kafka. Will this the appropriate core extension point to extend? > > > > PS: I have spend substantial time in searching about it however I did not > > find any related useful information. > > > > Thanks, > > Vicky > > > > > > > > > > -- > > View this message in context: http://lucene.472066.n3. > > nabble.com/Crawling-to-send-data-to-Kafka-tp4312320.html > > Sent from the Nutch - User mailing list archive at Nabble.com. > > >
