Hi Roannel,
I am not using, and was not even aware of Nutch's ability to emit events. I
just read https://issues.apache.org/jira/browse/NUTCH-2132?attachmentOrder=desc
where they basically had the same discussion.
If the general capability already exists, it seems like a good idea to add more
functionality to it. I also agree with Sebastian's comments there: the default
behaviour should not change, and there shouldn't be a performance cost,
especially to those not using this feature (which in this case should be easy,
it's just on step begin/end).
BTW, from an architectural point of view, I see these, and the ones in the
original ticket, as Logging Events, not Integration Events, and as such I think
the approach should have been to use structured log messages instead of
RabbitMQ. I'm not sure how much support log4j has for structured log messages,
but I know that newer log libraries have good support for sending the same
message as text to a normal log and as a structured message to another appender.
Yossi.
> -----Original Message-----
> From: Roannel Fernández Hernández <roan...@uci.cu>
> Sent: 05 July 2018 04:05
> To: user@nutch.apache.org
> Subject: Re: [MASSMAIL]RE: Events out-of-the-box
>
> Hi Yossi
>
> Thanks for your answer. I've been testing your idea of the appender, but I
> think
> is too hard get the counters from the context by this via. I truly believe
> Nutch
> should provide some mainly events out-of-the-box using the included publisher
> component. Do you agree with me?
>
> Regards
>
> ----- Mensaje original -----
> > De: "Yossi Tamari" <yossi.tam...@pipl.com>
> > Para: user@nutch.apache.org
> > Enviados: Viernes, 29 de Junio 2018 2:09:52
> > Asunto: [MASSMAIL]RE: Events out-of-the-box
> >
> > This is not something I actually did, but you should be able to
> > achieve this by adding a log4j appender for RabbitMQ (such as
> > https://github.com/plant42/rabbitmq-log4j-appender), and configuring
> > the relevant loggers and filters to send only the logging events you
> > need to that appender.
> > BTW, if you just want "fetching started/fetching ended" style
> > messages, you can simply add it to the crawl script, no need to touch the
> > Java
> code.
> >
> > > -----Original Message-----
> > > From: Roannel Fernández Hernández <roan...@uci.cu>
> > > Sent: 29 June 2018 06:24
> > > To: user@nutch.apache.org
> > > Subject: Events out-of-the-box
> > >
> > >
> > >
> > > Hi folks,
> > >
> > >
> > >
> > >
> > > I'm using Nutch 1.14 and I have to send notifications to a RabbitMQ
> > > queue when a every step starts and ends. So, my question is: Do I
> > > have to change the code to achieve this or is there an easier way?
> > > How can I do this?
> > >
> > >
> > >
> > >
> > > If code should be changed I think is a good idea provide
> > > out-of-the-box events for each step. We can even pass the counters
> > > from the context to each event. I don't know, it's just an idea.
> > >
> > >
> > >
> > >
> > > What do you think guys?
> > >
> > >
> > >
> > >
> > > Regards
> > >
> > > UCIENCIA 2018: III Conferencia Científica Internacional de la
> > > Universidad de las Ciencias Informáticas.
> > > Del 24-26 de septiembre, 2018 http://uciencia.uci.cu
> > > http://eventos.uci.cu
> >
> >
> UCIENCIA 2018: III Conferencia Científica Internacional de la Universidad de
> las
> Ciencias Informáticas.
> Del 24-26 de septiembre, 2018 http://uciencia.uci.cu http://eventos.uci.cu
