Thank you guys. Now I have written my custom sink of using Esper in Flume.
On Tue, Jun 4, 2013 at 2:49 PM, Jintao Guan <[email protected]> wrote: > Hi Shekhar, > > Thank you for your email. The first solution is what I am looking for. > I really want to know the details of the custom sink. > > 1. The first thing I want to know is that how to install the custom sink ? > Compile it then put the ***.jar into $FLOME_HOME/lib ? > 2. Is there any material about how to write custom sink ? > > Thank you. > > > On Tue, Jun 4, 2013 at 2:41 PM, Shekhar Sharma <[email protected]>wrote: > >> You have two options : >> >> (1) You can write a custom flume sink for esper..Disadvantage would be >> you cant change the esper queries at run time >> >> (2) YOu can write esper service (Rest API) and the flume sink will send >> the java pojo to Esper service..The advantage is that you will have the >> ability to change the queries at run time.. >> >> I have tried both the approaches..let me know if you would like to know >> more... >> The first approach is very simple, just need to extend the sink from >> flume Abstract sink and override the process method.. >> In the constructor of the flume you need to initialze the esper engine, >> as well as esper statements and esper queries.. >> Make sure your listeners are attached as well when constructing the >> object.. >> While you receive the events in the process method, you need to convert >> the Flume SimpleEvent to POJO and call EsperEngine's sendevent() method... >> >> For the second method you can have your queries,listeners and statements >> defined in XML file and you parse them when the service starts and have a >> thread that looks for the change of this xml file.. >> >> Hope that helps. >> Regards, >> Som Shekhar Sharma >> +91-8197243810 >> >> >> On Tue, Jun 4, 2013 at 11:36 PM, Jintao Guan <[email protected]>wrote: >> >>> Hello guys, >>> >>> I want to use Esper in Flume Agents, so that I can monitor all of the >>> messages and logs and trigger alerts when there are Error logs. >>> >>> Does it seem like a plugin ? How do I install the custom interceptor ? >>> >>> Does anyone have any idea ? >>> >> >> >
