Re: Flink: How to handle external app configuration changes in flink

2016-09-26 Thread Govindarajan Srinivasaraghavan
Hi Jamie, Thanks a lot for the response. Appreciate your help. Regards, Govind On Mon, Sep 26, 2016 at 3:26 AM, Jamie Grier wrote: > Hi Govindarajan, > > Typically the way people do this is to create a stream of configuration > changes and consume this like any other

Re: Flink: How to handle external app configuration changes in flink

2016-09-26 Thread Jamie Grier
Hi Govindarajan, Typically the way people do this is to create a stream of configuration changes and consume this like any other stream. For the specific case of filtering for example you may have a data stream and a stream of filters that you want to run the data through. The typically

Flink: How to handle external app configuration changes in flink

2016-09-25 Thread Govindarajan Srinivasaraghavan
Hi, My requirement is to stream millions of records in a day and it has huge dependency on external configuration parameters. For example, a user can go and change the required setting anytime in the web application and after the change is made, the streaming has to happen with the new