How to create User Notifications/Reminder ?

2018-07-11 Thread shyla deshpande
I need to create User Notification/Reminder when I don’t see a specific event (high volume) from that user for more than 2 weeks. Should I be using windowing or CEP or ProcessFunction? I am pretty new to Flink. Can anyone please advise me what is the best way to solve this? Thank you for your t

Re: How to create User Notifications/Reminder ?

2018-07-11 Thread shyla deshpande
uestion[1] asked two days ago. Maybe it is helpful for > you. Let me know if you have any other concern. > Best, Hequn > > [1] http://apache-flink-user-mailing-list-archive.2336050. > n4.nabble.com/How-to-trigger-a-function-on-the-state- > periodically-td21311.html > > On Th

Re: How to create User Notifications/Reminder ?

2018-07-12 Thread shyla deshpande
want to process data > beyond 2 weeks. > I'm not familiar with CEP, but it sounds like a good idea. > > Best, Hequn > > > On Thu, Jul 12, 2018 at 10:56 AM, shyla deshpande < > deshpandesh...@gmail.com> wrote: > >> Hi Hequen, >> >> I was more i

Event Time Session Window does not trigger..

2018-08-04 Thread shyla deshpande
Hi, I used PopularPlacesFromKafka from dataartisans.flinktraining.exercises as the basis. I made very minor changes and the session window is not triggered. If I use ProcessingTime instead of EventTime it works. Here is my code. Appreciate any help. Thanks object KafkaEventTimeWindow { priva

Re: Event Time Session Window does not trigger..

2018-08-05 Thread shyla deshpande
>> >> [1] https://stackoverflow.com/questions/51691269/event-time- >> window-in-flink-does-not-trigger >> >> On Sun, Aug 5, 2018 at 11:24 AM, shyla deshpande < >> deshpandesh...@gmail.com> wrote: >> >>> Hi, >>> >>&

Re: Event Time Session Window does not trigger..

2018-08-06 Thread shyla deshpande
ate from this >> environment. So if your application contains multi environments, then yes. >> >> Best, Hequn >> >> On Mon, Aug 6, 2018 at 9:37 AM, shyla deshpande > > wrote: >> >>> Hi Hequn, >>> >>> I now realize that in Pr

docker, error NoResourceAvailableException..

2018-08-14 Thread shyla deshpande
Hello all, Trying to use docker as a single node flink cluster. docker run --name flink_local -p 8081:8081 -t flink local I submited a job to the cluster using the Web UI. The job failed. I see this error message in the docker logs. org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvaila

Re: docker, error NoResourceAvailableException..

2018-08-15 Thread shyla deshpande
g setting : > > *taskmanager.numberOfTaskSlots: *2 > > > This will give you 2 Task Slots with only 1 Task Manager. But you will > need to somehow override config in the container, possibly using : > https://docs.docker.com/storage/volumes/ > > Regards, > Dominik. >

When using Flink for CEP, can the data in Cassandra database be used for state

2017-11-08 Thread shyla deshpande
Hello all, I am new to Flink. We have our data in Cassandra database. We have a use case for CEP. I am checking out if Flink fits well for us. When processing the event data, I may want to pull data for the cassandra database like the user profile and join with the event data. Is there a way to