is flink' states functionality futile?

2017-07-21 Thread ziv
Hi, After following all the instruction for how to manage a states with flink for non-keyed stream and after implementing all the required functions and defining all the variables (listState and the descriptor and so on), the program did actually worked well. But then I had to debug the program an

Re: is flink' states functionality futile?

2017-07-23 Thread ziv
Ok, Let me see if I understand you correctly. You actually state that flink' states functionality is introduced only to handle recovering from failures. Let's take the example given in 1.3 documentary - https://ci.apache.org/projects/flink/flink-docs-release-1.3/dev/stream/state.html

RE: is flink' states functionality futile?

2017-07-26 Thread ziv
Hi, what is the reference you wanted to link in [1]? From: Tzu-Li (Gordon) Tai [via Apache Flink Mailing List archive.] [mailto:ml+s1008284n18936...@n3.nabble.com] Sent: 26 July 2017 05:44 To: Meri Ziv Subject: Re: is flink' states functionality futile? <https://ci.apache.org/projec

Sync Flink

2017-08-28 Thread ziv
People, I have two sources: 1) DataStream int1 = env.addSource(new intWithDelat1()): generates series of integers in streaming of 1 sec delay between elemets. 2) DataStream long3 = env.addSource(new longWithDelay3()): generates series of longs in streaming of 3 sec delay. I want to:

RE: Sync Flink

2017-08-29 Thread ziv
.nabble.com] Sent: 28 August 2017 12:36 To: Meri Ziv Subject: Re: Sync Flink Hi, This is not possible out-of-box, but you could use a ProcessFunction (or rather CoProcessFunction) to buffer elements and set a timer so that you only emit when the watermarks advances on both inputs. Best, Aljoscha

update data from two sources with Flink

2017-09-10 Thread ziv
Hi, I have two sources that both contribute to build fields of objects. When building an object is completed I sink it out. Can anyone suggest the effective way for such a program with Flink? Ziv -- Sent from: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/

RE: is flink' states functionality futile?

2017-09-26 Thread ziv
then its value erased and I get null pointer exception. on the other hand, leave it without 'transient', it's a compilation error - implementation of function is not serializable. how you explain that? Best, Ziv. -- Sent from: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/

RE: is flink' states functionality futile?

2017-09-26 Thread Meri Ziv
sient, then its value erased and I get null pointer exception. on the other hand, leave it without 'transient', it's a compilation error - implementation of function is not serializable. how you explain that? Best, Ziv. From: Tzu-Li (Gordon) Tai [mailto:tzuli...@apache.org] Sent: 2

FW: is flink' states functionality futile?

2017-09-26 Thread Meri Ziv
() and StateValue and so on. Indeed I then used only simple data in my program then everything worked fine and it been seem to me as if all the state’ tools are useless. I think this should be explained better in the documentation. Ziv. From: Tzu-Li (Gordon) Tai [via Apache Flink Mailing List