Re: Experiencing long latency while using sockets

One pointer is the StreamExecutionEnvironment.setBufferTimeout() parameter. Flink's network stack collects records in buffers to send them over the network. A buffer is sent when it is completely filled or after a configurable timeout. So if your program does not process many records, these records

Re: Flink REST API async?

Aha ok… Thanks for your answer Eron. Regards On 7 Aug 2017, at 19:04, Eron Wright mailto:eronwri...@gmail.com>> wrote: When you submit a program via the REST API, the main method executes inside the JobManager process.Unfortunately a static variable is used to establish the execution env

Re: Flink REST API async?

I quickly talked to Till about this. The new JobManager, once FLIP-6 is implemented, will have a new REST endpoint that allows submitting a JobGraph directly. With this, we no longer have to execute the user main() method in the WebRuntimeMonitor (which is a component that the current JobManager

Re: a lot of connections in state "CLOSE_WAIT"

FLINK-7368 may be the reason for this behavior. On 31.07.2017 03:54, XiangWei Huang wrote: 1. yes and yes. 2. Yes,it was shown correctly. 3.I wasn’t modify this setting. 在 2017年7月26日，18:06，Chesnay Schepler [via Apache Flink User Mailing List archive.] <[hidden email] > 写道： So this/only/happ

Re: WaterMark & Eventwindow not fired correctly

Hi, So I understood that you have roughly this pipeline: Input 1 --\ |- CoFlatMap - TimestampAndWatermarkAssigner - KeyBy - Window Input 2 --/ If the timestamp assigner is after the CoFlatMap the processInput() method of the extractor should still be called. Not by the StreamInpu

Re: Event-time and first watermark

I see. But yes, even in the case the watermark will always be "one behind". The logic in the extraction operator is roughly this: 1. Extract timestamp T, assign to internal StreamRecord 2. Send StreamRecord downstream 3. Extract Watermark W 4. Send Watermark downstream (In your case T == W)

Flink CEP issues

Hi guys, We are using flink cep to detect pattern. Here is the exception we got: org.apache.flink.streaming.api.operators.InternalTimeServiceManager. advanceWatermark(InternalTimeServiceManager.java:107) at org.apache.flink.streaming.api.operators.AbstractStreamOperator. processWatermark(Abstract

Writing on Cassandra

Hi, I'm trying to integrate a Cassandra sink in my project but honestly I'm a bit confused because I don't find any examples of use. I want just to populate a table and query it on a single node instance of Cassandra. The only one link I found is: https://ci.apache.org/projects/flink/flink-docs-

Re: Writing on Cassandra

I probably solved import issue, but still need help to find some examples of use. Please let me know if someone has experience with Flink and Cassandra together -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Writing-on-Cassandra-tp14744p1474

Re: Flink CEP issues

Hi Daiqing, Is it possible to share your job in order to reproduce the problem? Or at least a minimal example. If you see from the JIRA, there is another user in https://issues.apache.org/jira/browse/FLINK-6321 who had a similar problem but we

Advice on debugging state back end...

Hi Folks, I have a stream application which is running out of heap space - looks like there might be something up with state storage I'm having trouble determining if it just needs a lot of memory or there is a memory leak. Are there any tips/best practice for this? I've looked at heap du

Re: a lot of connections in state "CLOSE_WAIT"

It seems so,thanks for your reply Chesnay. > 在 2017年8月8日，22:23，Chesnay Schepler [via Apache Flink User Mailing List > archive.] 写道： > > FLINK-7368 may be the reason for this behavior. > > On 31.07.2017 03:54, XiangWei Huang wrote: >> 1. yes and yes. >> 2. Yes,it was shown correctly. >>

Task slot data

Hi, I have a complex algorithm running on a flatmap operator and it requires cache and metrics instances to be passed to various classes. Since the task slots run on the same JVM, I'm not sure if I will be able to use static members or singleton classes. Can I use ThreadLocal variables to isolate