Buffer stats when Back Pressure is high

2019-01-06 Thread Gagan Agrawal
Hi, I want to understand does any of buffer stats help in debugging / validating that downstream operator is performing slow when Back Pressure is high? Say I have A -> B operators and A shows High Back Pressure which indicates something wrong or not performing well on B side which is slowing down

Re: Using port ranges to connect with the Flink Client

2019-01-06 Thread Joshua Fan
Hi Chesnay Yes, RestClusterClient is used in our company when using flink 1.7. It can do almost everything except to get the ClusterOverview when I want to get summary information on a session cluster. Finally, I manually trigger a http get request to the cluster to do that. If RestClusterClient

Re: The way to write a UDF with generic type

2019-01-06 Thread yinhua.dai
Hi Timo, But getResultType should only return a concrete type information, right? How could I implement with a generic type? I'd like to clarify my questions again. Say I want to implement my own "MAX" function, but I want to apply it to different types, e.g. integer, long, double etc, so I

Re: using updating shared data

2019-01-06 Thread Elias Levy
That is not fully correct. While in practice it may not matter, ignoring the timestamp of control messages may result in non-deterministic behavior, as during a restart the control message may be processed in a different order in relation to the other stream. So the output of multiple runs may

Re: using updating shared data

2019-01-06 Thread Avi Levi
Sounds like a good idea. because in the control stream the time doesn't really matters. Thanks !!! On Fri, Jan 4, 2019 at 11:13 AM David Anderson wrote: > Another solution to the watermarking issue is to write an > AssignerWithPeriodicWatermarks for the control stream that always returns >