Re: Watermarks not propagated to WebUI?

2019-10-20 Thread Thomas Weise
The issue persists with 1.9.1: https://issues.apache.org/jira/browse/FLINK-14470 On Mon, Aug 26, 2019 at 1:47 AM Jan Lukavský wrote: > Hi Robert, > > I'd very much love to, but because I run my pipeline with Beam, I'm > afraid I will have to wait a little longer, before Beam has runner for > 1

Re: Watermarks not propagated to WebUI?

2019-08-26 Thread Jan Lukavský
Hi Robert, I'd very much love to, but because I run my pipeline with Beam, I'm afraid I will have to wait a little longer, before Beam has runner for 1.9 [1]. I'm pretty sure that the watermarks disappeared with overall parallelism (over all operators) something above 2000. There was quite a

Re: Watermarks not propagated to WebUI?

2019-08-26 Thread Robert Metzger
Jan, will you be able to test this issue on the now-released Flink 1.9 with the new UI? What parallelism is needed to reproduce the issue? On Thu, Aug 15, 2019 at 1:59 PM Chesnay Schepler wrote: > I remember an issue regarding the watermark fetch request from the WebUI > exceeding some HTTP si

Re: Watermarks not propagated to WebUI?

2019-08-15 Thread Chesnay Schepler
I remember an issue regarding the watermark fetch request from the WebUI exceeding some HTTP size limit, since it tries to fetch all watermarks at once, and the format of this request isn't exactly efficient. Querying metrics for individual operators still works since the request is small enou

Re: Watermarks not propagated to WebUI?

2019-08-15 Thread Jan Lukavský
Hi, Thomas, thanks for confirming this. I have noticed, that in 1.9 the WebUI has been reworked a lot, does anyone know if this is still an issue? I currently cannot easily try 1.9, so I cannot confirm or disprove that. Jan On 8/14/19 6:25 PM, Thomas Weise wrote: I have also noticed this i

Re: Watermarks not propagated to WebUI?

2019-08-14 Thread Thomas Weise
I have also noticed this issue (Flink 1.5, Flink 1.8), and it appears with higher parallelism. This can be confusing to the user when watermarks actually work and can be observed using the metrics. On Wed, Aug 14, 2019 at 7:36 AM Jan Lukavský wrote: > Hi, > > is it possible, that watermarks are