MAX_WATERMARK is emitted by ContinuousFileReaderOperator and StreamSource
when they close.
I think you'll find this just works without your having to do anything to
make it happen.
David
On Tue, Jul 28, 2020 at 8:07 AM Piotr Nowojski wrote:
> MAX_WATERMARK should be emitted automatically by
MAX_WATERMARK should be emitted automatically by the
WatermarkAssignerOperator.
Piotrek
pon., 27 lip 2020 o 09:16 Flavio Pompermaier
napisał(a):
> Yes it could..where should I emit the MAX_WATERMARK and how do I detect
> that the input reached its end?
>
> On Sat, Jul 25, 2020 at 8:08 PM David
Yes it could..where should I emit the MAX_WATERMARK and how do I detect
that the input reached its end?
On Sat, Jul 25, 2020 at 8:08 PM David Anderson
wrote:
> In this use case, couldn't the custom trigger register an event time timer
> for MAX_WATERMARK, which would be triggered when the
In this use case, couldn't the custom trigger register an event time timer
for MAX_WATERMARK, which would be triggered when the bounded input reaches
its end?
David
On Mon, Jul 20, 2020 at 5:47 PM Piotr Nowojski wrote:
> Hi,
>
> I'm afraid that there is not out of the box way of doing this.
Hi,
I'm afraid that there is not out of the box way of doing this. I've created
a ticket [1] to write down and document a discussion that we had about this
issue in the past.
The issue is that currently, untriggered processing time timers are ignored
on end of input and it seems like there might
Hi to all,
I was trying to port another job we have that use dataset API to datastream.
The legacy program was doing basically a dataset.mapPartition().reduce() so
I tried to replicate this thing with a
final BasicTypeInfo columnType = BasicTypeInfo.DOUBLE_TYPE_INFO;
final DataStream input =
