David Anderson created FLINK-19109:
--------------------------------------

             Summary: Split Reader eats chained periodic watermarks
                 Key: FLINK-19109
                 URL: https://issues.apache.org/jira/browse/FLINK-19109
             Project: Flink
          Issue Type: Bug
    Affects Versions: 1.11.1, 1.10.2, 1.11.0, 1.10.1, 1.10.0
            Reporter: David Anderson


Attempting to generate watermarks chained to the Split Reader / 
ContinuousFileReaderOperator, as in


{{        SingleOutputStreamOperator<Event> results = env
                .readTextFile(...)
                .map(...)
                .assignTimestampsAndWatermarks(bounded)
                .keyBy(...)
                .process(...);
}}

leads to the Watermarks failing to be produced. Breaking the chain, via 
{{disableOperatorChaining()}} or a {{rebalance}}, works around the bug. Using 
punctuated watermarks also avoids the issue.

Looking at this in the debugger reveals that timer service is being prematurely 
quiesced.

In many respects this is FLINK-7666 brought back to life.

The problem is not present in 1.9.3.

There's a minimal reproducible example in 
https://github.com/alpinegizmo/flink-question-001/tree/bug.






--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to