Jark Wu created FLINK-18118:
-------------------------------
Summary: Some SQL Jobs with two input operators are loosing data
with unaligned checkpoints
Key: FLINK-18118
URL: https://issues.apache.org/jira/browse/FLINK-18118
Project: Flink
Issue Type: Bug
Components: Runtime / Checkpointing, Table SQL / Runtime
Affects Versions: 1.11.0
Reporter: Jark Wu
Fix For: 1.11.0
After trying to enable unaligned checkpoints by default, a lot of Blink
streaming SQL/Table API tests containing joins or set operations are throwing
errors that are indicating we are loosing some data (full records, without
deserialisation errors). Example errors:
{noformat}
[ERROR] Failures:
[ERROR] JoinITCase.testFullJoinWithEqualPk:775 expected:<List(1,1, 2,2, 3,3,
null,4, null,5)> but was:<List(2,2, 3,3, null,1, null,4, null,5)>
[ERROR] JoinITCase.testStreamJoinWithSameRecord:391 expected:<List(1,1,1,1,
1,1,1,1, 2,2,2,2, 2,2,2,2, 3,3,3,3, 3,3,3,3, 4,4,4,4, 4,4,4,4, 5,5,5,5,
5,5,5,5)> but was:<List()>
[ERROR] SemiAntiJoinStreamITCase.testAntiJoin:352 expected:<0> but was:<1>
[ERROR] SetOperatorsITCase.testIntersect:55 expected:<MutableList(1,1,Hi,
2,2,Hello, 3,2,Hello world)> but was:<List()>
[ERROR] JoinITCase.testJoinPushThroughJoin:1272 expected:<List(1,0,Hi,
2,1,Hello, 2,1,Hello world)> but was:<List(2,1,Hello, 2,1,Hello world)>
{noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
