[
https://issues.apache.org/jira/browse/FLINK-30828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17682176#comment-17682176
]
Zhu Zhu commented on FLINK-30828:
---------------------------------
I can re-produce this problem locally.
This problem started to appear after FLINK-30683 which changed the SQL test to
test against {{BatchShuffleMode.ALL_EXCHANGES_BLOCKING}}
instead of {{BatchShuffleMode.ALL_EXCHANGES_PIPELINED}}.
By changing it back to test against
{{BatchShuffleMode.ALL_EXCHANGES_PIPELINED}}, the problem is gone. So seems the
case is unstable with blocking shuffle.
I will change the case to run with {{BatchShuffleMode.ALL_EXCHANGES_PIPELINED}}
first to unblock CI.
cc [~godfreyhe] [~lzljs3620320]
> SortAggITCase.testLeadLag failed
> --------------------------------
>
> Key: FLINK-30828
> URL: https://issues.apache.org/jira/browse/FLINK-30828
> Project: Flink
> Issue Type: Bug
> Components: Table SQL / Planner
> Affects Versions: 1.17.0
> Reporter: Matthias Pohl
> Priority: Critical
> Labels: test-stability
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=45389&view=logs&j=0c940707-2659-5648-cbe6-a1ad63045f0a&t=075c2716-8010-5565-fe08-3c4bb45824a4&l=12560
> {code}
> Jan 30 11:03:32 [ERROR] Tests run: 72, Failures: 1, Errors: 0, Skipped: 0,
> Time elapsed: 37.42 s <<< FAILURE! - in
> org.apache.flink.table.planner.runtime.batch.sql.agg.SortAggITCase
> Jan 30 11:03:32 [ERROR]
> org.apache.flink.table.planner.runtime.batch.sql.agg.SortAggITCase.testLeadLag
> Time elapsed: 0.547 s <<< FAILURE!
> Jan 30 11:03:32 java.lang.AssertionError:
> Jan 30 11:03:32
> Jan 30 11:03:32 Results do not match for query:
> Jan 30 11:03:32
> Jan 30 11:03:32 SELECT
> Jan 30 11:03:32 a,
> Jan 30 11:03:32 b, LEAD(b, 1) over (order by a) AS bLead, LAG(b, 1) over
> (order by a) AS bLag,
> Jan 30 11:03:32 c, LEAD(c, 1) over (order by a) AS cLead, LAG(c, 1) over
> (order by a) AS cLag,
> Jan 30 11:03:32 d, LEAD(d, 1) over (order by a) AS dLead, LAG(d, 1) over
> (order by a) AS dLag,
> Jan 30 11:03:32 e, LEAD(e, 1) over (order by a) AS eLead, LAG(e, 1) over
> (order by a) AS eLag,
> Jan 30 11:03:32 f, LEAD(f, 1) over (order by a) AS fLead, LAG(f, 1) over
> (order by a) AS fLag,
> Jan 30 11:03:32 g, LEAD(g, 1) over (order by a) AS gLead, LAG(g, 1) over
> (order by a) AS gLag,
> Jan 30 11:03:32 h, LEAD(h, 1) over (order by a) AS hLead, LAG(h, 1) over
> (order by a) AS hLag,
> Jan 30 11:03:32 i, LEAD(i, 1) over (order by a) AS iLead, LAG(i, 1) over
> (order by a) AS iLag,
> Jan 30 11:03:32 j, LEAD(j, 1) over (order by a) AS jLead, LAG(j, 1) over
> (order by a) AS jLag,
> Jan 30 11:03:32 k, LEAD(k, 1) over (order by a) AS kLead, LAG(k, 1) over
> (order by a) AS kLag,
> Jan 30 11:03:32 l, LEAD(l, 1) over (order by a) AS lLead, LAG(l, 1) over
> (order by a) AS lLag,
> Jan 30 11:03:32 m, LEAD(m, 1) over (order by a) AS mLead, LAG(m, 1) over
> (order by a) AS mLag,
> Jan 30 11:03:32 n, LEAD(n, 1) over (order by a) AS nLead, LAG(n, 1) over
> (order by a) AS nLag
> Jan 30 11:03:32
> Jan 30 11:03:32 FROM UnnamedTable$230
> Jan 30 11:03:32 order by a
> Jan 30 11:03:32
> Jan 30 11:03:32
> Jan 30 11:03:32 Results
> Jan 30 11:03:32 == Correct Result - 3 ==
>
>
>
> == Actual Result - 3 ==
> Jan 30 11:03:32 +I[Alice, 1, 1, null, 1, 1, null, 2, 2, null, 9223, 9223,
> null, -2.3, -2.3, null, 9.9, 9.9, null, true, true, null, varchar, varchar,
> null, char , char , null, 2021-08-03,
> 2021-08-03, null, 20:08:17, 20:08:17, null, 2021-08-03T20:08:29,
> 2021-08-03T20:08:29, null, 9.99, 9.99, null] +I[Alice, 1, 1, null, 1, 1,
> null, 2, 2, null, 9223, 9223, null, -2.3, -2.3, null, 9.9, 9.9, null, true,
> true, null, varchar, varchar, null, char , char
> , null, 2021-08-03, 2021-08-03, null, 20:08:17, 20:08:17, null,
> 2021-08-03T20:08:29, 2021-08-03T20:08:29, null, 9.99, 9.99, null]
> Jan 30 11:03:32 +I[Alice, 1, null, 1, 1, null, 1, 2, null, 2, 9223, null,
> 9223, -2.3, null, -2.3, 9.9, null, 9.9, true, null, true, varchar, null,
> varchar, char , null, char , 2021-08-03, null,
> 2021-08-03, 20:08:17, null, 20:08:17, 2021-08-03T20:08:29, null,
> 2021-08-03T20:08:29, 9.99, null, 9.99] +I[Alice, 1, null, 1, 1, null, 1, 2,
> null, 2, 9223, null, 9223, -2.3, null, -2.3, 9.9, null, 9.9, true, null,
> true, varchar, null, varchar, char , null, char
> , 2021-08-03, null, 2021-08-03, 20:08:17, null, 20:08:17,
> 2021-08-03T20:08:29, null, 2021-08-03T20:08:29, 9.99, null, 9.99]
> Jan 30 11:03:32 !+I[Alice, null, null, 1, null, null, 1, null, null, 2, null,
> null, 9223, null, null, -2.3, null, null, 9.9, null, null, true, null, null,
> varchar, null, null, char , null, null, 2021-08-03, null,
> null, 20:08:17, null, null, 2021-08-03T20:08:29, null, null, 9.99]
> +I[Alice, null, 1, null, null, 1, null, null, 2,
> null, null, 9223, null, null, -2.3, null, null, 9.9, null, null, true, null,
> null, varchar, null, null, char , null, null, 2021-08-03,
> null, null, 20:08:17, null, null, 2021-08-03T20:08:29, null, null, 9.99, null]
> Jan 30 11:03:32
> Jan 30 11:03:32 Plan:
> Jan 30 11:03:32 == Abstract Syntax Tree ==
> Jan 30 11:03:32 LogicalSort(sort0=[$0], dir0=[ASC-nulls-first])
> Jan 30 11:03:32 +- LogicalProject(inputs=[0..1], exprs=[[LEAD($1, 1) OVER
> (ORDER BY $0 NULLS FIRST), LAG($1, 1) OVER (ORDER BY $0 NULLS FIRST), $2,
> LEAD($2, 1) OVER (ORDER BY $0 NULLS FIRST), LAG($2, 1) OVER (ORDER BY $0
> NULLS FIRST), $3, LEAD($3, 1) OVER (ORDER BY $0 NULLS FIRST), LAG($3, 1) OVER
> (ORDER BY $0 NULLS FIRST), $4, LEAD($4, 1) OVER (ORDER BY $0 NULLS FIRST),
> LAG($4, 1) OVER (ORDER BY $0 NULLS FIRST), $5, LEAD($5, 1) OVER (ORDER BY $0
> NULLS FIRST), LAG($5, 1) OVER (ORDER BY $0 NULLS FIRST), $6, LEAD($6, 1) OVER
> (ORDER BY $0 NULLS FIRST), LAG($6, 1) OVER (ORDER BY $0 NULLS FIRST), $7,
> LEAD($7, 1) OVER (ORDER BY $0 NULLS FIRST), LAG($7, 1) OVER (ORDER BY $0
> NULLS FIRST), $8, LEAD($8, 1) OVER (ORDER BY $0 NULLS FIRST), LAG($8, 1) OVER
> (ORDER BY $0 NULLS FIRST), $9, LEAD($9, 1) OVER (ORDER BY $0 NULLS FIRST),
> LAG($9, 1) OVER (ORDER BY $0 NULLS FIRST), $10, LEAD($10, 1) OVER (ORDER BY
> $0 NULLS FIRST), LAG($10, 1) OVER (ORDER BY $0 NULLS FIRST), $11, LEAD($11,
> 1) OVER (ORDER BY $0 NULLS FIRST), LAG($11, 1) OVER (ORDER BY $0 NULLS
> FIRST), $12, LEAD($12, 1) OVER (ORDER BY $0 NULLS FIRST), LAG($12, 1) OVER
> (ORDER BY $0 NULLS FIRST), $13, LEAD($13, 1) OVER (ORDER BY $0 NULLS FIRST),
> LAG($13, 1) OVER (ORDER BY $0 NULLS FIRST)]])
> Jan 30 11:03:32 +- LogicalUnion(all=[true])
> [...]
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)