[
https://issues.apache.org/jira/browse/FLINK-22781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17351697#comment-17351697
]
Andy commented on FLINK-22781:
------------------------------
[~godfreyhe] After I think back the problem, I found there still exists a
problem even after group window without any data (the data may be retracted)
should not send any record :(.
The result still may be different with disable/enable mini-batch because there
exists some uncertain factors. For example, If disable mini-batch, the upsert
source sends a update message, `StreamExecChangelogNormalize` would send a
update-before message and a update-after message to downstream. *The
update-before maybe dropped as late data when it comes to windowOperator
because it has the original row-time as last insert message at the same primary
key.* *Whether it would be dropped or not is not nondeterministic*. Let's see
what happened if enable mini-batch, the `StreamExecChangelogNormalize` maybe
reduces the temporary change, *whether the intermediate result is visible to
the following window operator is nondeterministic*.
> Incorrect result for group window aggregate when mini-batch is enabled
> ----------------------------------------------------------------------
>
> Key: FLINK-22781
> URL: https://issues.apache.org/jira/browse/FLINK-22781
> Project: Flink
> Issue Type: Bug
> Components: Table SQL / Planner
> Affects Versions: 1.14.0
> Reporter: godfrey he
> Assignee: Andy
> Priority: Critical
> Fix For: 1.14.0
>
>
> We can reproduce this issue through adding the following code to
> {{GroupWindowITCase#testWindowAggregateOnUpsertSource}} method:
> {code:java}
> tEnv.getConfig.getConfiguration.setBoolean(
> ExecutionConfigOptions.TABLE_EXEC_MINIBATCH_ENABLED, true)
> tEnv.getConfig.getConfiguration.set(
> ExecutionConfigOptions.TABLE_EXEC_MINIBATCH_ALLOW_LATENCY,
> Duration.ofSeconds(1))
> tEnv.getConfig.getConfiguration.setLong(
> ExecutionConfigOptions.TABLE_EXEC_MINIBATCH_SIZE, 10L)
> {code}
> The reason is the group window without any data (the data may be retracted)
> should not send any record.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
