[
https://issues.apache.org/jira/browse/FLINK-25683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17479223#comment-17479223
]
Yao Zhang commented on FLINK-25683:
-----------------------------------
Hi [~dwysakowicz] and [~twalthr] ,
Thank you very much for your reply. I retested this issue and finally got that
the problem only exists if the DataStream is converted from table API. If we
use pure Stream API everything works smoothly. It is not a good practice to
change AbstractStreamOperator. The problem indeed lies in
InputConversionOperator.
{code:java}
@Override
public void processWatermark(Watermark mark) throws Exception {
if (propagateWatermark) {
super.processWatermark(mark);
}
} {code}
I debugged and it turned out that the value of propagateWatermark was false. No
watermarks will be forwarded to the downstream.
> wrong result if table transfrom to DataStream then window process in batch
> mode
> -------------------------------------------------------------------------------
>
> Key: FLINK-25683
> URL: https://issues.apache.org/jira/browse/FLINK-25683
> Project: Flink
> Issue Type: Bug
> Components: Table SQL / API, Table SQL / Runtime
> Affects Versions: 1.14.2
> Environment: mac book pro m1
> jdk 8
> scala 2.11
> flink 1.14.2
> idea 2020
> Reporter: zhangzh
> Assignee: Yao Zhang
> Priority: Major
> Labels: pull-request-available
> Attachments: TableToDataStreamBatchWindowTest.scala, pom.xml
>
>
> I have 5 line datas,
> i first need to transform current data with SQL
> then mix current data and historical data which is batch get from hbase
> for some special reason the program must run in batch mode
> i think the correct result should be like this：
> (BOB,1)
> (EMA,1)
> (DOUG,1)
> (ALICE,1)
> (CENDI,1)
> but the result is :
> (EMA,1)
>
> if i set different parallelism ,the result is different.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
