[ 
https://issues.apache.org/jira/browse/FLINK-18523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17154533#comment-17154533
 ] 

Benchao Li commented on FLINK-18523:
------------------------------------

[~aljoscha] Actually the Table API / SQL module also has this config, as 
described in the issue description: {{table.exec.source.idle-timeout}}. What we 
want to address in this issue is the situation that all source subtasks have no 
input data, and the watermark won't advance.

> Advance watermark if there is no data in all of the partitions after some time
> ------------------------------------------------------------------------------
>
>                 Key: FLINK-18523
>                 URL: https://issues.apache.org/jira/browse/FLINK-18523
>             Project: Flink
>          Issue Type: New Feature
>          Components: Table SQL / API
>    Affects Versions: 1.11.0
>            Reporter: chen yong
>            Priority: Major
>
> In the case of window calculations and eventTime scenarios, watermar cannot 
> update because the source does not have data for some reason, and the last 
> Windows cannot trigger the calculations.
> One parameter, table.exec.source. Idle -timeout, can only solve the problem 
> of ignoring parallelism of watermark alignment that does not occur.But when 
> there is no watermark in each parallel degree, you still cannot update the 
> watermark.
> Is it possible to add a lock-timeout parameter (which should be larger than 
> maxOutOfOrderness with default of "-1 ms") and if the watermark is not 
> updated beyond this time (i.e., there is no data), then the current time is 
> taken and sent downstream as the watermark.
>  
> thanks!



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to