[
https://issues.apache.org/jira/browse/FLINK-21833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317243#comment-17317243
]
Jark Wu edited comment on FLINK-21833 at 4/9/21, 2:51 AM:
----------------------------------------------------------
Fixed in
- master: 6ac9b46413b890e5992c8f046834bc2e75da3b39
- release-1.12: 688378e61b8d6e8d3b18adfd34ba26888d70da56
was (Author: jark):
Fixed in
- master: 6ac9b46413b890e5992c8f046834bc2e75da3b39
- release-1.12: TODO
> TemporalRowTimeJoinOperator.java will lead to the state expansion by
> short-life-cycle & huge RowData, although config idle.state.retention.time
> -----------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: FLINK-21833
> URL: https://issues.apache.org/jira/browse/FLINK-21833
> Project: Flink
> Issue Type: Bug
> Components: Table SQL / Runtime
> Affects Versions: 1.12.2
> Reporter: lynn1.zhang
> Assignee: lynn1.zhang
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.13.0, 1.12.3
>
> Attachments: image-2021-03-17-11-06-21-768.png
>
>
> In our company cases, short-life-cycle & huge RowData will use this operator
> to join each other. Every key called session_id will be expired after 2min.
> With idle.state.retention.time configuration, after 2min if not used, the
> leftState and rightState will be cleaned up by the operator but nextLeftIndex
> & registeredTimer state data will be stored forever.
> After running a day(about 20 million session_id in our company cases), the
> checkpoint operator will cause the job crash.
> I have found the bug, and fixed it.
> !image-2021-03-17-11-06-21-768.png!
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
