Re: Question about State TTL and Interval Join

2021-06-06 Thread Yun Tang
To: user@flink.apache.org Subject: Question about State TTL and Interval Join We currently have a flink 1.8 application deployed on Kinesis Data Analytics using the RocksDB State backend. Our application is joining across 3 different kinesis streams using an interval join. We noticed that our

Re: Question about State TTL and Interval Join

2021-06-05 Thread JING ZHANG
Hi Chris, There is no need to state TTL if stateful operators only contain IntervalJoin. Please check the watermark of two input streams, does the watermark not advance for a long time? Best regards, JING ZHANG McBride, Chris 于2021年6月5日周六 上午3:17写道: > We currently have a flink 1.8 application

Question about State TTL and Interval Join

2021-06-04 Thread McBride, Chris
We currently have a flink 1.8 application deployed on Kinesis Data Analytics using the RocksDB State backend. Our application is joining across 3 different kinesis streams using an interval join. We noticed that our checkpoint sizes continue to increase over time, we eventually have OOM