Fan Hong created FLINK-31809: -------------------------------- Summary: Improve efficiency of ListStateWithCache#snapshotState Key: FLINK-31809 URL: https://issues.apache.org/jira/browse/FLINK-31809 Project: Flink Issue Type: Improvement Components: Library / Machine Learning Reporter: Fan Hong
Current `ListStateWithCache#snapshotState` supports distributed file systems and local file systems. However, in both cases, full data is written to the filesystem (` dataCacheWriter.writeSegmentsToFiles()`) when `snapshotState` is called. Moreover, when local file system is used, full data is written to Flink state storage right now, which doubles the costs. -- This message was sent by Atlassian Jira (v8.20.10#820010)