SHuixo commented on issue #6465: URL: https://github.com/apache/iceberg/issues/6465#issuecomment-1361267227
> i am using sql client so i go through flink and iceberg document and i can not found something like this sorry can you explain more i am not expert in flink is this configuration in yaml conf file why flink not committed file in hdfs i search to much in flnik document and i can not find anything helped me You can directly modify the **checkpointing** related configuration in the **flink-conf.yaml** file to make it take effect, the official website reference link is as follows [https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/deployment/config/](https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/deployment/config/) And the configuration items can be added as follows： ``` execution.checkpointing.interval: 5000 execution.checkpointing.mode: EXACTLY_ONCE state.backend: filesystem state.checkpoints.dir: hdfs:///flink/checkpoints state.savepoints.dir: hdfs:///flink/checkpoints execution.checkpointing.timeout: 600000 execution.checkpointing.min-pause: 500 execution.checkpointing.max-concurrent-checkpoints: 1 state.checkpoints.num-retained: 3 execution.checkpointing.externalized-checkpoint-retention: RETAIN_ON_CANCELLATION ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
