rmetzger commented on issue #8303: [FLINK-12343]add file replication config for yarn configuration URL: https://github.com/apache/flink/pull/8303#issuecomment-487922029 Having looked more at this, I agree with you. We need to go back to step 1 and discuss the overall approach in JIRA. `setReplication` is a no-op, because the file doesn't exist at the time of the call. I agree that setting the `dfs.replication` factor is a good direction to consider. Also, we need to carefully think through the files we want to be affected by this setting. I guess all files uploaded by the yarn client and application master, but not checkpointing or any other files written by runtime operators. @HuangZhenQiu Can you look into all these aspects and propose a solution in JIRA?
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
