[
https://issues.apache.org/jira/browse/FLINK-29754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17623663#comment-17623663
]
Gabor Somogyi commented on FLINK-29754:
---------------------------------------
> if the Hadoop configuration is set through the {{HADOOP_CONF_DIR}}
> environment variable, then the configuration loaded by the HadoopConfigLoader
> will not contain the values set there
Set where exactly? What is missing?
> HadoopConfigLoader should consider Hadoop configuration files
> -------------------------------------------------------------
>
> Key: FLINK-29754
> URL: https://issues.apache.org/jira/browse/FLINK-29754
> Project: Flink
> Issue Type: Bug
> Components: FileSystems
> Reporter: Peter Vary
> Priority: Major
>
> Currently
> [HadoopConfigLoader|https://github.com/apache/flink/blob/master/flink-filesystems/flink-hadoop-fs/src/main/java/org/apache/flink/runtime/util/HadoopConfigLoader.java]
> considers Hadoop configurations on the classpath, but does not consider
> Hadoop configuration files which are set in another way.
> So if the Hadoop configuration is set through the {{HADOOP_CONF_DIR}}
> environment variable, then the configuration loaded by the HadoopConfigLoader
> will not contain the values set there.
> This can cause unexpected behaviour when setting checkpoint / savepoint dirs
> on S3, and the specific S3 configurations are set in the Hadoop configuration
> files
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
