[
https://issues.apache.org/jira/browse/FLINK-22414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17331383#comment-17331383
]
Yang Wang commented on FLINK-22414:
-----------------------------------
[~chesnay] I agree with you that we do not need to expose HADOOP_CONF_DIR as
environment variable. Instead, the {{config.sh}} has already parse the value of
{{env.hadoop.conf.dir}} and append to the classpath. Since hadoop will pick the
core-site.xml and hdfs-site.xml from classpath by default, I think using
{{FLINK_PROPERTIES}} should work.
[~f.pompermaier] Could you share the exception when only
{{env.hadoop.conf.dir}} is configured and {{HADOOP_CONF_DIR}} is not set?
> Consider env.hadoop.conf.dir when looking for the hadoop configuration
> ----------------------------------------------------------------------
>
> Key: FLINK-22414
> URL: https://issues.apache.org/jira/browse/FLINK-22414
> Project: Flink
> Issue Type: Bug
> Components: Deployment / YARN, Runtime / Configuration
> Affects Versions: 1.11.3, 1.12.2, 1.13.0, 1.14.0
> Reporter: Matthias
> Priority: Major
>
> The option of setting {{env.hadoop.conf.dir}} is allowed to be used as an
> alternative to setting the environment variable {{HADOOP_CONF_DIR}} based [on
> the
> documentation|https://ci.apache.org/projects/flink/flink-docs-stable/deployment/config.html#env-hadoop-conf-dir].
> But the variable is not checked when determining the configuration location
> in the code (see
> [HadoopUtils.getHadoopConfiguration|https://github.com/apache/flink/blob/ba027e0b3e2cf950cd0bd7fb4f632a9c3449d9ad/flink-filesystems/flink-hadoop-fs/src/main/java/org/apache/flink/runtime/util/HadoopUtils.java#L53]).
> This issue is about adding {{env.hadoop.conf.dir}} as an option to specify
> the Hadoop configuration directory.
> Initial proposal came from [this user mailing list
> thread|http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Flink-Hadoop-config-on-docker-compose-td42967.html#a42994].
--
This message was sent by Atlassian Jira
(v8.3.4#803005)