[
https://issues.apache.org/jira/browse/FLINK-21982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17310358#comment-17310358
]
Bo Cui commented on FLINK-21982:
--------------------------------
when new configuration, configuration will load core-site by
classLoader.getResource(String)
https://github.com/apache/hadoop/blob/ea6595d3b68ac462aec0d493718d7a10fbda0b6d/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/conf/Configuration.java#L788
> jobs should use client org.apache.hadoop.config on yarn
> -------------------------------------------------------
>
> Key: FLINK-21982
> URL: https://issues.apache.org/jira/browse/FLINK-21982
> Project: Flink
> Issue Type: Bug
> Components: Deployment / YARN
> Affects Versions: 1.13.0
> Reporter: Bo Cui
> Priority: Major
>
> currently, jobs use the Yarn server configuration during execution.
> i think we should submit the configuration to the HDFS, like MR job.xml...etc
> and container fetches the job.xml and creates a soft link(hdfs-site core-site
> yarn-site) during container initializes
> and then the configuration can obtain these resources through
> classLoader.getResource(String) during configuration initializes
--
This message was sent by Atlassian Jira
(v8.3.4#803005)