[
https://issues.apache.org/jira/browse/HADOOP-9570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daryn Sharp updated HADOOP-9570:
--------------------------------
Status: Patch Available (was: Open)
> Configuration.addResource() should only parse the new resource
> --------------------------------------------------------------
>
> Key: HADOOP-9570
> URL: https://issues.apache.org/jira/browse/HADOOP-9570
> Project: Hadoop Common
> Issue Type: Improvement
> Components: conf
> Environment: Ubuntu LXC
> Reporter: Gopal V
> Assignee: Daryn Sharp
> Priority: Minor
> Attachments: HADOOP-9570.branch-2.8.001.patch,
> HADOOP-9570.branch-2.8.patch, HADOOP-9750.patch
>
>
> Hadoop configuration parsing re-parses all configuration files when a new
> resource is added to the configuration object.
> This is wasteful and runs through every deprecation check unnecessarily.
> {code}
> JobConf clone = new JobConf(job);
> clone.addResource(...);
> {code}
> will reparse every file including core-site, hdfs-site etc.
> Resource addition can be taken care of cleanly, if the addResourceObject()
> call applies the new resource, followed by applying the overlay, without
> re-parsing any of the older files already loaded into the hashtable.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
