[ https://issues.apache.org/jira/browse/HADOOP-127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Owen O'Malley resolved HADOOP-127. ---------------------------------- Resolution: Duplicate I believe this was fixed by HADOOP-785. > Unclear precedence of config files and property definitions > ----------------------------------------------------------- > > Key: HADOOP-127 > URL: https://issues.apache.org/jira/browse/HADOOP-127 > Project: Hadoop > Issue Type: Bug > Components: conf > Environment: Hadoop 0.1.1, Nutch 0.8-dev > Reporter: Andrzej Bialecki > Assignee: Doug Cutting > > The order in which configuration resources are read is not sufficiently > documented, and also there are no mechanisms preventing harmful re-definition > of certain properties, if they are put in wrong config files. > From reading the code in Hadoop Configuration.java, JobConf.java and Nutch > NutchConfiguration.java I _think_ this is what's happening. > There are two groups of resources: default resources, loaded first, and final > resources, loaded at the end. All properties (re)-defined in files loaded > later will override any previous definitions: > * default resources: loaded in the order as they are added. The following > files are added here, in order: > 1. hadoop-default.xml (Configuration) > 2. nutch-default.xml (NutchConfiguration) > 3. mapred-default.xml (JobConf) > 4. job_xx_xxx.xml (JobConf, in JobConf(File config)) > * final resource: which always come after default resources, i.e. if any > value is defined here it will always override those set in default resources > (NOTE: including per job settings!!!). The following files are added here, in > reversed order: > 2. hadoop-site.xml (Configuration) > 1. nutch-site.xml (NutchConfiguration) > (i.e. hadoop-site.xml will take precedence over anything else defined in any > other config file). > I would appreciate checking that this is indeed the case, and suggestions how > to ensure that you cannot so easily shoot yourself in the foot if you define > wrong properties in hadoop-site or nutch-site ... -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.