[
https://issues.apache.org/jira/browse/HADOOP-2081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13580574#comment-13580574
]
shobin joseph commented on HADOOP-2081:
---------------------------------------
This fix will create problems when we run the vaidya scrpit in
hadoop-2.0.0-mr1-cdh4.1.2.
Exception:java.lang.NumberFormatException: For input string:
"0.05"java.lang.NumberFormatException: For input string: "0.05"
at
java.lang.NumberFormatException.forInputString(NumberFormatException.java:48)
at java.lang.Integer.parseInt(Integer.java:458)
at java.lang.Integer.parseInt(Integer.java:499)
at org.apache.hadoop.conf.Configuration.getInt(Configuration.java:887)
at
org.apache.hadoop.vaidya.postexdiagnosis.tests.MapSideDiskSpill.getPrescription(MapSideDiskSpill.java:99)
at
org.apache.hadoop.vaidya.DiagnosticTest.getReportElement(DiagnosticTest.java:283)
at
org.apache.hadoop.vaidya.postexdiagnosis.PostExPerformanceDiagnoser.main(PostExPerformanceDiagnoser.java:254)
In the job conf file
the properties are like
<property><name>mapred.reduce.slowstart.completed.maps</name><value>0.05</value><source>mapred-default.xml</source><source>/tmp/hadoop-527022/mapred/local/jobTracker/job_201302121643_0003.xml</source></property>
<property><name>io.sort.record.percent</name><value>0.05</value><source>mapred-default.xml</source><source>/tmp/hadoop-527022/mapred/local/jobTracker/job_201302121643_0003.xml</source></property>
<property><name>io.sort.spill.percent</name><value>0.80</value><source>mapred-default.xml</source><source>/tmp/hadoop-527022/mapred/local/jobTracker/job_201302121643_0003.xml</source></property>
all the above lines throw the exception.
The important thing is default values for the above properties are 0.05 and 0.8
> Configuration getInt, getLong, and getFloat replace invalid numbers with the
> default value
> ------------------------------------------------------------------------------------------
>
> Key: HADOOP-2081
> URL: https://issues.apache.org/jira/browse/HADOOP-2081
> Project: Hadoop Common
> Issue Type: Bug
> Components: conf
> Affects Versions: 0.22.0
> Reporter: Owen O'Malley
> Assignee: Harsh J
> Fix For: 0.23.0
>
> Attachments: HADOOP-2081.r1.diff, HADOOP-2081.r2.diff,
> HADOOP-2081.r3.diff
>
>
> The current behavior of silently replace invalid numbers in the configuration
> with the default value leads to hard to diagnose problems. The methods should
> throw an exception to signal that the input was invalid.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira