distcp throws a NullPointerException in the close() method of mapper class due 
to the Reporter becoming invalid
---------------------------------------------------------------------------------------------------------------

                 Key: HADOOP-2174
                 URL: https://issues.apache.org/jira/browse/HADOOP-2174
             Project: Hadoop
          Issue Type: Bug
          Components: util
    Affects Versions: 0.15.0
            Reporter: Riccardo
            Priority: Critical
             Fix For: 0.15.1


distcp occasionally throws a NullPointerException in the close() method of the 
mapper class, when the copy of the Reporter handle becomes invalid:

java.lang.NullPointerException
       at 
org.apache.hadoop.util.CopyFiles$FSCopyFilesMapper.updateStatus(CopyFiles.java:242)
       at 
org.apache.hadoop.util.CopyFiles$FSCopyFilesMapper.close(CopyFiles.java:402)
       at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:53)
       at org.apache.hadoop.mapred.MapTask.run(MapTask.java:192)
       at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1760)

This can easily be fixed by checking whether the Reporter is null before 
updating the status. Also, the status could be updated once the invocation of 
copy(srcstat, dstpath, out, reporter); returns on line 373 of CopyFiles.java. 
Marking this as critical for a 0.15.1 release as Chris requested.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply via email to