Distcp fails with null pointer exception.
-----------------------------------------
Key: HADOOP-3112
URL: https://issues.apache.org/jira/browse/HADOOP-3112
Project: Hadoop Core
Issue Type: Bug
Reporter: Mahadev konar
Assignee: Robert Chansler
Priority: Blocker
Fix For: 0.17.0
Copy failed: java.lang.NullPointerException
at
org.apache.hadoop.io.serializer.SerializationFactory.<init>(SerializationFactory.java:52)
at org.apache.hadoop.io.SequenceFile$Writer.init(SequenceFile.java:910)
at
org.apache.hadoop.io.SequenceFile$Writer.<init>(SequenceFile.java:846)
at org.apache.hadoop.io.SequenceFile.createWriter(SequenceFile.java:394)
at org.apache.hadoop.io.SequenceFile.createWriter(SequenceFile.java:285)
at org.apache.hadoop.util.CopyFiles.setup(CopyFiles.java:743)
at org.apache.hadoop.util.CopyFiles.copy(CopyFiles.java:520)
at org.apache.hadoop.util.CopyFiles.run(CopyFiles.java:591)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
at org.apache.hadoop.util.CopyFiles.main(CopyFiles.java:607)
this is the null pointer exception you get when using 0.17 to distcp.
i was running using hod
with hadoop --config hoddir distcp .....................
After investigating further with help from chris, we found out that it is using
conf.getStrings which does not have a default. Also, hadoop default conf
directory is not added to the classpath when we run bin/hadoop on the client
side.
On copying hadoop-default.xml to my config directory it worked fine.
we can add hadoop default conf directory to the classpath? or allow use a
default in the call for io.serializations?
I am marking this as a blocker for someone to take a look.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
