[
https://issues.apache.org/jira/browse/HADOOP-3112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mahadev konar updated HADOOP-3112:
----------------------------------
Description:
Copy failed: java.lang.NullPointerException
at
org.apache.hadoop.io.serializer.SerializationFactory.<init>(SerializationFactory.java:52)
at org.apache.hadoop.io.SequenceFile$Writer.init(SequenceFile.java:910)
at
org.apache.hadoop.io.SequenceFile$Writer.<init>(SequenceFile.java:846)
at org.apache.hadoop.io.SequenceFile.createWriter(SequenceFile.java:394)
at org.apache.hadoop.io.SequenceFile.createWriter(SequenceFile.java:285)
at org.apache.hadoop.util.CopyFiles.setup(CopyFiles.java:743)
at org.apache.hadoop.util.CopyFiles.copy(CopyFiles.java:520)
at org.apache.hadoop.util.CopyFiles.run(CopyFiles.java:591)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
at org.apache.hadoop.util.CopyFiles.main(CopyFiles.java:607)
this is the null pointer exception you get when using 0.17 to distcp.
i was running using hod
with hadoop --config hoddir distcp .....................
After investigating further with help from chris, we found out that it is using
conf.getStrings which does not have a default. Also, hadoop default conf
directory is not added to the classpath when we run bin/hadoop on the client
side.
On copying hadoop-default.xml to my config directory it worked fine.
we can add hadoop default conf directory to the classpath? or use a default in
the call for conf.getStrings("io.serializations")?
I am marking this as a blocker for someone to take a look.
was:
Copy failed: java.lang.NullPointerException
at
org.apache.hadoop.io.serializer.SerializationFactory.<init>(SerializationFactory.java:52)
at org.apache.hadoop.io.SequenceFile$Writer.init(SequenceFile.java:910)
at
org.apache.hadoop.io.SequenceFile$Writer.<init>(SequenceFile.java:846)
at org.apache.hadoop.io.SequenceFile.createWriter(SequenceFile.java:394)
at org.apache.hadoop.io.SequenceFile.createWriter(SequenceFile.java:285)
at org.apache.hadoop.util.CopyFiles.setup(CopyFiles.java:743)
at org.apache.hadoop.util.CopyFiles.copy(CopyFiles.java:520)
at org.apache.hadoop.util.CopyFiles.run(CopyFiles.java:591)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
at org.apache.hadoop.util.CopyFiles.main(CopyFiles.java:607)
this is the null pointer exception you get when using 0.17 to distcp.
i was running using hod
with hadoop --config hoddir distcp .....................
After investigating further with help from chris, we found out that it is using
conf.getStrings which does not have a default. Also, hadoop default conf
directory is not added to the classpath when we run bin/hadoop on the client
side.
On copying hadoop-default.xml to my config directory it worked fine.
we can add hadoop default conf directory to the classpath? or allow use a
default in the call for io.serializations?
I am marking this as a blocker for someone to take a look.
> Distcp fails with null pointer exception.
> -----------------------------------------
>
> Key: HADOOP-3112
> URL: https://issues.apache.org/jira/browse/HADOOP-3112
> Project: Hadoop Core
> Issue Type: Bug
> Reporter: Mahadev konar
> Assignee: Robert Chansler
> Priority: Blocker
> Fix For: 0.17.0
>
>
> Copy failed: java.lang.NullPointerException
> at
> org.apache.hadoop.io.serializer.SerializationFactory.<init>(SerializationFactory.java:52)
> at
> org.apache.hadoop.io.SequenceFile$Writer.init(SequenceFile.java:910)
> at
> org.apache.hadoop.io.SequenceFile$Writer.<init>(SequenceFile.java:846)
> at
> org.apache.hadoop.io.SequenceFile.createWriter(SequenceFile.java:394)
> at
> org.apache.hadoop.io.SequenceFile.createWriter(SequenceFile.java:285)
> at org.apache.hadoop.util.CopyFiles.setup(CopyFiles.java:743)
> at org.apache.hadoop.util.CopyFiles.copy(CopyFiles.java:520)
> at org.apache.hadoop.util.CopyFiles.run(CopyFiles.java:591)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
> at org.apache.hadoop.util.CopyFiles.main(CopyFiles.java:607)
> this is the null pointer exception you get when using 0.17 to distcp.
> i was running using hod
> with hadoop --config hoddir distcp .....................
> After investigating further with help from chris, we found out that it is
> using conf.getStrings which does not have a default. Also, hadoop default
> conf directory is not added to the classpath when we run bin/hadoop on the
> client side.
> On copying hadoop-default.xml to my config directory it worked fine.
> we can add hadoop default conf directory to the classpath? or use a default
> in the call for conf.getStrings("io.serializations")?
> I am marking this as a blocker for someone to take a look.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
