[
https://issues.apache.org/jira/browse/MAPREDUCE-6328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507103#comment-14507103
]
Jason Lowe commented on MAPREDUCE-6328:
---------------------------------------
FileBench is attempting to wield SequenceFileOutputFormat outside the context
of a task. SequenceFileOutputFormat assumes it's running within a task, as it
invokes FileOutputFormat.getTaskOutputPath which assumes
conf.get(JobContext.TASK_ATTEMPT_ID) is not going to return null. However
since we're not running in a task that property hasn't been setup and therefore
there's no property set (and no task output path).
At first glance this looks like a bug in FileBench.
> NPE in TaskAttemptContextImpl.java
> ----------------------------------
>
> Key: MAPREDUCE-6328
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-6328
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Reporter: Brahma Reddy Battula
> Assignee: Brahma Reddy Battula
>
> yarn jar
> ../share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.7.0.jar
> filebench -dir /TESTBBP
> 15/04/20 15:45:05 INFO Configuration.deprecation:
> mapred.output.compression.type is deprecated. Instead, use
> mapreduce.output.fileoutputformat.compress.type
> W SEQ_ZIP_BLK: 15/04/20 15:45:05 INFO Configuration.deprecation:
> mapred.work.output.dir is deprecated. Instead, use mapreduce.task.output.dir
> java.lang.NullPointerException
> at
> org.apache.hadoop.mapreduce.task.TaskAttemptContextImpl.<init>(TaskAttemptContextImpl.java:49)
> at
> org.apache.hadoop.mapreduce.task.TaskAttemptContextImpl.<init>(TaskAttemptContextImpl.java:44)
> at
> org.apache.hadoop.mapred.TaskAttemptContextImpl.<init>(TaskAttemptContextImpl.java:38)
> at
> org.apache.hadoop.mapred.TaskAttemptContextImpl.<init>(TaskAttemptContextImpl.java:33)
> at
> org.apache.hadoop.mapred.FileOutputFormat.getTaskOutputPath(FileOutputFormat.java:253)
> at
> org.apache.hadoop.mapred.SequenceFileOutputFormat.getRecordWriter(SequenceFileOutputFormat.java:49)
> at org.apache.hadoop.io.FileBench.writeBench(FileBench.java:113)
> at org.apache.hadoop.io.FileBench$RW$1.exec(FileBench.java:297)
> at org.apache.hadoop.io.FileBench.run(FileBench.java:224)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> at org.apache.hadoop.io.FileBench.main(FileBench.java:155)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at
> org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:71)
> at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)
> at
> org.apache.hadoop.test.MapredTestDriver.run(MapredTestDriver.java:130)
> at
> org.apache.hadoop.test.MapredTestDriver.main(MapredTestDriver.java:138)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
