[
https://issues.apache.org/jira/browse/MAPREDUCE-2584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13101998#comment-13101998
]
Harsh J commented on MAPREDUCE-2584:
------------------------------------
Todd,
Looks like some form of build issue.
Here's what I tried to do to get this test to pass:
hadoop $ (Applied patch)
hadoop $ mvn install -DskipTests -P-cbuild
(Success)
hadoop-mapreduce-project $ ant veryclean
(Success)
hadoop-mapreduce-project $ ant -Dresolvers=internal -Dtestcase=TestMRJobClient
test
(Failed)
hadoop-mapreduce-project $ grep "find a serializer for the" build/ -R
Binary file
build/test/classes/org/apache/hadoop/mapreduce/TestMRJobClient.class matches
Binary file
build/test/mapred/classes/org/apache/hadoop/mapreduce/TestMRJobClient.class
matches
This looks wrong. That string ought to be present in the binary MR jar as well,
but it doesn't show up as part of grep result. It would mean that locally
published jars aren't being used? Also, TestMRJobClient lies outside of the
client test suites, in the older area… Shouldn't it be moved in?
> Check for serializers early, and give out more information regarding missing
> serializers
> ----------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-2584
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2584
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: task
> Affects Versions: 0.20.2
> Reporter: Harsh J
> Assignee: Harsh J
> Labels: serializers, tasks
> Fix For: 0.23.0
>
> Attachments: MAPREDUCE-2584.r2.diff, MAPREDUCE-2584.r3.diff,
> MAPREDUCE-2584.r4.diff, MAPREDUCE-2584.r5.diff
>
>
> As discussed on HADOOP-7328, MapReduce can handle serializers in a much
> better way in case of bad configuration, improper imports (Some odd Text
> class instead of the Writable Text set as key), etc..
> This issue covers the MapReduce parts of the improvements (made to IFile,
> MapOutputBuffer, etc. and possible early-check of serializer availability
> pre-submit) that provide more information than just an NPE as is the current
> case.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
