[
https://issues.apache.org/jira/browse/HBASE-8528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13657147#comment-13657147
]
Jonathan Hsieh commented on HBASE-8528:
---------------------------------------
Tracked it down -- in MiniMRClientClusterFactory, we get a conf from the job
and feed it to the MiniMRYarnCluster [1]. The job doesn't get the same conf
we build in hbase -- it instantiates its own. [2] This is why we need to
manually copy over settings into the hbase mr client for mr2/yarn hbase jobs.
I'm going to add some comments to gary's patch to this effect.
[1]
https://github.com/apache/hadoop-common/blob/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/MiniMRClientClusterFactory.java#L73
[2]
https://github.com/apache/hadoop-common/blob/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/Job.java#L147
> [hadoop2] TestMultiTableInputFormat always fails on hadoop with YARN-129
> applied
> --------------------------------------------------------------------------------
>
> Key: HBASE-8528
> URL: https://issues.apache.org/jira/browse/HBASE-8528
> Project: HBase
> Issue Type: Sub-task
> Components: hadoop2, mapreduce, test
> Affects Versions: 0.95.0
> Reporter: Jonathan Hsieh
> Assignee: Jonathan Hsieh
> Fix For: 0.98.0, 0.95.1
>
> Attachments: hbase-8528_alt.patch, hbase-8528.patch
>
>
> TestMulitTableInputFormat always fails if YARN-129 is applied. Its error
> message isn't useful (assertion failed) -- but if you look at the
> stderr/stdout/syslog files of the jobs in
> hbase-server/target/org.apache.hadoop.mapred.MiniMRCluster* (minicluster data
> dirs) you'll find this class not found exception:
> {code}
> Exception in thread "main" java.lang.NoClassDefFoundError:
> org/apache/hadoop/mapreduce/v2/app/MRAppMaster
> Caused by: java.lang.ClassNotFoundException:
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster
> at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> Could not find the main class:
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster. Program will exit.
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
