[
https://issues.apache.org/jira/browse/HBASE-8324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13630299#comment-13630299
]
Jonathan Hsieh commented on HBASE-8324:
---------------------------------------
This unit test is to test the HFileOutputFormat; it should essentially be proof
that the HFileOutputFormat works as expected. Making sure the MR
implementation is correct is out of scope and not hbase's resonsibility. I
think it does make sense to say that hadoop2 needs to have a release notes
saying not to use speculative execution (or jobs can fail if speculative
execution is on). Taken to a silly extreme, we'd need to run this and all the
other mini mr cluster tests against a wide array of different MR
configurations. For the sake of a unit test, I think two (hadoop1 and hadoop2)
is plenty enough.
> TestHFileOutputFormat.testMRIncremental* fails against hadoop2 profile
> ----------------------------------------------------------------------
>
> Key: HBASE-8324
> URL: https://issues.apache.org/jira/browse/HBASE-8324
> Project: HBase
> Issue Type: Sub-task
> Components: hadoop2, test
> Affects Versions: 0.95.0
> Reporter: Jonathan Hsieh
> Assignee: Jonathan Hsieh
> Fix For: 0.98.0, 0.95.1
>
> Attachments: hbase-8324.hadoop2.patch, hbase-8324.v2.patch
>
>
> Two tests cases are failing:
> testMRIncrementalLoad, testMRIncrementalloadWithSplit
> {code}
> <testcase time="33.942"
> classname="org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat"
> name="testMRIncrementalLoad">
> <failure type="java.lang.AssertionError">java.lang.AssertionError
> at org.junit.Assert.fail(Assert.java:86)
> at org.junit.Assert.assertTrue(Assert.java:41)
> at org.junit.Assert.assertTrue(Assert.java:52)
> at
> org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat.runIncrementalPELoad(TestHFileOutputFormat.java:468)
> at
> org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat.doIncrementalLoadTest(TestHFileOutputFormat.java:378)
> at
> org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat.testMRIncrementalLoad(TestHFileOutputFormat.java:348)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> ...
> <testcase time="34.324"
> classname="org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat"
> name="testMRIncrementalLoadWithSplit">
> <failure type="java.lang.AssertionError">java.lang.AssertionError
> at org.junit.Assert.fail(Assert.java:86)
> at org.junit.Assert.assertTrue(Assert.java:41)
> at org.junit.Assert.assertTrue(Assert.java:52)
> at
> org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat.runIncrementalPELoad(TestHFileOutputFormat.java:468)
> at
> org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat.doIncrementalLoadTest(TestHFileOutputFormat.java:378)
> at
> org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat.testMRIncrementalLoadWithSplit(TestHFileOutputFormat.java:354)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> ...
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
