[
https://issues.apache.org/jira/browse/HBASE-2884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12893273#action_12893273
]
Todd Lipcon commented on HBASE-2884:
------------------------------------
Looked at this a bit -- the thing is that it's expecting 2048 entries, which
would indicate mapred.map.tasks was set to 2. Each mapper is expected to
generate 1024 rows. But, we seed Random() in RandomKVGeneratingMapper with
System.currentTimeMillis - perhaps in this flaky case both mappers started in
the same millisecond and thus generated identical data. When we go and scan, we
only get 1024 rows because we just double-inserted everything?
> TestHFileOutputFormat intermittent diff: LoadIncrementalHFiles should put
> expected data in table expected:<2048> but was:<1024>
> -------------------------------------------------------------------------------------------------------------------------------
>
> Key: HBASE-2884
> URL: https://issues.apache.org/jira/browse/HBASE-2884
> Project: HBase
> Issue Type: Bug
> Reporter: Kannan Muthukkaruppan
> Attachments: TestHFileOutputFormat-output.txt,
> TestHFileOutputFormat.txt
>
>
> {code}
> Tests run: 5, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 160.582 sec
> <<< FAILURE!
> testMRIncrementalLoad(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat)
> Time elapsed: 85.676 sec <<< FAILURE!
> java.lang.AssertionError: LoadIncrementalHFiles should put expected data in
> table expected:<2048> but was:<1024>
> at org.junit.Assert.fail(Assert.java:91)
> at org.junit.Assert.failNotEquals(Assert.java:645)
> at org.junit.Assert.assertEquals(Assert.java:126)
> at org.junit.Assert.assertEquals(Assert.java:470)
> at
> org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat.doIncrementalLoadTest(TestHFileOutputFormat.java:300)
> at
> org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat.testMRIncrementalLoad(TestHFileOutputFormat.java:248)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> {code}
> Will upload full test output shortly.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
