[
https://issues.apache.org/jira/browse/HBASE-12252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on HBASE-12252 started by Dima Spivak.
-------------------------------------------
> IntegrationTestBulkLoad fails with illegal partition error
> ----------------------------------------------------------
>
> Key: HBASE-12252
> URL: https://issues.apache.org/jira/browse/HBASE-12252
> Project: HBase
> Issue Type: Bug
> Components: test
> Affects Versions: 0.98.6
> Reporter: Dima Spivak
> Assignee: Dima Spivak
>
> While running {{IntegrationTestBulkLoad}} for a while, I encountered the
> following error:
> {code}
> 14/10/14 05:57:12 INFO mapreduce.IntegrationTestBulkLoad: Running check
> 14/10/14 05:57:12 INFO client.RMProxy: Connecting to ResourceManager at
> node-1.internal/10.0.0.3:8032
> 14/10/14 05:57:16 INFO util.RegionSizeCalculator: Calculating region sizes
> for table "IntegrationTestBulkLoad".
> 14/10/14 05:57:16 INFO mapreduce.JobSubmitter: number of splits:16
> 14/10/14 05:57:17 INFO mapreduce.JobSubmitter: Submitting tokens for job:
> job_1413261370136_0012
> 14/10/14 05:57:17 INFO impl.YarnClientImpl: Submitted application
> application_1413261370136_0012
> 14/10/14 05:57:17 INFO mapreduce.Job: The url to track the job:
> http://node-1.internal:8088/proxy/application_1413261370136_0012/
> 14/10/14 05:57:17 INFO mapreduce.Job: Running job: job_1413261370136_0012
> 14/10/14 05:57:32 INFO mapreduce.Job: Job job_1413261370136_0012 running in
> uber mode : false
> 14/10/14 05:57:32 INFO mapreduce.Job: map 0% reduce 0%
> 14/10/14 05:57:52 INFO mapreduce.Job: map 6% reduce 0%
> 14/10/14 05:57:53 INFO mapreduce.Job: Task Id :
> attempt_1413261370136_0012_m_000013_0, Status : FAILED
> Error: java.io.IOException: Illegal partition for
> org.apache.hadoop.hbase.mapreduce.IntegrationTestBulkLoad$LinkKey@133c4539
> (-3)
> at
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer.collect(MapTask.java:1079)
> at
> org.apache.hadoop.mapred.MapTask$NewOutputCollector.write(MapTask.java:712)
> at
> org.apache.hadoop.mapreduce.task.TaskInputOutputContextImpl.write(TaskInputOutputContextImpl.java:89)
> at
> org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.write(WrappedMapper.java:112)
> at
> org.apache.hadoop.hbase.mapreduce.IntegrationTestBulkLoad$LinkedListCheckingMapper.map(IntegrationTestBulkLoad.java:502)
> at
> org.apache.hadoop.hbase.mapreduce.IntegrationTestBulkLoad$LinkedListCheckingMapper.map(IntegrationTestBulkLoad.java:491)
> at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:784)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
> at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:415)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
> at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)
> Container killed by the ApplicationMaster.
> Container killed on request. Exit code is 143
> Container exited with a non-zero exit code 143
> {code}
> I'm pretty sure I've tracked this down to a partition generator that can
> return a negative number; I'll post a fix once I've confirmed locally.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
