Dima Spivak created HBASE-12252:
-----------------------------------
Summary: IntegrationTestBulkLoad fails with illegal partition error
Key: HBASE-12252
URL: https://issues.apache.org/jira/browse/HBASE-12252
Project: HBase
Issue Type: Bug
Components: test
Affects Versions: 0.98.6
Reporter: Dima Spivak
Assignee: Dima Spivak
While running {{IntegrationTestBulkLoad}} for a while, I encountered the
following error:
{code}
14/10/14 05:57:12 INFO mapreduce.IntegrationTestBulkLoad: Running check
14/10/14 05:57:12 INFO client.RMProxy: Connecting to ResourceManager at
node-1.internal/10.0.0.3:8032
14/10/14 05:57:16 INFO util.RegionSizeCalculator: Calculating region sizes for
table "IntegrationTestBulkLoad".
14/10/14 05:57:16 INFO mapreduce.JobSubmitter: number of splits:16
14/10/14 05:57:17 INFO mapreduce.JobSubmitter: Submitting tokens for job:
job_1413261370136_0012
14/10/14 05:57:17 INFO impl.YarnClientImpl: Submitted application
application_1413261370136_0012
14/10/14 05:57:17 INFO mapreduce.Job: The url to track the job:
http://node-1.internal:8088/proxy/application_1413261370136_0012/
14/10/14 05:57:17 INFO mapreduce.Job: Running job: job_1413261370136_0012
14/10/14 05:57:32 INFO mapreduce.Job: Job job_1413261370136_0012 running in
uber mode : false
14/10/14 05:57:32 INFO mapreduce.Job: map 0% reduce 0%
14/10/14 05:57:52 INFO mapreduce.Job: map 6% reduce 0%
14/10/14 05:57:53 INFO mapreduce.Job: Task Id :
attempt_1413261370136_0012_m_000013_0, Status : FAILED
Error: java.io.IOException: Illegal partition for
org.apache.hadoop.hbase.mapreduce.IntegrationTestBulkLoad$LinkKey@133c4539 (-3)
at
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.collect(MapTask.java:1079)
at
org.apache.hadoop.mapred.MapTask$NewOutputCollector.write(MapTask.java:712)
at
org.apache.hadoop.mapreduce.task.TaskInputOutputContextImpl.write(TaskInputOutputContextImpl.java:89)
at
org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.write(WrappedMapper.java:112)
at
org.apache.hadoop.hbase.mapreduce.IntegrationTestBulkLoad$LinkedListCheckingMapper.map(IntegrationTestBulkLoad.java:502)
at
org.apache.hadoop.hbase.mapreduce.IntegrationTestBulkLoad$LinkedListCheckingMapper.map(IntegrationTestBulkLoad.java:491)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:784)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)
Container killed by the ApplicationMaster.
Container killed on request. Exit code is 143
Container exited with a non-zero exit code 143
{code}
I'm pretty sure I've tracked this down to a partition generator that can return
a negative number; I'll post a fix once I've confirmed locally.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
