[
https://issues.apache.org/jira/browse/HBASE-20526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16472625#comment-16472625
]
Ted Yu commented on HBASE-20526:
--------------------------------
Test failure seems to be related to patch:
{code}
[ERROR] Tests run: 6, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 174.114
s <<< FAILURE! - in
org.apache.hadoop.hbase.client.TestRestoreSnapshotFromClientWithRegionReplicas
[ERROR]
testRestoreSnapshotAfterSplit(org.apache.hadoop.hbase.client.TestRestoreSnapshotFromClientWithRegionReplicas)
Time elapsed: 17.969 s <<< ERROR!
org.apache.hadoop.hbase.snapshot.HBaseSnapshotException:
org.apache.hadoop.hbase.snapshot.HBaseSnapshotException: Snapshot {
ss=testRestoreSnapshotAfterSplit-snap table=testtb-1525617745131 type=FLUSH }
had an error. Procedure testRestoreSnapshotAfterSplit-snap { waiting=[]
done=[] }
at
org.apache.hadoop.hbase.master.snapshot.SnapshotManager.isSnapshotDone(SnapshotManager.java:354)
at
org.apache.hadoop.hbase.master.MasterRpcServices.isSnapshotDone(MasterRpcServices.java:1030)
at
org.apache.hadoop.hbase.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java:58585)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2349)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:123)
at
org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:188)
at
org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:168)
Caused by: org.apache.hadoop.hbase.snapshot.CorruptedSnapshotException via
Failed taking snapshot { ss=testRestoreSnapshotAfterSplit-snap
table=testtb-1525617745131 type=FLUSH } due to exception:Manifest region info
{ENCODED => 7e089fb3359462cea181a607beba185a, NAME =>
'testtb-1525617745131,8,1525617745132_0002.7e089fb3359462cea181a607beba185a.',
STARTKEY => '8', ENDKEY => '', OFFLINE => true, SPLIT => true, REPLICA_ID =>
2}doesn't match expected region:{ENCODED => 9ca827b8e313d4b010ae10accb02a970,
NAME =>
'testtb-1525617745131,8,1525617745132.9ca827b8e313d4b010ae10accb02a970.',
STARTKEY => '8', ENDKEY => '', OFFLINE => true, SPLIT =>
true}:org.apache.hadoop.hbase.snapshot.CorruptedSnapshotException: Manifest
region info {ENCODED => 7e089fb3359462cea181a607beba185a, NAME =>
'testtb-1525617745131,8,1525617745132_0002.7e089fb3359462cea181a607beba185a.',
STARTKEY => '8', ENDKEY => '', OFFLINE => true, SPLIT => true, REPLICA_ID =>
2}doesn't match expected region:{ENCODED => 9ca827b8e313d4b010ae10accb02a970,
NAME =>
'testtb-1525617745131,8,1525617745132.9ca827b8e313d4b010ae10accb02a970.',
STARTKEY => '8', ENDKEY => '', OFFLINE => true, SPLIT => true}
at
org.apache.hadoop.hbase.errorhandling.ForeignExceptionDispatcher.rethrowException(ForeignExceptionDispatcher.java:83)
at
org.apache.hadoop.hbase.master.snapshot.TakeSnapshotHandler.rethrowExceptionIfFailed(TakeSnapshotHandler.java:315)
at
org.apache.hadoop.hbase.master.snapshot.SnapshotManager.isSnapshotDone(SnapshotManager.java:344)
... 6 more
{code}
Please correct the test failure before posting patch for master.
> multithreads bulkload performance
> ---------------------------------
>
> Key: HBASE-20526
> URL: https://issues.apache.org/jira/browse/HBASE-20526
> Project: HBase
> Issue Type: Improvement
> Components: mapreduce, Zookeeper
> Affects Versions: 1.2.5, 1.3.2
> Environment: hbase-server-1.2.0-cdh5.12.1
> spark version 1.6
> Reporter: Key Hutu
> Assignee: Key Hutu
> Priority: Minor
> Labels: performance
> Fix For: 1.3.2
>
> Attachments: HBASE-20526-branch-1.3.V1.patch
>
> Original Estimate: 96h
> Remaining Estimate: 96h
>
> When doing bulkload , some interactive with zookeeper to getting region key
> range may be cost more time.
> In multithreads enviorment, the duration maybe cost 5 minute or more.
> From the executor log, like 'Reading reply sessionid:0x262fb37f4a07080 ,
> packet:: clientPath:null server ...' contents appear many times.
>
> It likely to provide new method for bulkload, caching the key range outside
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
