[
https://issues.apache.org/jira/browse/HBASE-21285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645694#comment-16645694
]
Lavinia-Stefania Sirbu commented on HBASE-21285:
------------------------------------------------
Sure [[email protected]], the result of my experiments are:
* Number of regions = 20 (~200 hfiles) => getRegionSizes ~25ms
* Number of regions = 500 (~9000 hfiles) => getRegionSizes ~100ms
* Number of regions = 23000 regions (~216000 hfiles) => getRegionSizes ~3.5s
> Enhanced TableSnapshotInputFormat to allow a size based splitting
> -----------------------------------------------------------------
>
> Key: HBASE-21285
> URL: https://issues.apache.org/jira/browse/HBASE-21285
> Project: HBase
> Issue Type: Improvement
> Components: snapshots
> Affects Versions: 1.4.0
> Reporter: Lavinia-Stefania Sirbu
> Priority: Minor
> Attachments: HBASE-21285.branch-1.4.001.patch,
> HBASE-21285.branch-1.4.002.patch
>
>
> Currently, all the splits generated by a snapshot are having length 0. Right
> now, we have a configuration for the number of splits per region, but it's a
> general one and not very helpful when the sizes for regions are really
> different. The modification must be done in TableSnapshotInputFormatImpl
> where the length must be computed.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
