[
https://issues.apache.org/jira/browse/HBASE-24859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sandeep Pal resolved HBASE-24859.
---------------------------------
Resolution: Abandoned
Closing this since it may lead to data misses if new data received after table
splits information get passed to MR.
> Remove the empty regions from the hbase mapreduce splits
> --------------------------------------------------------
>
> Key: HBASE-24859
> URL: https://issues.apache.org/jira/browse/HBASE-24859
> Project: HBase
> Issue Type: Improvement
> Components: mapreduce
> Reporter: Sandeep Pal
> Assignee: Sandeep Pal
> Priority: Major
>
> It has been observed that when the table has too many regions, MR jobs
> consume more memory in the client. This is because we keep the region level
> information in memory and the memory heavy object is TableSplit because of
> Scan object as a part of it.
> We can optimize the memory consumption by not loading the region level
> information if the region is empty.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
