Sandeep Pal created HBASE-24859:
-----------------------------------
Summary: Remove the empty regions from the hbase mapreduce splits
Key: HBASE-24859
URL: https://issues.apache.org/jira/browse/HBASE-24859
Project: HBase
Issue Type: Improvement
Components: mapreduce
Reporter: Sandeep Pal
Assignee: Sandeep Pal
It has been observed that when the table has too many regions, MR jobs consume
more memory in the client. This is because we keep the region level information
in memory and the memory heavy object is TableSplit because of Scan object as a
part of it.
We can optimize the memory consumption by not loading the region level
information if the region is empty.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)