[
https://issues.apache.org/jira/browse/HBASE-3871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ted Yu resolved HBASE-3871.
---------------------------
Resolution: Fixed
Hadoop Flags: [Reviewed]
> Speedup LoadIncrementalHFiles by parallelizing HFile splitting
> --------------------------------------------------------------
>
> Key: HBASE-3871
> URL: https://issues.apache.org/jira/browse/HBASE-3871
> Project: HBase
> Issue Type: Improvement
> Components: mapreduce
> Affects Versions: 0.90.2
> Reporter: Ted Yu
> Assignee: Ted Yu
> Attachments: 3871.patch
>
>
> From Adam w.r.t. HFile splitting:
> There's actually a good number of messages of that type (HFile no longer fits
> inside a single region), unfortunately I didn't take a timestamp on just when
> I was running with the patched jars vs the regular ones, however from the
> logs I can say that this is occurring fairly regularly on this system. The
> cluster I tested this on is our backup cluster, the mapreduce jobs on our
> production cluster output HFiles which are copied to the backup and then
> loaded into HBase on both. Since the regions may be somewhat different on
> the backup cluster I would expect it to have to split somewhat regularly.
> This JIRA complements HBASE-3721 by parallelizing HFile splitting which is
> done in the main thread.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
