[
https://issues.apache.org/jira/browse/HBASE-1050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thibaut updated HBASE-1050:
---------------------------
I think this one is hitting me as well on a regulary basis (and might also be
the cause of the hangups I'm experiencing)
I have a thread that is constantly adding new data to a table. This table is
also scanned regularly (every 30 minutes, but the job currently takes longer)
and parts of the rows are overwritten with new data, so lots of region splits
could happen in the meantime.
I also had bad blocks in my DFS yesterday, allthough dfs did report a healthy
state. When I restarted hbase. hbase never came up (there was a missing block
in the rootfile)
> Allow regions to split around scanners
> --------------------------------------
>
> Key: HBASE-1050
> URL: https://issues.apache.org/jira/browse/HBASE-1050
> Project: Hadoop HBase
> Issue Type: Improvement
> Components: client, regionserver
> Reporter: Andrew Purtell
> Assignee: Andrew Purtell
> Priority: Blocker
> Fix For: 0.20.0
>
>
> We have a number of scanners iterating over a table that also sees a lot of
> constant write activity. If the scans are too frequent we will suppress
> splitting. At a lull then a number of splits happen all at once, occasionally
> overwhelming DFS and causing file corruption.
> I wonder how much work it would be to split regions around scanners. Rather
> than wait for scanner leases to expire, suspend/block the scanner, split the
> table, and then negotiate with the client to continue.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
