Re: Major Compaction Tool

Hi, We wrote something similar. It just triggers major compaction with given parallelism and distribute it across the cluster. https://github.com/flipkart-incubator/hbase-compactor On Dec 16, 2017 10:01 AM, "Jean-Marc Spaggiari" wrote: Rahul, I had something in mind

Re: Major Compaction Tool

Rahul, I had something in mind for months/years! It's a must to have! Thanks for taking the task! I like register to the JIRA and come back very soon with tons of ides and recommendations. You can count on my to test it too! JMS 2017-12-15 17:44 GMT-05:00 rahul gidwani

Re: Major Compaction Tool

The tool creates a Map of servers to CompactionRequests needing to be performed. You always select the server with the largest queue (*which is not currently compacting) *to compact next. I created a JIRA: HBASE-19528 for this tool. On Fri, Dec 15, 2017 at 2:35 PM, Ted Yu

[jira] [Created] (HBASE-19530) New regions should always be added with state CLOSED

Appy created HBASE-19530: Summary: New regions should always be added with state CLOSED Key: HBASE-19530 URL: https://issues.apache.org/jira/browse/HBASE-19530 Project: HBase Issue Type: Bug

[jira] [Created] (HBASE-19529) Handle null states in AM

Appy created HBASE-19529: Summary: Handle null states in AM Key: HBASE-19529 URL: https://issues.apache.org/jira/browse/HBASE-19529 Project: HBase Issue Type: Bug Reporter: Appy >From

Re: Major Compaction Tool

bq. with at most N distinct RegionServers compacting at a given time If per table balancing is not on, the regions for the underlying table may not be evenly distributed across the cluster. In that case, how would the tool which servers to perform compaction ? I think you can log a JIRA for

[jira] [Created] (HBASE-19528) Major Compaction Tool

churro morales created HBASE-19528: -- Summary: Major Compaction Tool Key: HBASE-19528 URL: https://issues.apache.org/jira/browse/HBASE-19528 Project: HBase Issue Type: New Feature

Re:Major Compaction Tool

Hi Rahul, That sounds like a very useful tool. It would be a good extension to the pedagogy I point folks to for scheduled HBase major compactions via Oozie (which just does a naive asynchronous table-wide major compaction today): https://github.com/cbaenziger/Oozie_MajorCompaction_Example

Major Compaction Tool

Hi, I was wondering if anyone was interested in a manual major compactor tool. The basic overview of how this tool works is: Parameters: - Table - Stores - ClusterConcurrency - Timestamp So you input a table, desired concurrency and the list of stores you wish to

[jira] [Created] (HBASE-19527) Make ExecutorService threads daemon=true.

stack created HBASE-19527: - Summary: Make ExecutorService threads daemon=true. Key: HBASE-19527 URL: https://issues.apache.org/jira/browse/HBASE-19527 Project: HBase Issue Type: Bug

[jira] [Resolved] (HBASE-19272) Deal with HBCK tests disabled by HBASE-14614 AMv2 when HBCK works again...

[ https://issues.apache.org/jira/browse/HBASE-19272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-19272. --- Resolution: Fixed Assignee: stack I pushed .001 to branch-2 and master. It just removes the named

[jira] [Created] (HBASE-19526) Update hadoop version to 3.0 GA

Mike Drob created HBASE-19526: - Summary: Update hadoop version to 3.0 GA Key: HBASE-19526 URL: https://issues.apache.org/jira/browse/HBASE-19526 Project: HBase Issue Type: Task

Re: EOL HBase 1.1

Thanks Nick for your cool curation of our branch-1. Nice job done, S On Thu, Dec 14, 2017 at 10:25 AM, Nick Dimiduk wrote: > Hello, > > This is for folks who haven't followed our discussions and aren't reading > closely the ANNOUNCE mail. The release line from branch-1.1 is

[jira] [Resolved] (HBASE-18110) [AMv2] Reenable tests temporarily disabled

[ https://issues.apache.org/jira/browse/HBASE-18110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HBASE-18110. --- Resolution: Fixed Resolving as done. Accounting of all tests disabled has them all onlined again unless

[jira] [Created] (HBASE-19525) RS side changes for moving peer modication from zk watcher to procedure

Duo Zhang created HBASE-19525: - Summary: RS side changes for moving peer modication from zk watcher to procedure Key: HBASE-19525 URL: https://issues.apache.org/jira/browse/HBASE-19525 Project: HBase

[jira] [Created] (HBASE-19524) Master side changes for moving peer modification from zk watcher to procedure

Duo Zhang created HBASE-19524: - Summary: Master side changes for moving peer modification from zk watcher to procedure Key: HBASE-19524 URL: https://issues.apache.org/jira/browse/HBASE-19524 Project:

[jira] [Resolved] (HBASE-14790) Implement a new DFSOutputStream for logging WAL only

[ https://issues.apache.org/jira/browse/HBASE-14790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang resolved HBASE-14790. --- Resolution: Fixed More than two years, finally we are done! Thanks all who helping on this new

[jira] [Created] (HBASE-19523) TestLogRolling is flakey

Duo Zhang created HBASE-19523: - Summary: TestLogRolling is flakey Key: HBASE-19523 URL: https://issues.apache.org/jira/browse/HBASE-19523 Project: HBase Issue Type: Bug Components:

[jira] [Created] (HBASE-19522) The complete order is wrong in AsyncBufferedMutatorImpl

Guanghao Zhang created HBASE-19522: -- Summary: The complete order is wrong in AsyncBufferedMutatorImpl Key: HBASE-19522 URL: https://issues.apache.org/jira/browse/HBASE-19522 Project: HBase

Re: EOL HBase 1.1

Thanks for all the great work as branch-1.1 RM sir, it's definitely a successful release line! Best Regards, Yu On 15 December 2017 at 02:25, Nick Dimiduk wrote: > Hello, > > This is for folks who haven't followed our discussions and aren't reading > closely the ANNOUNCE