Easier configuration of handler executors

Hello folks, Now that priority can be passed with each hbase operation. ( https://issues.apache.org/jira/browse/HBASE-15816). I noticed that setting up handler pools was very cumbersome. I have to implement a new RpcSchedulerFactory and implement a new RpcScheduler. I believe much of this

Re: building hbase with native libraries

. > > This is little different from our current advice to, prior to production > deploy, replace the Hadoop jars packaged in our convenience binary > distribution with the actual version of Hadoop you are running in > production. > > > On Tue, Mar 27, 2018 at 2:37 P

building hbase with native libraries

It seems like the recommended approach is to do this: Build your hbase with against a particular version of hadoop with maven using the -Dhadoop-two.version= Then set your HBASE_LIRBRARY_PATH= $HADOOP_HOME/lib/native/Linux-amd64-64 You could run into problems if you are upgrading your hadoop

Re: [DISCUSS] our stable release pointer and EOM

+1 On Fri, Mar 9, 2018 at 10:38 AM, Stack wrote: > On Thu, Mar 8, 2018 at 6:40 PM, Sean Busbey wrote: > > > Hi folks! > > > > I've been working to get the test suite back to green on branch-1.2; > > we have a lot of branches to track backport for and a

Re: HBaseCon Plans?

I talked to my wife and she gave her blessing to host *HBaseCon - EastBay* at our house in Oakland if we can't find any other venues. On Thu, Feb 8, 2018 at 4:18 AM, Jean-Marc Spaggiari wrote: > So who's jumping in for NY or SF? ;) > > 2018-02-08 4:46 GMT-05:00

Re: [VOTE] The first HBase 1.4.1 release candidate (RC0) is available

+ 1 (non-binding) (1.8.0_152) Startup from tar.gz works Rolling upgrade from 1.4.0 -> 1.4.1 Shell CRUD works Created a test table wrote 1 million rows, split regions and WEB UI displayed correct results, performed scans and random gets, latency and logs look good. checksum okay, built from source

Re: Two master branches?

ust hope that there is no weird > > case-sensitiveness issue which deletes both. > > > > On Mon, Jan 22, 2018 at 11:14 AM, rahul gidwani <rahul.gidw...@gmail.com > > > > wrote: > > > >> I have the same issue that Peter has > >> > >> I ass

Re: Two master branches?

I have the same issue that Peter has I assume the solution is re-clone like ted suggested. On Mon, Jan 22, 2018 at 10:41 AM, Ted Yu wrote: > When I did 'git pull' in workspace for master branch today, I got: > > error: Ref refs/remotes/origin/master is at >

Re: Major Compaction Tool

something in mind for months/years! It's a must to have! Thanks for > taking the task! I like register to the JIRA and come back very soon with > tons of ides and recommendations. You can count on my to test it too! > > JMS > > 2017-12-15 17:44 GMT-05:00 rahul gidwani <ra

Re: Major Compaction Tool

? > > I think you can log a JIRA for upstreaming this tool. > > Thanks > > On Fri, Dec 15, 2017 at 2:01 PM, rahul gidwani <chu...@apache.org> wrote: > > > Hi, > > > > I was wondering if anyone was interested in a manual major compactor > tool. >

Major Compaction Tool

Hi, I was wondering if anyone was interested in a manual major compactor tool. The basic overview of how this tool works is: Parameters: - Table - Stores - ClusterConcurrency - Timestamp So you input a table, desired concurrency and the list of stores you wish to

Re: [DISCUSSION] Merge Backup / Restore - Branch HBASE-7912

Have we considered that if we wanted to do incremental backups for particular table(s), we can just keep track of all the memstore flushes for those table(s) [and add some logic for bulk load as well] and have a cleaner that wont delete those storefiles from archive. Of course we would have to

Re: Allowing clients to set priorities

38 that goes w/ > this work? > > Thanks Rahul, > St.Ack > > On Fri, Apr 22, 2016 at 9:53 AM, rahul gidwani <rahul.gidw...@gmail.com> > wrote: > >> Sure sorry didn't provide a good example. >> >> There are two situations where I have thought this featur

Re: Allowing clients to set priorities

gt;> On Wed, Apr 20, 2016 at 11:21 PM, Stack <st...@duboce.net> wrote: >> >> On Wed, Apr 20, 2016 at 1:47 PM, rahul gidwani <rahul.gidw...@gmail.com> >> wrote: >> >>> I was wondering if people would be interested in allowing the client to >>&

Allowing clients to set priorities

I was wondering if people would be interested in allowing the client to specify priorities? I really think we are good responsible adults and wont abuse this feature. :) This would not just be for one particular operation but all operations. I'll make it feature complete. As for batch

Re: Modify ColumnFamily Procedure

ich operates on a > single family > > Matteo > > > On Wed, Feb 24, 2016 at 10:48 AM, rahul gidwani <rahul.gidw...@gmail.com> > wrote: > > > Now we can do dynamic updates to column family configurations (which is > > awesome!). > > > > If I want to make c

Modify ColumnFamily Procedure

Now we can do dynamic updates to column family configurations (which is awesome!). If I want to make configuration changes to multiple column families for a table, I have to run multiple procedures. The problem with this is on a large cluster you have to reopen all the regions multiple times,

Re: [jira] [Resolved] (HBASE-14036) HBase Backup/Restore Phase 1: Custom WAL archive cleaner

Do you think its time to stop sending files one by one to the cleaners and have all the cleaners take batches of files (like replication and snapshot cleaners)? As we add more cleaners for large clusters and certain scenarios the cleaner chain comes to a crawl? On Fri, Jul 17, 2015 at 3:28 PM,

Re: hbase hdfs snapshots

someone would want to run Map/Reduce over snapshots this could be much faster as we could take an hdfs snapshot and bypass the clone. rahul On Thu, Jul 9, 2015 at 12:20 PM, Matteo Bertozzi theo.berto...@gmail.com wrote: On Thu, Jul 9, 2015 at 12:12 PM, rahul gidwani rahul.gidw...@gmail.com

hbase hdfs snapshots

HBase snapshots are a very useful feature. but it was implemented back before there was the ability to snapshot via HDFS. Newer versions of Hadoop support HDFS snapshots. I was wondering if the community would be interested in something like a Snapshot V3 where we use HDFS to take these

Re: snapshotting key ranges

would manage for you? --- Jesse Yates @jesse_yates jyates.github.com On Thu, Feb 12, 2015 at 9:18 AM, rahul gidwani rahul.gidw...@gmail.com wrote: Before proposing this idea, I would like to state I have recently had a through psychiatric evaluation and I'm

snapshotting key ranges

Before proposing this idea, I would like to state I have recently had a through psychiatric evaluation and I'm not crazy. We here at flurry land have some very large tables on the order of 1PB, 3PB with dfs replication. We wanted to ship this table to another cluster using snapshots. Problem is

[jira] [Created] (HBASE-8806) Row locks are acquired repeatedly in HRegion.doMiniBatchMutation for duplicate rows.

rahul gidwani created HBASE-8806: Summary: Row locks are acquired repeatedly in HRegion.doMiniBatchMutation for duplicate rows. Key: HBASE-8806 URL: https://issues.apache.org/jira/browse/HBASE-8806