Re: Sources Of HBase Client Side Latency

2016-04-19 Thread Neelesh
We have very similar issues with HBase 1.1.2, especially around splits. It takes several minutes at times. We use phoenix with two global indexes and we know that compounds the issue a bit, but about 95% of inserts take < 50ms (with index writes included), but the remaining 5% are wild from 100ms t

Re: Hbase on HDFS versus Cassandra

2016-11-30 Thread Neelesh
We use both, in different capacities. Cassandra is an x-DC archive store with mostly batch writes and occasional key based reads. Hbase is for real-time event ingestion. Our experience so far on hbase + phoenix is that when it works, it is fast and scales like crazy. But if you ever hit a snag arou

Re: Hbase on HDFS versus Cassandra

2016-12-01 Thread Neelesh
Our challenge has been to understand what's HBase doing under various scenarios. We monitor call queue lengths, sizes and latencies as the primary alerting mechanism to tell us something is going on with HBase. Thanks! -neelesh On Wed, Nov 30, 2016 at 1:15 PM, Ted Yu wrote: > Neelesh:Can y

Re: Hbase on HDFS versus Cassandra

2016-12-01 Thread Neelesh
ROR+2008+INT10+Unable+ > to+find+cached+index+metadata+PHOENIX+1718+ > > Cheers > > > On Wednesday, November 30, 2016 11:59 PM, Neelesh > wrote: > > > Ted, > we use HDP 2.3.4 (HBase 1.1.2, phoenix 4.4 - but with a lot of backports > from later versions) > > T

Incremental snapshot export

2017-01-18 Thread Neelesh
ExportSnapshot to optionally skip copying HFiles if it already exists, given that HFiles in the context of snapshots are immutable. Thanks! -neelesh

Re: Incremental snapshot export

2017-01-18 Thread Neelesh
ved this problem. > > Cheers > > On Wed, Jan 18, 2017 at 9:04 AM, Neelesh wrote: > > > Hi, > > Does the ExportSnapshot utility incrementally export HFiles ? From the > > code, it looks like I can specify an overwrite flag to delete and > recreate > > t