Re: Hbase on HDFS versus Cassandra

2016-12-01 Thread Jerry He
> We also discovered that the queuesize is > global (across general/replication/priority queues) and if it reaches the > 1GB limit, calls to all queues will drop. That was interesting because even > though the replication handlers have a different queue, the size is > counted globally, affecting o

Re: Hbase on HDFS versus Cassandra

2016-12-01 Thread Neelesh
Yes, PHOENIX-1718 has about the same information On Dec 1, 2016 1:12 AM, "Ted Yu" wrote: > w.r.t. "Unable to find cached index metadata" error, have you seen this ? > > http://search-hadoop.com/m/Phoenix/9UY0h2YBSOhgbflB1? > subj=Re+Global+Secondary+Index+ERROR+2008+INT10+Unable+ > to+find+cache

Re: Hbase on HDFS versus Cassandra

2016-12-01 Thread Ted Yu
w.r.t. "Unable to find cached index metadata" error, have you seen this ? http://search-hadoop.com/m/Phoenix/9UY0h2YBSOhgbflB1?subj=Re+Global+Secondary+Index+ERROR+2008+INT10+Unable+to+find+cached+index+metadata+PHOENIX+1718+ Cheers On Wednesday, November 30, 2016 11:59 PM, Neelesh wrote:

Re: Hbase on HDFS versus Cassandra

2016-12-01 Thread Neelesh
Ted, we use HDP 2.3.4 (HBase 1.1.2, phoenix 4.4 - but with a lot of backports from later versions) The key of the data table is The two global indexes are and Around 100B rows in the main table. The main issues we see are # Sudden spikes in queueSize - going all the way to 1G limit and stay

Re: Hbase on HDFS versus Cassandra

2016-11-30 Thread Ted Yu
Neelesh:Can you share more details about the sluggish cluster performance (such as version of hbase / phoenix, your schema, region server log snippet, stack traces, etc) ? As hbase / phoenix evolve, I hope the performance keeps getting better for your use case. Cheers On Wednesday, Novembe

RE: Hbase on HDFS versus Cassandra

2016-11-30 Thread Rohit Jain
ig Data to enterprises, and not just a Big Table implementation. Not sure how integrated Cassandra is into that entire eco-system. Rohit -Original Message- From: Neelesh [mailto:neele...@gmail.com] Sent: Wednesday, November 30, 2016 10:08 AM To: user@hbase.apache.org Subject: Re: Hbase on H

Re: Hbase on HDFS versus Cassandra

2016-11-30 Thread Neelesh
We use both, in different capacities. Cassandra is an x-DC archive store with mostly batch writes and occasional key based reads. Hbase is for real-time event ingestion. Our experience so far on hbase + phoenix is that when it works, it is fast and scales like crazy. But if you ever hit a snag arou

Re: Hbase on HDFS versus Cassandra

2016-11-30 Thread Vladimir Rodionov
Mich, this is a wrong group for your question. We are not Cassandra experts either and even if we are - we love HBase more :) -Vlad On Wed, Nov 30, 2016 at 7:02 AM, Mich Talebzadeh wrote: > Hi Guys, > > Used Hbase on HDFS reasonably well. Happy to to stick with it and more with > Hive/Phoenix