Timeseries Aggregation - TAggregator

2014-11-11 Thread Julian Wissmann
Hi, I am pleased to announce the TAggregator [ https://github.com/juwi/HBase-TAggregator]. It is a coprocessor capable of returning an interval based map of aggregates. So far it supports max,min,avg and sum. It can handle timestamps embedded in the key (as integers) or, as an alternative

Re: Timeseries Aggregation - TAggregator

2014-11-11 Thread Stack
Sweet. Thanks for posting notice here Julian. Add TAggregator here http://wiki.apache.org/hadoop/SupportingProjects ? (Make yourself a login and tell me what it is offlist and I'll give you edit rights). Thanks, St.Ack On Tue, Nov 11, 2014 at 5:10 AM, Julian Wissmann julianwissm...@gmail.com

Re: Timeseries Aggregation - TAggregator

2014-11-11 Thread Stack
nvm. I just added it myself. Let me know if you'd like me change description. St.Ack On Tue, Nov 11, 2014 at 7:23 AM, Stack st...@duboce.net wrote: Sweet. Thanks for posting notice here Julian. Add TAggregator here http://wiki.apache.org/hadoop/SupportingProjects ? (Make yourself a login and

Re: Themis : implements cross-row/corss-table transaction on HBase.

2014-11-11 Thread Stack
Thanks for updating the list with the nice Themis updates Jianwei. I added Themis to the powered by list (and the other missing transactions managers, Tephra and Haeinsa). St.Ack On Mon, Nov 10, 2014 at 12:50 AM, 崔建伟 cuijian...@xiaomi.com wrote: Hi everyone: In last few months, we have updated

Re: what can cause RegionTooBusyException?

2014-11-11 Thread Ted Yu
For your first question, region server web UI, rs-status#regionRequestStats, shows Write Request Count. You can monitor the value for the underlying region to see if it receives above-normal writes. Cheers On Mon, Nov 10, 2014 at 4:06 PM, Brian Jeltema bdjelt...@gmail.com wrote: Was the

Re: what can cause RegionTooBusyException?

2014-11-11 Thread Brian Jeltema
Thanks. I appear to have resolved this problem by restarting the HBase Master and the RegionServers that were reporting the failure. Brian On Nov 11, 2014, at 12:13 PM, Ted Yu yuzhih...@gmail.com wrote: For your first question, region server web UI, rs-status#regionRequestStats, shows Write

Re: I'm studying hbase with php, and I wonder getRow guarantee sequential order.

2014-11-11 Thread Michael Segel
Not sure of the question. A scan will return multiple rows in sequential order. Note that its sequential byte stream order. The columns will also be in sequential order as well… So if you have a set of column named as ‘foo’+timestamp then for each column in the set of foo, it will be in

Re: I'm studying hbase with php, and I wonder getRow guarantee sequential order.

2014-11-11 Thread greenblue
Thank you for the reply. It helps me enough! -- View this message in context: http://apache-hbase.679495.n3.nabble.com/I-m-studying-hbase-with-php-and-I-wonder-getRow-guarantee-sequential-order-tp4065833p4065861.html Sent from the HBase User mailing list archive at Nabble.com.

convert hbase Result into an easy-to-parse string

2014-11-11 Thread Jian Feng
I see the 'Result' class has a toString() method. what I need is a serialized form of the object, so that I can process the key values later on. The problem I am trying to solve is that I need to convert the object to a string then transfer this string to Python, and then let Python codes to

Re: convert hbase Result into an easy-to-parse string

2014-11-11 Thread Ted Yu
Currently Result's toString() calls toString() method of each Cell (KeyValue) it contains. KeyValue's toString() method is implemented like this: return keyToString(this.bytes, this.offset + ROW_OFFSET, getKeyLength()) + /vlen= + getValueLength() + /seqid= + seqId; Meaning value is

Re: what can cause RegionTooBusyException?

2014-11-11 Thread Qiang Tian
the checkResource Ted mentioned is a good suspect. see online hbase book 9.7.7.7.1.1. Being Stuck. Did you see below message in your RS log? LOG.info(Waited + (System.currentTimeMillis() - fqe.createTime) + ms on a compaction to clean up 'too many store files'; waited +

Re: what can cause RegionTooBusyException?

2014-11-11 Thread Qiang Tian
or: LOG.warn(Region + region.getRegionNameAsString() + has too many + store files; delaying flush up to + this.blockingWaitTime + ms); sth like: WARN org.apache.hadoop.hbase.regionserver.MemStoreFlusher: Region

RE: Themis : implements cross-row/corss-table transaction on HBase.

2014-11-11 Thread 崔建伟
Hi Stack: Thanks for your concern and work:). I will continue to improve Themis and report the new progress. Best jianwei From: saint@gmail.com saint@gmail.com on behalf of Stack st...@duboce.net Sent: Wednesday, November 12, 2014 12:15 AM To:

Is it possible that HBase update performance is much better than read in YCSB test?

2014-11-11 Thread Liu, Ming (HPIT-GADSC)
Hi, all, I am trying to use YCSB to test on our HBase 0.98.5 instance and got a strange result: update is 6x better than read. It is just an exercise, so the HBase is running in a workstation in standalone mode. I modified the workloada shipped with YCSB into two new workloads: workloadr and

Version in HBase

2014-11-11 Thread Krishna Kalyan
Hi, Is it possible to do a select * from table_name where version = somedate ; using HBase APIs?. (Scanning for values where version = somedate ) Could you please direct me to appropriate links to achieve this?. Regards, Krishna

Re: Version in HBase

2014-11-11 Thread Krishna Kalyan
For Example for table 'test_table', Values inserted are: Row1 - Val1 = t Row1 - Val2 = t + 3 Row1 - Val3 = t + 5 Row2 - Val1 = t Row2 - Val2 = t + 3 Row2 - Val3 = t + 5 on scan 'test_table' where version = t + 4 should return Row1 - Val1 = t + 3 Row2 - Val2 = t + 3 How do i achieve time stamp