Re: hbase.bucketcache.percentage.in.combinedcache with ioengine= on HBase 0.98

2015-10-07 Thread Nick Dimiduk
I compared "offheap" vs file:tmpfs in the "showdown" blog post I linked previously. For that test, they were comparable. Configuring MaxDirectMemory is only required for "offheap", not the other configurations. In fact, if you use both tmpfs and MaxDirectMemory, you'll probably run out of memory

Re: Minor compacts seem blocked on major compacts

2015-10-07 Thread Ted Yu
Have you seen the following code ? ThreadPoolExecutor pool = (selectNow && s.throttleCompaction(compaction.getRequest().getSize())) ? longCompactions : shortCompactions; Looks like throttleCompaction() returned false. Please see the following method in RatioBasedCompactionPolicy :

Re: Introducing Project S2Graph

2015-10-07 Thread Nick Dimiduk
Very cool, thanks for posting Doyung Yoon! On Wed, Oct 7, 2015 at 10:57 AM, DO YUNG YOON wrote: > Hello Forks. > > I want to introduce an open-source distributed graph database s2graph on > HBase. > > Here is the github repository and presentations that describe how s2graph >

Re: Bucket cache causes region server status page to use 1GB ram

2015-10-07 Thread Ted Yu
bq. which seems of limited use to me Agree. Mind logging an improvement JIRA ? Cheers On Wed, Oct 7, 2015 at 12:00 PM, James Hartshorn wrote: > Since we started using the HBase bucket cache I've noticed the region > server status pages not loading completely in

Aw: Re: double keys major_compaction -

2015-10-07 Thread Hansi Klose
Hi, I could get rid of the key's. I made yesterday a rolling restart of the whole cluster. After that i did a flush 't1' major_compact 't1' The keys with the old timestamp are not present anymore. Regards > Gesendet: Freitag, 02. Oktober 2015 um 15:38 Uhr > Von: "Ted Yu"

Asking about the trend of increasing latency, hbase spike

2015-10-07 Thread UI-JIN LIM
Hi. This is Ui Jin, Lim in Korea, LG CNS We had setup and are operating hbase 0.98.13 on our customer, iptv Company. Our customer claim about this spike. Following is our status. . We had been operating with BlockCache(heap) for 3 months. The ratio of above 100ms has been reached 6.69% of total

Re: Introducing Project S2Graph

2015-10-07 Thread Stack
Thanks for posting Do Yung Yoon. St.Ack On Wed, Oct 7, 2015 at 10:57 AM, DO YUNG YOON wrote: > Hello Forks. > > I want to introduce an open-source distributed graph database s2graph on > HBase. > > Here is the github repository and presentations that describe how s2graph >

Bucket cache causes region server status page to use 1GB ram

2015-10-07 Thread James Hartshorn
Since we started using the HBase bucket cache I've noticed the region server status pages not loading completely in Chrome, and causing significant performance problems on Firefox. After some investigation I realized the page itself is huge: wc -l HBase-Region-Server-hb22.html 2010116

Introducing Project S2Graph

2015-10-07 Thread DO YUNG YOON
Hello Forks. I want to introduce an open-source distributed graph database s2graph on HBase. Here is the github repository and presentations that describe how s2graph store data as property graph model and production usecases. github: https://github.com/kakao/s2graph presentation: 1.

Re: Minor compacts seem blocked on major compacts

2015-10-07 Thread Randy Fox
Looking at the source I don’t see how a manual major compact could get in the large compaction pool: If selectNow Is True the pool selector has to be shortCompactions. From the logs it sure seems that selectNow has to be true, else it would have logged “system” instead of

Re: Hbase to Qlik Sense

2015-10-07 Thread Siva
Hi Ted, Thanks for your response. Qlik does not support JDBC and have challenges reading from hbase, there are few connectors available like Simba which uses rest api. So wanted to check with the community if any one ran into similar situation and what are takes on connectors/phoenix to hbase in