Re: [ANNOUNCE] New HBase committer Jingyun Tian

2018-11-13 Thread stack
Welcome jingyun. S On Mon, Nov 12, 2018, 11:54 PM 张铎(Duo Zhang) On behalf of the Apache HBase PMC, I am pleased to announce that Jingyun > Tian has accepted the PMC's invitation to become a committer on the > project. We appreciate all of Jingyun's generous contributions thus far and > look

[ANNOUNCE] Apache HBase 2.1.1 is now available for download

2018-11-01 Thread Stack
The HBase team is happy to announce the immediate availability of Apache HBase 2.1.1. Apache HBase is an open-source, distributed, versioned, non-relational database. Apache HBase gives you low latency random access to billions of rows with millions of columns atop non-specialized hardware. To

Re: What is the best way to return scanner stats to client from co-processor?

2018-10-29 Thread Stack
On Wed, Oct 24, 2018 at 5:29 PM Alex Baranau wrote: > Hi, > > I'd like to return some scanner statistics from co-processor back to the > client. E.g. number of rows filtered out. There isn't a way to add > an arbitrary attributes to Result object, which would be simplest--e.g. I > could do that

Re: HBase REST Client class appears not to be Thread Safe

2018-09-24 Thread Stack
Yeah, looks like it is not written thread-safe. As you suggest, we should note that at the least. You think it possible to make it thread-safe Jon? Is it onerous running multiple clients or a pool of clients? Thanks, M On Mon, Sep 24, 2018 at 11:04 AM Jon Poulton wrote: > I was looking at

Re: [DISCUSS] Separate Git Repository for HBCK2

2018-09-19 Thread Stack
shape here: https://docs.google.com/document/d/1Oun4G3M5fyrM0OxXcCKYF8td0KD7gJQjnU9Ad-2t-uk/edit#heading=h.64hssul3ontj Would appreciate any input here too. Thanks, S On Thu, Aug 2, 2018 at 5:28 PM Stack wrote: > I put up new repo under rubric of > https://issues.apache.org/jira/browse/HBASE

Re: HBase 2.0.1 INCONSISTENT issues

2018-09-11 Thread Stack
n "hole". > > > > Could you give me example how I can fetch or scan section of the table? > > > > Thanks. > > > > > > On Mon, Sep 10, 2018 at 1:53 PM Stack wrote: > > > >> On Mon, Sep 10, 2018 at 1:32 PM Oleg Galitskiy

Re: HBase 2.0.1 INCONSISTENT issues

2018-09-11 Thread Stack
uot;THE START ROW IN THE REGION", LIMIT => 10} Something like the above. S > Thanks. > > > On Mon, Sep 10, 2018 at 1:53 PM Stack wrote: > > > On Mon, Sep 10, 2018 at 1:32 PM Oleg Galitskiy > > > wrote: > > > > > Hello, > > > > >

Re: HBase 2.0.1 INCONSISTENT issues

2018-09-10 Thread Stack
On Mon, Sep 10, 2018 at 1:32 PM Oleg Galitskiy wrote: > Hello, > > Faced with inconsistent issues on HBase 2.0.1: > -- > > ERROR: Region \{ meta => null, hdfs => > > hdfs://master:50001/hbase/data/default/some_table/0646d0bee757d0fb0de1529475b5426f, > deployed => >

[ANNOUNCE] Apache HBase 2.0.2 is now available for download

2018-09-02 Thread stack
The HBase team is happy to announce the immediate availability of HBase 2.0.2. Apache HBase™ is an open-source, distributed, versioned, non-relational database. Apache HBase gives you low latency random access to billions of rows with millions of columns atop non-specialized hardware. To learn

Re: Pictures, Videos and Slides for HBaseConAsia2018

2018-08-31 Thread Stack
On Fri, Aug 31, 2018 at 10:22 AM Chetan Khatri wrote: > Thank you Stack for everything. > > Thanks Chetan but our mighty Yu Li did all the work! S > On Fri, Aug 31, 2018 at 8:18 PM Stack wrote: > > > I blew the cobwebs off our blog and put up a short note on the co

Re: Pictures, Videos and Slides for HBaseConAsia2018

2018-08-31 Thread Stack
I blew the cobwebs off our blog and put up a short note on the conference by Yu Li and myself. See here: https://blogs.apache.org/hbase/ S On Wed, Aug 22, 2018 at 3:03 AM Yu Li wrote: > Hi all, > > HBaseConAsia2018 is successfully held on Aug. 17th in Beijing, China and > please following

Re: hbase logs show the performance of compact isnt good. any suggstion to find out the reason?

2018-08-27 Thread Stack
Hello Lu: Any other environmental or hardware differences between dev and prod? E.g. is the compaction the only thing running on prod? Are there adjacent processes that might be using up i/o or network? Are the machines same in prod as in dev? Also, you compare one compaction on dev to another

Re: AntsDB is released with MySQL compatibility for HBase

2018-08-19 Thread Stack
ple who are familiar with traditional relational > database can adopt HBase/Hadoop stack with ease. > > I’d be very glad if you find the project is useful and your feedback is > very welcome. > > Thanks > -water >

Re: [DISCUSS] Separate Git Repository for HBCK2

2018-08-02 Thread Stack
u > > On 29 July 2018 at 05:57, Stack wrote: > > > I filed HBASE-20969 "Create an hbase-operator-tools repo to host hbck2 > > and later, other toolings". Will create repo in a day or two unless > > objection. > > Thanks, > > S > >

Re: On the number of column families

2018-08-02 Thread Stack
On Thu, Jul 12, 2018 at 4:31 AM Lars Francke wrote: > > I've got a question on the number of column families. I've told everyone > for years that you shouldn't use more than maybe 3-10 column families. > > Our book still says the following: > "HBase currently does not do well with anything above

Re: Ingest performance after upgrade

2018-07-31 Thread Stack
tps://issues.apache.org/jira/browse/HBASE-18469 > > > On 07/26/2018 06:41 PM, Stack wrote: > > On Mon, Jul 23, 2018 at 6:57 AM Austin Heyne wrote: > > > >> Hey all, hopefully this is a simple one. > >> > >> We've migrated from HBase (on s3) 1.3.2 to

Re: [DISCUSS] Separate Git Repository for HBCK2

2018-07-28 Thread Stack
I filed HBASE-20969 "Create an hbase-operator-tools repo to host hbck2 and later, other toolings". Will create repo in a day or two unless objection. Thanks, S On Thu, Jul 19, 2018 at 2:09 PM Umesh Agashe wrote: > > Hi, > > I've had the opportunity to talk about HBCK2 with a few of you. One of

Re: Ingest performance after upgrade

2018-07-26 Thread Stack
On Mon, Jul 23, 2018 at 6:57 AM Austin Heyne wrote: > Hey all, hopefully this is a simple one. > > We've migrated from HBase (on s3) 1.3.2 to 1.4.4, creating a fresh > instance with all our configuration from the previous one with few > changes. However, we're seeing ingest run ~100x slower than

Re: [DISCUSS] Separate Git Repository for HBCK2

2018-07-25 Thread Stack
ese are > not changes that impact source or binary compatibility. They only change > the promises we make going forward about their stability. I believe we can > allow these in new minors, so we could potentially move hbck out in a > 1.5.0. > > > On Mon, Jul 23, 2018 at 4:46 PM Sta

Re: confusing heartbeats.

2018-07-24 Thread Stack
I tried backporting the patch to branch-1. There just a few rejects. Would you be up for creating a backport issue and attaching a version of this patch that fit branch-1? Thanks, S On Thu, Jul 19, 2018 at 10:12 PM Kang Minwoo wrote: > Hello, Users > > Our filter is row key filter. So scan time

Re: [DISCUSS] Separate Git Repository for HBCK2

2018-07-23 Thread Stack
On Thu, Jul 19, 2018 at 2:09 PM Umesh Agashe wrote: > Hi, > > I've had the opportunity to talk about HBCK2 with a few of you. One of the > suggestions is to to have a separate git repository for HBCK2. Lets discuss > about it. > > In the past when bugs were found in hbck, there is no easy way to

Re: HBase 2.0.1 with Hadoop 2.8.4 causes NoSuchMethodException

2018-07-06 Thread Stack
Hey Andrey: Testing 2.0.0, I ran against 2.7.x and 2.8.3. I just went back to my test cluster and upgraded to 2.8.4 and indeed, I see master stuck initializing waiting on the assign of hbase:meta. 2018-07-06 08:39:21,787 INFO [PEWorker-10] procedure.RecoverMetaProcedure: pid=5,

Re: Bulk Load running files multiple times

2018-06-29 Thread Stack
On Thu, Jun 28, 2018 at 1:24 PM Austin Heyne wrote: > Hey again, > > I'm running a bulk load on s3 and I'm seeing region servers being > instructed to load an hfile multiple times. I've seen this behavior two > different ways. The first time I saw this was after deciding to brute > force my way

Re: How to avoid major compaction during restart?

2018-06-29 Thread Stack
Would disabling the hbase balancer soon after startup work for you? S On Thu, Jun 28, 2018 at 12:55 PM Marcell Ortutay wrote: > Hi all, > > I'm interested in ways to avoid a major compaction when restarting all the > HBase region servers in a cluster (for example, for a version upgrade). Are >

[ANNOUNCE] Apache HBase 2.0.1 is now available for download

2018-06-20 Thread stack
HBase 2.0.1 is now available for download. Apache HBase is an open-source, distributed, versioned, non-relational database. Apache HBase gives you low latency random access to billions of rows with millions of columns atop non-specialized hardware. To learn more about HBase, see

Re: [ANNOUNCE] New HBase committer Guangxu Cheng

2018-06-06 Thread Stack
Congratulations Guangxu Cheng! S On Mon, Jun 4, 2018 at 12:00 AM, 张铎(Duo Zhang) wrote: > On behalf of the Apache HBase PMC, I am pleased to announce that Guangxu > Cheng has accepted the PMC's invitation to become a committer on the > project. We appreciate all of Guangxu's generous

Re: AntsDB 18.05.27 is released with TPC-C benchmark and LGPL

2018-06-01 Thread Stack
Thank you. Let me give it a go. S On Fri, Jun 1, 2018 at 8:21 AM, Water Guo wrote: > Hi, S > > Sorry to have you wait. I got some distractions in the past two days. You > can find the steps here http://www.antsdb.com/?p=218 > > Regards, > ~water > > On May

Re: AntsDB 18.05.27 is released with TPC-C benchmark and LGPL

2018-05-29 Thread Stack
On Mon, May 28, 2018 at 12:19 AM, Water Guo wrote: > > > I also conducted a TPC-C benchmark using BenchmarkSQL 4.1.1 from > PostgreSQL community. It shows that AntsDB can handle row lock and > transaction commit/rollback very efficiently. Result is published at >

Re: How to improve HBase read performance.

2018-05-23 Thread Stack
On Wed, May 16, 2018 at 7:30 PM, Kang Minwoo wrote: > Here is information. > > store about 5 billion a day. > 5B logs a day? > size of each log is about 4k. > You store a single log into a single cell? > compression by snappy. > > The log in the hbase cell is

Re: AntsDB is released with MySQL compatibility for HBase

2018-05-08 Thread Stack
Phoenix. While Phoenix is > > building a powerful SQL layer for HBase, we want to focus on backward > > compatibility. We want to have applications built for MySQL can be used > > directly on HBase. And people who are familiar with traditional > relational > > database can adopt HBase/Hadoop stack with ease. > > > > I’d be very glad if you find the project is useful and your feedback is > > very welcome. > > > > Thanks > > -water > > > >

Re: AntsDB is released with MySQL compatibility for HBase

2018-05-07 Thread Stack
; People always ask me how it is different from Phoenix. While Phoenix is > building a powerful SQL layer for HBase, we want to focus on backward > compatibility. We want to have applications built for MySQL can be used > directly on HBase. And people who are familiar with traditional relational >

Re: A RS、DN of machine crash down,then hbase handler be filled,and hbase cluster request rapidly go down

2018-05-02 Thread Stack
On Fri, Apr 27, 2018 at 11:45 PM, Chenxi Tong wrote: > > > Dear all, > > For help, many many thanks to help。 > > Some days ago,our production hbase cluster experience a trouble,about Apr > 23 21:52, a machine suddenly crash down,the regionserver and datanode also > down in

Re: [ANNOUNCE] Apache HBase 2.0.0 is now available for download

2018-04-30 Thread stack
the amended announce to annou...@apache.org. It appears here: https://s.apache.org/hbase-2.0.0-ANNOUNCE. Please use this ANNOUNCE in place of my original going forward. Thanks, Your 2.0.0 RM. On Mon, Apr 30, 2018 at 12:24 PM, stack <st...@apache.org> wrote: > The HBase team is happy to

[ANNOUNCE] Apache HBase 2.0.0 is now available for download

2018-04-30 Thread stack
The HBase team is happy to announce the immediate availability of Apache HBase 2.0.0. Apache HBase™ is the Hadoop database, a distributed, scalable, big data store. To learn more about HBase, see https://hbase.apache.org/. HBase 2.0.0 is our second major release, the first release off the HBase

[ANNOUNCE] Apache HBase 2.0.0-beta-2 is now available for download

2018-03-07 Thread stack
The HBase team is happy to announce the immediate availability of Apache ​HBase​ 2.0.0-beta-2! Apache HBase is an open-source, distributed, versioned, non-relational database. Apache HBase gives you low latency random access to billions of rows with millions of columns atop non-specialized

Re: Region not initializing in 2.0.0-beta-1

2018-02-28 Thread stack
but they are too busy over there. Having tsdb working would be great help testing hbase2. Thanks for help sahil, S On Feb 28, 2018 8:17 AM, "sahil aggarwal" <sahil.ag...@gmail.com> wrote: Stack, It didn't work with zookeeper.version=3.4.10 too. If that's the case then w

Re: Region not initializing in 2.0.0-beta-1

2018-02-28 Thread Stack
Any progress Sahil? There was an issue fixed where we'd write the clusterid with server zk client but then would have trouble picking it up with the new zk read-only client seen in tests and fixed subsequent to beta-1. This looks like it. Thanks for trying the beta. S On Thu, Feb 22, 2018

Re: HbaseTestingUtlity with hbase-shaded-client and hbase-shaded-server

2018-01-24 Thread Stack
r I am not getting the above exception but > getting the exception which I posted in this query > > java.lang.ClassCastException: org.apache.hadoop.hbase.shaded > .org.mortbay.jetty.servlet.Context$SContext cannot be cast to > org.mortbay.jetty.handler.ContextHandler$SContext > at org.mortbay.je

Re: HbaseTestingUtlity with hbase-shaded-client and hbase-shaded-server

2018-01-23 Thread Stack
On Sun, Jan 21, 2018 at 10:33 PM, Debraj Manna wrote: > Hi > > Is the above exception related to the below open issue > https://issues.apache.org/jira/browse/HBASE-15666 ? > > >From the issue, it seems like this combination does not work. You need to use shaded client

[ANNOUNCE] Apache HBase 2.0.0-beta-1 is now available for download

2018-01-16 Thread Stack
The HBase team is happy to announce the immediate availability of Apache ​HBase​ 2.0.0-beta-1! Apache HBase is an open-source, distributed, versioned, non-relational database. Apache HBase gives you low latency random access to billions of rows with millions of columns atop non-specialized

Re: [ANNOUNCE] Please welcome new HBase committer YI Liang

2017-12-20 Thread Stack
Welcome Yi Liang (thanks for the help so far... ) S On Wed, Dec 20, 2017 at 4:06 PM, Jerry He wrote: > On behalf of the Apache HBase PMC, I am pleased to announce that > Yi Liang has accepted the PMC's invitation to become a committer > on the project. > > We appreciate all

Re: HBase increment of a specific cell version

2017-12-19 Thread Stack
On Mon, Dec 18, 2017 at 8:17 PM, Alex Loffler <a...@loffler.org> wrote: > Hi Stack, > > Thanks for the response, I am trying to maintain an hourly count of > messages between two keys/entities: Sender->recipient E.g. a->b > > There are multiple ways of modelling t

Re: HBase increment of a specific cell version

2017-12-18 Thread Stack
Hello Alex. We don't have such an ability. Can you say what the use case is because I at least am having trouble understanding why you would want to do such a thing. Thank you, S On Wed, Dec 13, 2017 at 2:07 PM, Alex Loffler wrote: > Hi Folks, > > I am using the HBase’s

Re: EOL HBase 1.1

2017-12-15 Thread Stack
Thanks Nick for your cool curation of our branch-1. Nice job done, S On Thu, Dec 14, 2017 at 10:25 AM, Nick Dimiduk wrote: > Hello, > > This is for folks who haven't followed our discussions and aren't reading > closely the ANNOUNCE mail. The release line from branch-1.1 is

Re: what is the role of ProtoBuffer while creating of instance of Table/Htable

2017-12-05 Thread Stack
this question is comes > to my mind > > Because order of protobuf jars is different between the two usages? St.Ack > Thanks > Manjeet Singh > > -- Forwarded message -- > From: Stack <st...@duboce.net> > Date: Tue, Dec 5, 2017 at 3:36 AM > Subject: R

Re: what is the role of ProtoBuffer while creating of instance of Table/Htable

2017-12-04 Thread Stack
HBase uses pb2.5.0. Is it an incompatibility between 2.4.1 and 2.5.0 pb? If you look at classpath, is your projects 2.4.1 pb jar coming ahead of the hbase pb jar? Thanks, S On Sun, Dec 3, 2017 at 10:52 AM, Manjeet Singh wrote: > Hi All, > > I am facing one issue

Re: OutOfMemoryError: Direct buffer memory on PUT

2017-11-08 Thread Stack
9215. Good one. S > On Wed, Nov 8, 2017 at 4:05 PM, Daniel Jeliński <djelins...@gmail.com> > wrote: > > > 2017-11-07 18:22 GMT+01:00 Stack <st...@duboce.net>: > > > > > On Mon, Nov 6, 2017 at 6:33 AM, Daniel Jeliński <djelins...@gmai

Re: OutOfMemoryError: Direct buffer memory on PUT

2017-11-07 Thread Stack
On Mon, Nov 6, 2017 at 6:33 AM, Daniel Jeliński wrote: > For others that run into similar issue, it turned out that the > OutOfMemoryError was thrown (and subsequently hidden) on the client side. > The error was caused by excessive direct memory usage in Java NIO's >

Re: [ANNOUNCE] New HBase committer Zheng Hu

2017-10-23 Thread Stack
Welcome Zheng Hu! S On Sun, Oct 22, 2017 at 11:18 PM, Duo Zhang wrote: > On behalf of the Apache HBase PMC, I am pleased to announce that Zheng Hu > has accepted the PMC's invitation to become a committer on the project. We > appreciate all of Zheng's generous contributions

To those who commented on the hbase refguide back in 2012...

2017-10-06 Thread Stack
I know, it was just one or two of you, but FYI, We used disqus to catch comments on the old docbook refguide. It turns out disqus had a compromise of a database from 2012 [1]. For those of you who left a comment back then, your login may have been exposed. The disqus site says: Potential Impact

Re: Sidelining HFiles

2017-10-04 Thread Stack
On Wed, Oct 4, 2017 at 9:59 AM, alwin james wrote: > Hi HBasers - > > Does sidelining of corrupted HFiles means the data lose? > If so, is there any tool/mechanism to retrieve as much data as possible > from a corrupted HFile? > > See

Re: Hbase regionserver heap occupancy because of MSLAB

2017-10-04 Thread Stack
On Wed, Oct 4, 2017 at 9:42 AM, Subash Kunjupillai wrote: > As sited in HBase Doc > -cdh5.1.3/book/regions.arch.html#too_many_regions> > , I understand that MSLAB of each memstore will occupy 2MB(default) of

Re: Welcome Chia-Ping Tsai to the HBase PMC

2017-09-29 Thread Stack
Welcome Chia-Ping. Keep up the great work. S On Fri, Sep 29, 2017 at 3:19 PM, Misty Stanley-Jones wrote: > The HBase PMC is delighted to announce that Chia-Ping Tsai has agreed to > join > the HBase PMC, and help to make the project run smoothly. Chia-Ping became > an > HBase

Re: Please congratulate our new PMC Chair Misty Stanley-Jones

2017-09-21 Thread Stack
Misty! On Thu, Sep 21, 2017 at 12:08 PM, Andrew Purtell wrote: > At today's meeting of the Board, Special Resolution B changing the HBase > project Chair to Misty Stanley-Jones was passed unanimously. > > Please join me in congratulating Misty on her new role! > > ​(If you

Re: HBaseCon Update (CfP closes Monday)

2017-09-05 Thread Stack
On Mon, Sep 4, 2017 at 12:09 PM, Kahlil Oppenheimer < kahliloppenhei...@gmail.com> wrote: > Hey Stack, > > I hope all is well! > > I just wanted to follow up here to see if there was any update on the > videos of the presentations being posted. I'd love to re-watch som

Re: “Could not find or load main class” when running with systemctl

2017-08-31 Thread Stack
e size(512 bytes, -p) 8 > POSIX message queues (bytes, -q) 819200 > real-time priority (-r) 0 > stack size (kbytes, -s) 8192 > cpu time (seconds, -t) unlimited > max user processes (-u) 65536 > virtual memory (

Re: “Could not find or load main class” when running with systemctl

2017-08-31 Thread Stack
On Wed, Aug 30, 2017 at 3:14 AM, Alexandr Porunov < alexandr.poru...@gmail.com> wrote: > Hello, > > I am trying to run hbase 1.3.1 with systemctl on fedora 26 but without > success. > > If I execute `/usr/lib/hbase/bin/start-hbase.sh` it starts just fine. > But I need to write systemctl wrapper

Re: Folly not installed

2017-08-29 Thread Stack
es it have too many holes still? Should they wait? St.Ack > Cheers > > On Tue, Aug 29, 2017 at 8:44 AM, Stack <st...@duboce.net> wrote: > > > On Tue, Aug 29, 2017 at 7:01 AM, Ted Yu <yuzhih...@gmail.com> wrote: > > > > > You can follow the structure of sim

Re: Folly not installed

2017-08-29 Thread Stack
On Tue, Aug 29, 2017 at 7:01 AM, Ted Yu wrote: > You can follow the structure of simple-client to create your own program. > > bq. it is possible compiling my own program without docker and buck? > > You can use make. > > bq. it is problem with includes > > Folly is used

[ANNOUNCE] Apache HBase 2.0.0-alpha-2 is now available for download

2017-08-21 Thread Stack
The HBase team is happy to announce the immediate availability of Apache HBase 2.0.0-alpha-2. Apache HBase is an open-source, distributed, versioned, non-relational database. Apache HBase gives you low latency random access to billions of rows with millions of columns atop non-specialized

hbaseconasia2017 slides and a few phtotos

2017-08-07 Thread Stack
We had a nice day out in Shenzhen at HBaseCon Asia last friday [0] (August 4th). There were a bunch of great talks [1] by the likes of jd.com, huawei, xiaomi, alibaba and others. Those given in Chinese had best attendance. A good few folks graciously had slides in English for the language-dumb

Re: [DISCUSS] Planning changes on RegionServer totalRequestCount metrics

2017-08-04 Thread stack
+1 We need a fat release note on this change so operators can quickly learn why traffic went down on upgrade. S On Aug 3, 2017 14:49, "Yu Li" wrote: > Dear all, > > Recently in HBASE-18469 > > we found some inconsistency

HBaseCon Asia 2017 is on this Friday, August 4th in Shenzhen

2017-08-02 Thread Stack
See the home page for the nice-looking agenda; scroll down the page at hbasecon.com Yours, St.Ack On Tue, Jun 6, 2017 at 11:07 PM, Bijieshan wrote: > HBaseCon Asia 2017 Registration is now open. The below is the registration > site: >

Re: [ANNOUNCE] Asynchronous client is available in HBase 2.0

2017-07-21 Thread Stack
ting even if 'obvious' (uses less resources/threads, more throughput?). Good one lads, St.Ack > Thanks, > Phil > > > 2017-07-21 6:15 GMT+08:00 Stack <st...@duboce.net>: > > > Very sweet Guanghao. Thanks for all the hard work (you, Duo and all who > > contribut

Re: [ANNOUNCE] Asynchronous client is available in HBase 2.0

2017-07-20 Thread Stack
Very sweet Guanghao. Thanks for all the hard work (you, Duo and all who contributed to the async work). When you think we should move the sync client to be on top of the async chassis? Thanks, St.Ack P.S. It looks like you updated its status in this doc,

Re: HBase Application Archetypes Redux

2017-07-14 Thread Stack
t; wrote: > > > Could we syndicate to the project blog before adding to the ref guide? > > > > On Jul 13, 2017 3:44 AM, "stack" <saint@gmail.com> wrote: > > > > Thanks Robert. Ok if we add pointer in refguide? > > S > > > > On

Re: HBase Application Archetypes Redux

2017-07-13 Thread stack
Thanks Robert. Ok if we add pointer in refguide? S On Jul 12, 2017 4:14 PM, "Robert Yokota" wrote: > In case anyone is interested, I wrote a blog revisiting the HBase > application archetypes as presented by Lars George and Jonathan Hsieh: > >

Re: Problem during hbase read

2017-07-05 Thread Stack
(What version of hbase?) Unfortunately the exception does not print the file name. Can you figure which file or region it is? Could try reading content w/ hfile tool to see if it complains also. Problem is: On-disk size without header provided is 36901, but block header contains 859321901.

Re: HBaseCon Update (CfP closes Monday)

2017-06-26 Thread Stack
On Mon, Jun 26, 2017 at 6:38 AM, Kahlil Oppenheimer < kahliloppenhei...@gmail.com> wrote: > These look awesome, Stack! Do you know if videos of the presentations will > go up at some point as well? > > They are coming Kahlil. They take a bit of time. I'll post notice here wh

Re: removing cells in minor compaction

2017-06-23 Thread Stack
(Disclaimer: my previous message did not involve verification in code or turning up test cases to prove my assertions. For example, the documentation claims that we retain versions beyond the max configured when we do minor compactions but I do not see in code how that is done. Perhaps this is how

Re: removing cells in minor compaction

2017-06-23 Thread Stack
On Wed, Jun 14, 2017 at 5:51 PM, Dave Latham wrote: > What cells, if any, are removed during minor compactions? > > Cells that > (a) are beyond the TTL? > (b) are shadowed by a delete marker? (from the files compacted) > (c) are shadowed by newer versions? (assuming

Re: HBaseCon Update (CfP closes Monday)

2017-06-22 Thread Stack
On Wed, Jun 21, 2017 at 11:11 PM, Phil Yang <ud1...@gmail.com> wrote: > Hi Stack > It seems there are only 21 slides here but we have 24 talks totally? > > Thanks Phil. AMZ and G don't want their slides posted. I didn't bother posting the housekeeping slides. S > Thanks,

Re: HBaseCon Update (CfP closes Monday)

2017-06-20 Thread Stack
Slides from last weeks hbasecon2017 are up and available here: https://www.slideshare.net/search/slideshow?searchfrom=header=hbasecon2017 Enjoy, HBaseCon Program Committee On Thu, Apr 20, 2017 at 10:57 AM, Stack <st...@duboce.net> wrote: > A few things. > > 1. CfP closes Monday.

Re: [ANNOUNCE] New HBase committer Allan Yang

2017-06-08 Thread Stack
Hurray! On Thu, Jun 8, 2017 at 8:49 PM, Yu Li wrote: > On behalf of the Apache HBase PMC, I am pleased to announce that Allan Yang > has accepted the PMC's invitation to become a committer on the > project. We appreciate all of Allan's generous contributions thus far and >

Re: What is the cause for RegionTooBusyException?

2017-05-26 Thread Stack
Please. Would appreciate your input Jeff. Thanks, St.Ack > Jeff > > > From: saint@gmail.com <saint@gmail.com> on behalf of Stack < > st...@duboce.net> > Sent: Friday, May 26, 2017 12:05:36 AM > To: Hbase-User > Subject:

Re: What is the cause for RegionTooBusyException?

2017-05-26 Thread Stack
On Mon, May 22, 2017 at 9:31 AM, jeff saremi wrote: > while I'm still trying to find anything useful in the logs, my question is > why isn't HBase self managing this? > It should do better here, yes (I thought TooBusy retried but I am not finding it at the mo.).

HBaseCon Update (CfP closes Monday)

2017-04-20 Thread Stack
A few things. 1. CfP closes Monday. Get those talks in [1]! 2. Registration is full; we are working on opening the 'waiting list' (if you are registered and do not think you can come, please give up your spot for another). Please check back on the hbasecon website in next day or so [2]. 3. In

Re: [DISCUSS] Status of the 0.98 release line

2017-04-10 Thread Stack
I agree we should EOL 0.98. St.Ack On Mon, Apr 10, 2017 at 11:43 AM, Andrew Purtell wrote: > Please speak up if it is incorrect to interpret the lack of responses as > indicating consensus on declaring 0.98 EOL. > > I believe we should declare 0.98 EOL. > > > On Wed, Mar

ANNOUNCE: User- and Dev-views on coming hbase-2.0.0 In-Memory Compaction Feature ("Accordion").

2017-04-09 Thread Stack
We just posted a nice user- [1] and dev-view [2] on the "Accordion", the In-Memory Compaction feature that is coming in hbase-2.0.0 written by our Sisters and Brother at Yahoo! Research. Check 'em out, St.Ack 1. https://blogs.apache.org/hbase/entry/accordion-hbase-breathes-with-in 2.

Re: How to healthcheck a regionserver

2017-04-04 Thread Stack
See http://hbase.apache.org/book.html#_canary. It has lots of options and is used by various monitoring health of nodes in a cluster. St.Ack On Wed, Mar 29, 2017 at 9:57 PM, jeff saremi wrote: > We have our region servers assigned by Yarn and occasionally we get a >

Re: HBase as a file repository

2017-04-04 Thread Stack
On Thu, Mar 30, 2017 at 9:25 PM, Daniel Jeliński wrote: > Thank you Ted for your response. > > I have read that part of HBase book. It never explained why objects over > 10MB are no good, and did not suggest an alternative storage medium for > these. > > Thats a hole. I

Re: HBase as a file repository

2017-04-04 Thread Stack
On Thu, Mar 30, 2017 at 1:01 PM, Daniel Jeliński wrote: > ... > Now. HBase Get in Java API is an atomic operation in the sense that it does > not complete until all data is retrieved from the server. It takes 100 ms > to retrieve a 1MB cell (file), and only after retrieving

Re: Updated Code of Conduct

2017-04-01 Thread Stack
On Fri, Mar 31, 2017 at 3:11 PM, Misty Stanley-Jones wrote: > All, > > We have updated the Code of Conduct to be a little more explicit about > how much we value diversity in the HBase project, and to ask for your > feedback on how we can improve. Your feedback is ALWAYS

HBaseCon2017 Registration is now Open!

2017-03-28 Thread stack
The HBaseCon West 2017 registration website is up [1]. Registration is no-charge (Courtesy of our gracious hosts). Space is limited so be sure to register early (This means YOU!, the HBase Community). Note, HBaseCon will be in Mountain View @ Google, NOT in San Francisco, on June 12th (The day

Re: Unable to get coprocessor debug logs in regionserver.

2017-03-20 Thread Stack
Your code is in the default package. Try setting it into the org.apache.hadoop.hbase package (or amending log4j.properties) to add INFO logging on whatever your package is). St.Ack On Mon, Mar 20, 2017 at 7:16 AM, Sreeram wrote: > Hi, > > I am writing a coprocessor for

Re: how to optimize for heavy writes scenario

2017-03-17 Thread Stack
On Fri, Mar 17, 2017 at 9:31 AM, Hef wrote: > Hi group, > I'm using HBase to store large amount of time series data, the usage case > is heavy on writes then reads. My application stops at writing 600k > requests per second and I can't tune up for better tps. > > Hardware:

Re: Why are work in progress in HBase 2.0 to reduce its dependency on ZooKeeper?

2017-03-14 Thread Stack
On Tue, Mar 14, 2017 at 4:28 AM, Kang Minwoo wrote: > Hi, I am Minwoo. > > I am interesting in HBase Architecture. > So I read Architecting HBase Applications. > > In the book, HBase 2.0 is work in progress to reduce its dependency on > ZooKeeper. > > I want to the

NOTICE: Nice testimony on benefits of the offheap read-path work now up on our blog

2017-03-08 Thread Stack
See writeup on how work done by your Yu Li, Sun Yu, Anoop Sam John, and Ramkrishna S Vasudevan improved throughput at scale on Singles Day 2016 @ Alibaba. Read all about it at https://blogs.apache.org/hbase/ Yours, St.Ack

Re: Don't Settle for Eventual Consistency

2017-03-04 Thread Stack
On Tue, Feb 21, 2017 at 3:24 AM, Edward Capriolo wrote: > On Mon, Feb 20, 2017 at 9:29 PM, Edward Capriolo > wrote: > ... > What happened to those 5 9s? > Academic paper and blog deploys vs actual production? (Hey Ed). Thanks for posting Robert,

Re: The complete list of metrics

2017-03-03 Thread Stack
On Fri, Mar 3, 2017 at 8:00 PM, Sean Busbey wrote: > Jeff, > > Check out the section on discovering metrics: > > http://hbase.apache.org/book.html#discovering.available.metrics > > In particular, it gives you the URL to use with teh JMX endpoint Yu > mentioned to get the

Re: Region Server Hotspot/CPU Problem

2017-03-02 Thread Stack
Could try CMS GC; the thread local collection is less prominent when CMS is in place it seems (Try thread dumping and comparing to thread dumps posted to HBASE-17072 and related issues; the original poster did a nice job describing the problem). St.Ack On Wed, Mar 1, 2017 at 2:49 PM, Saad Mufti

Re: Need guidance on getting detailed elapsed times in every stage of processing a request

2017-03-02 Thread Stack
gt; up again > > ____ > From: saint@gmail.com <saint@gmail.com> on behalf of Stack < > st...@duboce.net> > Sent: Thursday, March 2, 2017 12:17:35 PM > To: Hbase-User > Subject: Re: Need guidance on getting detailed elapsed times in every &g

Re: Need guidance on getting detailed elapsed times in every stage of processing a request

2017-03-02 Thread Stack
HBase/HTrace integration once worked but has long since rotted. Refactorings of internals without proper respect for trace connections is the main culprit. Updates in htrace and hdfs that need attention reconnecting spans, etc., is another. On top of this, zipkin project has seen a burst of effort

CfP HBaseCon2017, June 12th, 2017 in San Francisco

2017-02-18 Thread stack
imiduk, icebrg.io - 张铎, Xiaomi - Michael Stack, Cloudera Venue The conference will be held in San Francisco (details to follow). Contact All questions about submissions should be emailed to st...@apache.org Thanks, St.Ack 1. Submission link: https://easychair.org/conferences/?conf=hbasecon2017

Re: Doubt

2017-02-13 Thread Stack
You might consider adding list of issues and solutions to the hbase reference guide? Yours, S On Fri, Feb 10, 2017 at 1:34 AM, gaurhari dass wrote: > Hi , > > I always follow problems users facing with hbase and solutions provided. > > these problems and solutions are

Re: SocketTimeoutException on regionservers

2017-01-16 Thread Stack
Timeout after waiting ten seconds to read from HDFS is no fun. Tell us more about your HDFS setup. You collect system metrics on disks? Machines are healthy all around? How frequent does this occur? Thanks for the question, S On Thu, Jan 12, 2017 at 10:18 AM, Tulasi Paradarami <

Re: RPC calls in hbase

2017-01-05 Thread Stack
nt of regions. Suggest you do some background reading and study your cluster while under load looking at resource usage, metrics, logs and the usual suspects. St.Ack > On Thu, Jan 5, 2017 at 3:27 AM, Stack <st...@duboce.net> wrote: > > > (Thanks for jumping in Billy) > > &g

Re: RPC calls in hbase

2017-01-04 Thread Stack
/rowkey.design.html > > William Watson > Lead Software Engineer > > On Wed, Jan 4, 2017 at 1:41 AM, Rajeshkumar J <rajeshkumarit8...@gmail.com > > > wrote: > > > Hi Stack, > > > >Yes it worked. I had a serious doubt regarding lease does not ex

Re: RPC calls in hbase

2017-01-03 Thread Stack
Yeah. Try it. S On Tue, Jan 3, 2017 at 9:18 PM, Rajeshkumar J <rajeshkumarit8...@gmail.com> wrote: > So I need to add property in log4j.properties as below > > log4j.logger.org.apache.hadoop.hbase.ipc.RpcServer = TRACE > > On Wed, Jan 4, 2017 at 10:23 AM, Stack <

Re: RPC calls in hbase

2017-01-03 Thread Stack
gt; > On Wed, Jan 4, 2017 at 2:12 AM, Stack <st...@duboce.net> wrote: > > > On Mon, Jan 2, 2017 at 10:32 PM, Rajeshkumar J < > > rajeshkumarit8...@gmail.com> > > wrote: > > > > > Do all rpc calls are logged in hbase region server log? A

<    1   2   3   4   5   6   7   8   9   10   >