Re: [ANNOUNCE] Apache HBase 1.3.1 is now available for download

tag rel/1.3.1 has been pushed. On Sun, Apr 23, 2017 at 3:22 AM, Mikhail Antonov <olorinb...@gmail.com> wrote: > Pushing release tag is a step I tend to forget :( Thanks for the ping! > Will push the tag tomorrow. > > -Mikhail > > On Fri, Apr 21, 2017 at 9:26 PM, lars ho

Re: [ANNOUNCE] Apache HBase 1.3.1 is now available for download

Pushing release tag is a step I tend to forget :( Thanks for the ping! Will push the tag tomorrow. -Mikhail On Fri, Apr 21, 2017 at 9:26 PM, lars hofhansl <la...@apache.org> wrote: > Hi Mikhail, > > I don't see a 1.3.1 tag, yet. > > Thanks. > > -- Lars > >

Re: ANNOUNCE: Yu Li joins the Apache HBase PMC

Congratulations Yu! -Mikhail On Sat, Apr 15, 2017 at 12:44 PM, Nick Dimiduk wrote: > Congratulations Yu and thanks a lot! Keep up the good work! > > On Fri, Apr 14, 2017 at 7:22 AM Anoop John wrote: > > > On behalf of the Apache HBase PMC I"m

Re: [DISCUSS] Status of the 0.98 release line

+1 to EOL 0.98. Thanks Andrew for all the work maintaining it! -Mikhail On Mon, Apr 10, 2017 at 12:10 PM, Dima Spivak wrote: > +1 > > -Dima > > On Mon, Apr 10, 2017 at 12:08 PM, Stack wrote: > > > I agree we should EOL 0.98. > > St.Ack > > > > On Mon,

Re: HBase as a file repository

n read the > MOB data from that MOB file, and by default the cache on the data block in > MOB files are disabled. Two hfile seeking totally. And gc is another > reason. > > > 2017-04-05 3:44 GMT+08:00 Mikhail Antonov <olorinb...@gmail.com>: > > > Unfamiliar with MOB codebase bu

Re: HBase as a file repository

Unfamiliar with MOB codebase but reading.. " It takes 100 ms to retrieve a 1MB cell (file), and only after retrieving I am able to start serving it to the end user".. Is that avg, p90, p99? Do we have htrace probes on that codepath? Do we do more seeks that we expect? -Mikhail On Tue, Apr 4,

[ANNOUNCE] Apache HBase 1.3.0 is now available for download

The HBase team is happy to announce the immediate availability of HBase 1.3. 0! Apache HBase is an open-source, distributed, versioned, non-relational database. Apache HBase gives you low latency random access to billions of rows with millions of columns atop non-specialized hardware. To learn

Re: [ANNOUNCE] New HBase Committer Josh Elser

Congratulations Josh! -Mikhail On Sun, Dec 11, 2016 at 5:20 PM, 张铎 wrote: > Congratulations! > > 2016-12-12 9:03 GMT+08:00 Jerry He : > > > Congratulations , Josh! > > > > Good work on the PQS too. > > > > Jerry > > > > On Sun, Dec 11, 2016 at 12:14

Re: [DISCUSS] EOL 1.1 Release Branch

On the original topic - on one hand, the fewer code lines we maintain the better, as less volunteering time and efforts are spent on that. Also does postponing of EOL-ing of older releases slow down adoption of newer releases? On the other hand, if we believe ITBBL is broken / unreliable for some

Re: 答复: [ANNOUNCE] Duo Zhang (张铎) joins the Apache HBase PMC

Congratulations! -Mikhail On Tue, Sep 6, 2016 at 10:58 PM, Honghua Feng 冯宏华 wrote: > Congratulations, Duo. > > 发件人: Ted Yu > 发送时间: 2016年9月7日 12:31 > 收件人: user@hbase.apache.org > 抄送: HBase Dev List > 主题: Re:

[ANNOUNCE] Dima Spivak joins the Apache HBase PMC

Congratulations! -Mikhail > Congratulations Dima, and thank you!

Re: Hbase federated cluster for messages

Just out of curiosity, is there anything particular about your deployment or usecase that raised this specific concern about Namenode performance? HDFS clusters with 80 datanodes shall be considered medium-sized; there are plenty of (much) bigger clusters out there in the field; and HBase

Re: [ANNOUNCE] Mikhail Antonov joins the Apache HBase PMC

Thanks guys! -Mikhail On Fri, May 27, 2016 at 9:34 AM, Nick Dimiduk <ndimi...@gmail.com> wrote: > Nice work Mikhail! Congrats. > > On Thu, May 26, 2016 at 11:30 AM, Andrew Purtell <apurt...@apache.org> > wrote: > > > On behalf of the Apache HBase PMC I am

Retiring empty regions

Yeah, that sound interesting. Do you think it should be a script (command, runnable from the client side), or some chore on master? You're going on this route because region normalizer lacks features you guys need? -Mikhail > Circling back here and adding user@phoenix. I put together one

Re: Retiring empty regions

Crazy idea, but you might be able to take stripped down version of region normalizer code and make a Tool to run? Requesting split or merge is done through the client API, and the only weighing information you need is whether region empty or not, that you could find out too? "Short of upgrading

Re: Please welcome new HBase committer Stephen Yuan Jiang

Congrats Stephen! -Mikhail On Sun, Aug 23, 2015 at 5:25 PM, Jonathan Hsieh j...@cloudera.com wrote: Yay! On Thursday, August 20, 2015, Andrew Purtell apurt...@apache.org wrote: On behalf of the Apache HBase PMC, I am pleased to announce that Stephen Jiang has accepted the PMC's invitation

Re: Automating major compactions

I totally understand the reasoning behind compacting regions with biggest number of store files, but didn't follow why it's best to compact regions which have biggest store files, maybe I'm missing something? I'd maybe compact regions which have the smallest avg storefile size? You may also want

Re: Stochastic Balancer by tables

PM Mikhail Antonov olorinb...@gmail.com wrote: Yeah, I could see 2 reasons for remaining few regions to take unproportionally long time - 1) those regions are unproportionally large (you should be able to quickly confirm it) and 2) they happened to be hosted on really slow

Re: Stochastic Balancer by tables

Yeah, I could see 2 reasons for remaining few regions to take unproportionally long time - 1) those regions are unproportionally large (you should be able to quickly confirm it) and 2) they happened to be hosted on really slow/overloaded machine(s). #1 seems far more likely to me. And as Nick

Re: Regionserver won't start

http://stackoverflow.com/questions/19584303/hbase-failed-suppression-of-fs-shutdown-hook - this seems to be closely related, and seems like there either might be issue with how hostname is resolved, or with wrong hadoop jars in lib folder. zookeeper.ZooKeeper: Client environment:java.class.path=

Re: Please welcome new HBase committer Jing Chen (Jerry) He

Congrats Jerry! -Mikhail On Thu, Apr 2, 2015 at 9:21 PM, Pankaj kr pankaj...@huawei.com wrote: Congrats Jerry..!! :) -Original Message- From: Andrew Purtell [mailto:apurt...@apache.org] Sent: 02 April 2015 01:53 To: d...@hbase.apache.org; user@hbase.apache.org Subject: Please

Re: Please welcome new HBase committer Srikanth Srungarapu

Congratulations Srikanth! -Mikhail On Thu, Apr 2, 2015 at 8:44 PM, Pankaj kr pankaj...@huawei.com wrote: Congrats Srikanth..!! -Original Message- From: Andrew Purtell [mailto:apurt...@apache.org] Sent: 02 April 2015 01:53 To: d...@hbase.apache.org; user@hbase.apache.org Subject:

Re: master consumes large amount of CPU for days

Log only shows that every 5 mins balancers kicks in and finds no work to do. Could you share a bit more details about the cluster - how much memory / cores you have on the nodes, what are JVM properties for hbase daemons, what version of HBase you're running, what kind of apps you run on top of

Re: [ANNOUNCE] Sean Busbey joins the Apache HBase PMC

Congrats, Sean! -Mikhail On Thu, Mar 26, 2015 at 3:44 PM, Esteban Gutierrez este...@cloudera.com wrote: Congratulations Sean! -- Cloudera, Inc. On Thu, Mar 26, 2015 at 2:49 PM, lars hofhansl lhofha...@yahoo.com.invalid wrote: Yeah! :) From: Andrew Purtell apurt...@apache.org

Re: Row Size on Disk

I would think average row size (row width?) would be reported somewhere in metrics though? -Mikhail On Mon, Mar 16, 2015 at 9:41 PM, Nick Dimiduk ndimi...@gmail.com wrote: Probably a combination of the RowCount job and 'hadoop fs -du' will get you what you're after. On Monday, March 16,

Re: Kerberos exception

reading:GSS initiate fail* On Sun, Mar 15, 2015 at 2:43 PM, Mikhail Antonov olorinb...@gmail.com wrote: I don't see region server log file in attachment for some reason.. May be the file is too big and gets rejected by mail server? Without it it'd be hard to say. Also master log looks a bit

Re: Kerberos exception

, 2015 at 2:10 AM, Mikhail Antonov olorinb...@gmail.com wrote: Hi, Traces (especially one for region server) look a bit incomplete, did you copy them fully? Also may help if you post relevant pieces of hbase-site.xml (with security configs). Thanks, Mikhail On Fri, Mar 13

Re: Kerberos exception

Hi, Traces (especially one for region server) look a bit incomplete, did you copy them fully? Also may help if you post relevant pieces of hbase-site.xml (with security configs). Thanks, Mikhail On Fri, Mar 13, 2015 at 11:28 PM, Manoj Murumkar manoj.murum...@gmail.com wrote: Hi, We have a

Re: Zookeeper JAAS Problem

I assume you followed steps in https://issues.apache.org/jira/browse/HBASE-2418 and you're passing config file name in HBASE_OPTS? Also what are the permissions on this file? -Mikhail On Sun, Feb 15, 2015 at 7:24 PM, 郝东 donhof...@163.com wrote: Hi, guys I am deploying a hbase cluster with

Re: Connecting to HBase with Kerberos

to proceed and connect. Best Regards, Jiten Sent from my iPhone On Feb 11, 2015, at 10:09 PM, Mikhail Antonov olorinb...@gmail.com wrote: I'd say you don't need to have HBase cluster up and running at all to be able to obtain kerberos ticket from standalone java app. On thing I noticed, which I

Re: Connecting to HBase with Kerberos

name And yes, the log is complete. Thanks, Jiten Sent from my iPhone On Feb 11, 2015, at 5:58 PM, Mikhail Antonov olorinb...@gmail.com wrote: Just checking.. is that full log? Does the principal name have the _HOST portion in it? On Wed, Feb 11, 2015 at 5:24 PM, Jiten Gore ji

Re: Connecting to HBase with Kerberos

EncryptionKey constructor LSA: Found TicketFlags constructor LSA: Found KerberosTime constructor LSA: Finished OnLoad processing Sent from my iPhone On Feb 11, 2015, at 6:29 PM, Mikhail Antonov olorinb...@gmail.com wrote: Interesting. Your java program runs under the same user, as shall

Re: Connecting to HBase with Kerberos

files. Is there any thing else that we need to do? Sent from my iPhone On Feb 11, 2015, at 5:08 PM, Mikhail Antonov olorinb...@gmail.com wrote: Does your java app has JCE installed with unlimited encryption strength? -Mikhail On Wed, Feb 11, 2015 at 4:52 PM, Jiten Gore ji...@gores.net wrote

Re: Connecting to HBase with Kerberos

in the principal name. From command line, we are able to get the TGT using the following command: kinit -k -t keytab -p username Sent from my iPhone On Feb 11, 2015, at 6:01 PM, Mikhail Antonov olorinb...@gmail.com wrote: Another thing to check are [libdefaults] and [realms] sections in krb5

Re: Connecting to HBase with Kerberos

Also, are you running with java opts -Dsun.security.krb5.debug=true? May help. On Wed, Feb 11, 2015 at 6:34 PM, Mikhail Antonov olorinb...@gmail.com wrote: I believe I had this problem when the unix permissions on keytab file were incorrect. On Wed, Feb 11, 2015 at 6:31 PM, Jiten Gore ji

Re: Connecting to HBase with Kerberos

Does your java app has JCE installed with unlimited encryption strength? -Mikhail On Wed, Feb 11, 2015 at 4:52 PM, Jiten Gore ji...@gores.net wrote: Hi Dima, Thanks for the prompt response. Here's what we are doing and the error we are seeing: Code:

Re: Connecting to HBase with Kerberos

) at org.apache.hadoop.security.UserGroupInformation.loginUserFromKeytabAndReturnUGI(UserGroupInformation.java:997) ... 2 more Sent from my iPhone On Feb 11, 2015, at 6:14 PM, Mikhail Antonov olorinb...@gmail.com wrote: And when you just run 'kinit -k -t ...' with this keytab and principal, it all

Re: Connecting to HBase with Kerberos

Another thing to check are [libdefaults] and [realms] sections in krb5.conf, in case there's any typo or wrong case in there. You can get the TGT from the kinit command using this keytab, right? -Mikhail On Wed, Feb 11, 2015 at 5:58 PM, Mikhail Antonov olorinb...@gmail.com wrote: Just checking

Re: Connecting to HBase with Kerberos

until tomorrow for their creation and further testing. Simply having the HBase-client.jaas on HBase client did not help. The error remains the same. Sent from my iPhone On Feb 11, 2015, at 9:30 PM, Mikhail Antonov olorinb...@gmail.com wrote: Does error remain the same after changes

Re: Connecting to HBase with Kerberos

iPhone On Feb 11, 2015, at 7:47 PM, Mikhail Antonov olorinb...@gmail.com wrote: I don't have any secured cluster handy to check and don't remember. I supposed if you master and regionservers are starting fine and able to login from keytabs than you're fine, otherwise you'll need to configure

Re: Silly question... Coprocessor writes to ZK?

I think ZK isn't the best possible storage for statistics. A separate stats table may be better solution. -Mikhail 2014-09-04 15:48 GMT-07:00 Michael Segel michael_se...@hotmail.com: So suppose I want to capture metadata about a table across all of the regions for that table. Has anyone

Re: [ANNOUNCE] New HBase PMC members: Matteo Bertozzi, Nick Dimiduk, and Jeffrey Zhong

Congratulations guys! -Mikhail 2014-08-25 17:32 GMT-07:00 Ted Yu yuzhih...@gmail.com: Congrats to Matteo, Nick and Jeffrey ! On Aug 25, 2014, at 5:24 PM, Jonathan Hsieh j...@cloudera.com wrote: On behalf of the Apache HBase PMC, I am happy to belatedly announce and welcome Matteo

Re: Hbase region count and RS count for 2TB+

So you have 3200 regions in total, and that means each region is about 650mb in size only (if you have 2.2 Tb in total), unless I'm missing something? If that's the case your regions are probably way too small. -Mikhail 2014-08-15 0:44 GMT-07:00 Juraj jiv fatcap@gmail.com: Hi all, i read

Re: how to let hmaster read zookeeper's /hbase/unassigned

Just curious why would the whole master be down as a consequence of master restart? Thanks, Mikhail 2014-07-21 16:27 GMT-07:00 Jimmy Xiang jxi...@cloudera.com: There is no way to force the master to reload such data from zookeeper currently. Thanks, Jimmy On Mon, Jul 21, 2014 at 4:20

Re: how to let hmaster read zookeeper's /hbase/unassigned

Sorry, I meant whole cluster of course. -Mikhail 2014-07-21 16:29 GMT-07:00 Mikhail Antonov olorinb...@gmail.com: Just curious why would the whole master be down as a consequence of master restart? Thanks, Mikhail 2014-07-21 16:27 GMT-07:00 Jimmy Xiang jxi...@cloudera.com

Re: What is the impact if hbase master downs?

Hi Yanglin, what exactly do you mean by system..need to take any failover - any manual action by cluster admin? Failover happens automatically based on zookeeper timeout for current active master. Currently, hbase cluster has 1 active master and several backup masters. When backup masters notice

Re: What is the impact if hbase master downs?

or region assignment). -Mikhail 2014-07-03 0:45 GMT-07:00 Mikhail Antonov olorinb...@gmail.com: Hi Yanglin, what exactly do you mean by system..need to take any failover - any manual action by cluster admin? Failover happens automatically based on zookeeper timeout for current active master

Re: What is the impact if hbase master downs?

for a long time. Thank you very much. Best, Yanglin 2014-07-03 15:45 GMT+08:00 Mikhail Antonov olorinb...@gmail.com: Hi Yanglin, what exactly do you mean by system..need to take any failover - any manual action by cluster admin? Failover happens automatically based on zookeeper timeout

Re: What is the impact if hbase master downs?

Glad it helped! -Sent from mobile, please excuse typos Mikhail On Jul 3, 2014, at 18:22, yl wu wuyl6...@gmail.com wrote: Hi Mikhail, Thank you so much! Your reply really resolve my confusions. Best, Yanglin 2014-07-03 16:31 GMT+08:00 Mikhail Antonov olorinb...@gmail.com

Re: ZK issue on one single RS.

1. 2014-04-29 10:32:28,876 INFO org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation: This client just lost it's session with ZooKeeper, will automatically reconnect when needed. What about ZK metrics, may be it's timing out or something (I mean echo srvr |nc

Re: suggestion for how eliminate memory problem in heavy-write hbase region server

Henry, http://blog.ragozin.info/2011/10/java-cg-hotspots-cms-and-heap.html - that may give some insights. -Mikhail 2014-04-24 23:07 GMT-07:00 Henry Hung ythu...@winbond.com: Dear All, My current hbase environment is heavy write cluster with constant 2000+ insert rows / second spread to 10