QuotaExceededException as a DoNotRetryIOException?

2018-02-06 Thread Huaxiang Sun
Hi HBase devs, I found that QuotaExceededException is a DoNotRetryIOException, which is a bit strange from user’s point of view. For rpc throttling, the exception is retryable and it tells app to slow down and retry later. Any thoughts? Thanks, Huaxiang

Re: QuotaExceededException as a DoNotRetryIOException?

2018-02-07 Thread Huaxiang Sun
scenario Huaxiang? > > Thanks, > S > > > On Tue, Feb 6, 2018 at 4:56 PM, Huaxiang Sun wrote: > >> Hi HBase devs, >> >>I found that QuotaExceededException is a DoNotRetryIOException, which >> is a bit strange from user’s point of view. >>

Re: QuotaExceededException as a DoNotRetryIOException?

2018-02-07 Thread Huaxiang Sun
rage, we shouldn't retry. The quota is a fixed quote - you have > exceeded your allotted disk space, please do not try again until you have > remedied the situation. > > Our current usage conflates the two, sometimes it is correct, sometimes not. > > On Wed, Feb 7, 2018 a

Re: QuotaExceededException as a DoNotRetryIOException?

2018-02-13 Thread Huaxiang Sun
Thanks Andrew. +1 for the second option, I will create a jira for this change. Huaxiang > On Feb 7, 2018, at 9:25 AM, Huaxiang Sun wrote: > > Hi Mike, > >You are right. For rpc throttling, definitely it is retryable. For storage > quota, I think it will be fail fas

Re: [ANNOUNCE] New HBase committer Peter Somogyi

2018-02-22 Thread Huaxiang Sun
Congratulations Peter! > On Feb 22, 2018, at 11:50 AM, Umesh Agashe wrote: > > Congratulations Peter! > > On Thu, Feb 22, 2018 at 11:12 AM, Esteban Gutierrez > wrote: > >> Congrats, Peter! >> >> -- >> Cloudera, Inc. >> >> >> On Thu, Feb 22, 2018 at 1:10 PM, Ted Yu wrote: >> >>> Congratu

Re: [ANNOUNCE] Please welcome Ashish Singhi to the HBase PMC

2018-02-28 Thread Huaxiang Sun
Congratulations Ashish! > On Feb 28, 2018, at 10:53 AM, Tamás Pénzes wrote: > > Congrats! > > On Wed, Feb 28, 2018 at 10:52 AM, Peter Somogyi wrote: > >> Congratulations! >> >> On Wed, Feb 28, 2018 at 8:13 AM, Ted Yu wrote: >> >>> Congratulations, Ashish. >>> >>> On Wed, Feb 28, 2018 at 7

Re: [ANNOUNCE] Please welcome Guanghao Zhang to the HBase PMC

2018-02-28 Thread Huaxiang Sun
Congratulations Guanghao! > On Feb 28, 2018, at 10:53 AM, Tamás Pénzes wrote: > > Congrats! > > On Wed, Feb 28, 2018 at 10:52 AM, Peter Somogyi wrote: > >> Congratulations! >> >> On Wed, Feb 28, 2018 at 8:13 AM, Ted Yu wrote: >> >>> Congratulations, Guanghao ! >>> >>> On Wed, Feb 28, 201

Re: [ANNOUNCE] Please welcome Mike Drob to the HBase PMC

2018-02-28 Thread Huaxiang Sun
Congratulations Mike! > On Feb 28, 2018, at 11:54 AM, Umesh Agashe wrote: > > Congratulations Mike! > > On Wed, Feb 28, 2018 at 10:56 AM, Zach York > wrote: > >> Nice work, Congratulations Mike! >> >> On Wed, Feb 28, 2018 at 10:52 AM, Peter Somogyi >> wrote: >> >>> Congratulations! >>> >>

Re: [ANNOUNCE] New HBase committer Zach York

2018-03-07 Thread Huaxiang Sun
Congratulations, Zach! > On Mar 7, 2018, at 9:26 AM, Umesh Agashe wrote: > > Congratulations, Zach! > > On Wed, Mar 7, 2018 at 8:40 AM, Ted Yu wrote: > >> Congratulations, Zach ! >> >> On Wed, Mar 7, 2018 at 8:27 AM, Sean Busbey wrote: >> >>> On behalf of the Apache HBase PMC, I am please

Re: Recent trend in JIRA management

2018-07-23 Thread Huaxiang Sun
Thanks Andrew for bringing this up. I have one following up question. When pushing to 1.2/1.3/1.4, do we need to get RM's approval? Huaxiang > On Jul 23, 2018, at 12:24 PM, Andrew Purtell wrote: > > I forgot to mention if a commit is only made to master, then the RM who > happens to be looking

Re: Recent trend in JIRA management

2018-07-23 Thread Huaxiang Sun
one on the project to avoid coordination where > possible. Coordination is expensive. Use lock free design principles for > both the software and community practices. > > > > On Mon, Jul 23, 2018 at 12:42 PM Huaxiang Sun > wrote: > >> Thanks Andrew for bringing this

Re: Meta replicas in LoadBalance mode broken in 2.4?

2022-03-24 Thread Huaxiang Sun
Hi Andor, Which 2.4 release do you test in your lab? We use this feature at production cluster with 2.4.5. At server side, we use hfile refresh instead of wal replication. I used to run itbll for each release with this feature enabled. How did you find the errors, did itbll fail? Regard

Re: Meta replicas in LoadBalance mode broken in 2.4?

2022-03-25 Thread Huaxiang Sun
e more about ‘hfile refresh’ and how to configure it? > > Thanks, > Andor > > > > > > On 2022. Mar 24., at 17:43, Huaxiang Sun wrote: > > > > Hi Andor, > > > > Which 2.4 release do you test in your lab? We use this feature at > > production

Re: [DISCUSS] Use spotless to auto format pom and java code

2022-03-25 Thread Huaxiang Sun
+1, a very nice and helpful feature. On 2022/03/25 04:04:31 "张铎(Duo Zhang)" wrote: > Revive. > > Will wait for another couple of days, if no big objections, I will move > forward to integrate spotless into our active branches. > > Thanks. > > 张铎(Duo Zhang) 于2022年3月15日周二 21:17写道: > > > I've

Re: Meta replicas in LoadBalance mode broken in 2.4?

2022-03-26 Thread Huaxiang Sun
led) if hbase.meta.replicas.use = true ? Otherwise, it seems > > pointless to have meta replicas which do not actually receive updates (by > > default). > > > > > > On Fri, Mar 25, 2022 at 10:51 AM Huaxiang Sun > > wrote: > > > >> Hi Andor, >

Re: Meta replicas in LoadBalance mode broken in 2.4?

2022-03-28 Thread Huaxiang Sun
Hi Andor, Please keep us updated how itbll goes with the new server side config. Your result will be used a datapoint as well. Thanks, Huaxiang On 2022/03/25 17:51:49 Huaxiang Sun wrote: > Hi Andor, > >I get what you are saying. The HFile refreshing is the old way fo

Re: Meta replicas in LoadBalance mode broken in 2.4?

2022-03-28 Thread Huaxiang Sun
I will start to work on it. Thanks Huaxiang On 2022/03/27 18:42:06 Andrew Purtell wrote: > On Sat, Mar 26, 2022 at 10:00 PM Huaxiang Sun > wrote: > > > It makes sense to turn on async wal replication when > > hbase.meta.replicas.use = true. Let me run couple

Re: Meta replicas in LoadBalance mode broken in 2.4?

2022-03-29 Thread Huaxiang Sun
the clients, so must be in load balance mode. > > Thanks for the help! > > Andor > > > > > On 2022. Mar 27., at 6:59, Huaxiang Sun wrote: > > > > It makes sense to turn on async wal replication when > > hbase.meta.replicas.use = true. Let me run couple r

Re: Meta replicas in LoadBalance mode broken in 2.4?

2022-04-06 Thread Huaxiang Sun
gt; > https://github.com/apache/hbase/pull/4301 > > > > Thanks, > > Andor > > > > > > > > > >> On 2022. Mar 29., at 18:52, Huaxiang Sun wrote: > >> > >> This is great, thanks for the testing results! > >>

Re: [ANNOUNCE] Please welcome Xiaolin Ha(哈晓琳) to the HBase PMC

2022-04-11 Thread Huaxiang Sun
Congratulations, Xiaolin! Sent from my iPhone > On Apr 11, 2022, at 2:30 AM, Jan Hentschel > wrote: > > Congratulations and welcome! > > From: 张铎(Duo Zhang) > Date: Saturday, April 9, 2022 at 3:11 PM > To: HBase Dev List , hbase-user > , user-zh > Subject: [ANNOUNCE] Please welcome Xiaoli

Re: [ANNOUNCE] New HBase committer Bryan Beaudreault

2022-04-11 Thread Huaxiang Sun
Congratulations, Bryan! Sent from my iPhone > On Apr 11, 2022, at 2:30 AM, Jan Hentschel > wrote: > > Congratulations and welcome! > > From: 张铎(Duo Zhang) > Date: Saturday, April 9, 2022 at 1:45 PM > To: HBase Dev List , hbase-user > , user-zh > Subject: [ANNOUNCE] New HBase committer Bry

Re: [VOTE] First release candidate for HBase 2.4.12 (RC0) is available

2022-05-05 Thread Huaxiang Sun
+1 * Signature: ok * Checksum : ok * Rat check (1.8.0_242): ok - mvn clean apache-rat:check * Built from source (1.8.0_242): ok - mvn clean install -DskipTests * Unit tests pass (1.8.0_242): ok - mvn package -P runSmallTest

Re: [VOTE] First release candidate for HBase 2.4.12 (RC0) is available

2022-05-06 Thread Huaxiang Sun
3 node k8s cluster. Inserted 250M rows and it is verified correctly. On Thu, May 5, 2022 at 7:28 AM Huaxiang Sun wrote: > +1 > > * Signature: ok > > * Checksum : ok > > * Rat check (1.8.0_242): ok > > - mvn clean apache-rat:check >

Re: [NOTICE] Please be careful when merging a PR with failure pre commit result

2022-05-26 Thread Huaxiang Sun
Terribly sorry here! I did not notice Duo's reply in the PR and did not get chance to fix the error in time. Will pay more attention and be more careful when merging PR next time. Thanks again Duo for fixing the error. Huaxiang On Wed, May 25, 2022 at 6:09 AM 张铎(Duo Zhang) wrote: > Since our U

Re: [DISCUSS] First release candidate for 2.5.0 (RC0) is available for evaluation

2022-06-02 Thread Huaxiang Sun
+1 to make the change everywhere. Sometimes, there is a need to update the release field after jira is released (in theory, it should not happen). Thanks Huaxiang On Thu, Jun 2, 2022 at 10:56 AM Andrew Purtell wrote: > Even for branch-2.4, we can start placing links into the file, at the top,

Time for hbase-2.4.14 release

2022-08-16 Thread Huaxiang Sun
Hi Folks, There are quite some critical fixes after 2.4.13, especially memory leaks in SASL implementation and ByteBuffAllocator. Since 2.5.0 release is being worked on, there is a rolling back issue from 2.5.0 back to 2.4.* release which is fixed in the coming 2.4.14 release. 2.4.13 was relea

Re: Time for hbase-2.4.14 release

2022-08-17 Thread Huaxiang Sun
Thanks Duo. I am planning to spin 2.4.14RC0 on this Friday, if there is any jira you want to include in this RC, please backport them to branch-2.4 before this Friday. Thanks Huaxiang On Tue, Aug 16, 2022 at 8:11 PM 张铎(Duo Zhang) wrote: > Thanks for taking care of this! > > Huaxiang S

[VOTE] HBase 2.4.14 release candidate (RC0) is available

2022-08-22 Thread Huaxiang Sun
Please vote on this Apache hbase release candidate, hbase-2.4.14RC0 The VOTE will remain open for at least 72 hours. [ ] +1 Release this package as Apache hbase 2.4.14 [ ] -1 Do not release this package because ... The tag to be voted on is 2.4.14RC0: https://github.com/apache/hbase/tre

Re: [VOTE] HBase 2.4.14 release candidate (RC0) is available

2022-08-23 Thread Huaxiang Sun
; but got no response. > > And I checked the CHANGES.md, there is no HBASE-27301 in it, neither > in 2.4.13 nor 2.4.14. > > Please fix this issue and publish an RC again. > > Thanks. > > Huaxiang Sun 于2022年8月23日周二 07:15写道: > > > > Please vote on this Apac

Re: [VOTE] HBase 2.4.14 release candidate (RC0) is available

2022-08-23 Thread Huaxiang Sun
HBASE-27215 was not included in 2.4.13's release notes. I corrected both jira's fixed versions and respining a new RC. On Tue, Aug 23, 2022 at 8:44 AM Huaxiang Sun wrote: > Sorry to miss your message, checking it now, I may marked the wrong jira, > let me check the jira list and res

Re: [VOTE] HBase 2.4.14 release candidate (RC0) is available

2022-08-23 Thread Huaxiang Sun
s/HBASE-27215/HBASE-27125 in the previous email I sent. On Tue, Aug 23, 2022 at 9:26 AM Huaxiang Sun wrote: > Ok, I went through the jira list for 2.4.14 again. For some reason, I > marked "fixed version" for HBASE-27301 by accident, which was supposed to > be > > HBA

[VOTE] HBase 2.4.14 release candidate (RC1) is available

2022-08-24 Thread Huaxiang Sun
Please vote on this Apache hbase release candidate, hbase-2.4.14RC1 The VOTE will remain open for at least 72 hours. [ ] +1 Release this package as Apache hbase 2.4.14 [ ] -1 Do not release this package because ... The tag to be voted on is 2.4.14RC1: https://github.com/apache/hbase/tre

Re: [VOTE] HBase 2.4.14 release candidate (RC1) is available

2022-08-24 Thread Huaxiang Sun
- mvn package -P runSmallTests -Dsurefire.rerunFailingTestsCount=3 Went through CHANGES.md to make sure all 2.4.14 jiras are included. On Wed, Aug 24, 2022 at 8:59 AM Huaxiang Sun wrote: > Please vote on this Apache hbase release candidate, > > hbase-2.4.14RC1 > >

Re: [VOTE] Release candidate for HBase 2.5.0 (RC1) is available

2022-08-26 Thread Huaxiang Sun
+1 ~/work/hbase-hs/hbase-1 * Signature: ok * Checksum : failed * Rat check (1.8.0_242): ok - mvn clean apache-rat:check * Built from source (1.8.0_242): ok - mvn clean install -DskipTests * Unit tests pass (1.8.0_242): ok

Re: [VOTE] HBase 2.4.14 release candidate (RC1) is available

2022-08-28 Thread Huaxiang Sun
8.0_202-ea): ok > - mvn clean apache-rat:check > * Built from source (1.8.0_202-ea): ok > - mvn clean install -DskipTests > * Unit tests pass (1.8.0_202-ea): ok > - mvn package -P runSmallTests > -Dsurefire.rerunFailingTestsCount=3 > > From: Huaxiang Sun > D

Re: [VOTE] HBase 2.4.14 release candidate (RC1) is available

2022-08-29 Thread Huaxiang Sun
sts >* Unit tests pass (1.8.0_332): failed > - mvn package -P runAllTests -Dsurefire.rerunFailingTestsCount=3 > > TestSplitRegionWhileRSCrash times out. > > >> On Wed, Aug 24, 2022 at 8:59 AM Huaxiang Sun wrote: >> >> Please vote on this Apache h

Re: [VOTE] HBase 2.4.14 release candidate (RC1) is available

2022-08-30 Thread Huaxiang Sun
Thanks Duo, let me confirm before sending out the announcement. Huaxiang On Tue, Aug 30, 2022 at 8:23 AM 张铎(Duo Zhang) wrote: > Seems you forget to release the artifacts on > https://repository.apache.org/? > > Huaxiang Sun 于2022年8月30日周二 13:07写道: > > > > Thank

Re: [VOTE] HBase 2.4.14 release candidate (RC1) is available

2022-08-30 Thread Huaxiang Sun
Done, thanks for checking. On Tue, Aug 30, 2022 at 9:06 AM Huaxiang Sun wrote: > Thanks Duo, let me confirm before sending out the announcement. > > Huaxiang > > On Tue, Aug 30, 2022 at 8:23 AM 张铎(Duo Zhang) > wrote: > >> Seems you forget to releas

[ANNOUNCE] Apache HBase 2.4.14 is now available for download

2022-08-30 Thread Huaxiang Sun
The HBase team is happy to announce the immediate availability of HBase 2.4.14. Apache HBase™ is an open-source, distributed, versioned, non-relational database. Apache HBase gives you low latency random access to billions of rows with millions of columns atop non-specialized hardware. To le

Behavior of flush when compaction is disabled for a table

2016-07-27 Thread Huaxiang Sun
ed for the table? It may block the client as the memstore size exceeds the limit and region server returns RegionTooBusyException. Please advice the correct behavior. Thanks, Huaxiang Sun Ref[1] https://issues.apache.org/jira/browse/HBASE-16293?filter=-1 <https://issues.apache.org/ji

Re: [ANNOUNCE] Dima Spivak joins the Apache HBase PMC

2016-09-02 Thread Huaxiang Sun
Congratulations Dima! > On Aug 31, 2016, at 11:18 PM, ashish singhi wrote: > > Congratulations Dima! > > -Original Message- > From: Andrew Purtell [mailto:apurt...@apache.org] > Sent: 01 September 2016 01:08 > To: dev@hbase.apache.org; u...@hbase.apache.org > Subject: [ANNOUNCE] Dima S

Re: [ANNOUNCE] Misty Stanley-Jones joins the Apache HBase PMC

2016-09-07 Thread Huaxiang Sun
Congratulations Misty! > On Sep 7, 2016, at 4:42 PM, Nick Dimiduk wrote: > > Congratulations and thanks for all the contributions Misty! > > On Wed, Sep 7, 2016 at 11:40 AM, Sean Busbey wrote: > >> On behalf of the Apache HBase PMC I am pleased to announce that Misty has >> accepted our invit

Re: [ANNOUNCE] Duo Zhang (张铎) joins the Apache HBase PMC

2016-09-07 Thread Huaxiang Sun
Congratulations, 张铎! > On Sep 7, 2016, at 11:10 AM, Enis Söztutar wrote: > > Congrats Duo. > > Enis > > On Wed, Sep 7, 2016 at 8:03 AM, Misty Stanley-Jones > wrote: > >> Congratulations, Duo! >> >>> On Sep 6, 2016, at 9:26 PM, Stack wrote: >>> >>> On behalf of the Apache HBase PMC I am pl

Re: Data loss in MOB snapshot and clone?

2016-10-12 Thread Huaxiang Sun
Hi Tim, I believe that it runs into an issue which is specific to cloudera release we fixed recently. For details, could you discuss it in cdh forum? Copy me(h...@cloudera.com ) in the forum so I can explain more there. Thanks, Huaxiang > On Oct 12, 2016, at

Re: Data loss in MOB snapshot and clone?

2016-10-12 Thread Huaxiang Sun
By the way, I forgot the forum link: http://community.cloudera.com <http://community.cloudera.com/> Thanks, Huaxiang > On Oct 12, 2016, at 10:10 AM, Huaxiang Sun wrote: > > Hi Tim, > >I believe that it runs into an issue which is specific to cloudera release >

Re: Data loss in MOB snapshot and clone?

2016-10-12 Thread Huaxiang Sun
e this to a Cloudera forum and comment back here if it appears > unrelated. > > On Wed, Oct 12, 2016 at 7:24 PM, Huaxiang Sun <mailto:h...@cloudera.com>> wrote: > >> By the way, I forgot the forum link: http://community.cloudera.com >> <http://community.

Re: [ANNOUNCE] New HBase committer Lijin Bin

2016-11-29 Thread Huaxiang Sun
Congratulations, Lijin! > On Nov 29, 2016, at 5:15 AM, 宾莉金 or binlijin wrote: > > Thanks everyone. :) > > Looking forward to keep doing cool stuff with you guys. > > 2016-11-29 19:01 GMT+08:00 ramkrishna vasudevan < > ramkrishna.s.vasude...@gmail.com>: > >> Congratulations !! All the best !!

Re: [ANNOUNCE] New HBase committer Phil Yang

2016-11-29 Thread Huaxiang Sun
Congratulations, Phil! > On Nov 29, 2016, at 5:29 AM, Yu Li wrote: > > Congrats and welcome Phil! > > Best Regards, > Yu > > On 29 November 2016 at 19:01, Anoop John wrote: > >> Congrats and welcome Phil... Looking forward for many more >> contributions from u. >> >> -Anoop- >> >> On Tue,

Re: [ANNOUNCE] New HBase committer Guanghao Zhang

2016-12-19 Thread Huaxiang Sun
Congratulations, Guanghao! > On Dec 19, 2016, at 5:48 PM, Ted Yu wrote: > > Congratulations, Guanghao. > > On Mon, Dec 19, 2016 at 5:37 PM, Duo Zhang wrote: > >> On behalf of the Apache HBase PMC, I am pleased to announce that Guanghao >> Zhang has accepted the PMC's invitation to become a co

Inconsistent behavior of scan with filter and maxVersions?

2017-02-27 Thread Huaxiang Sun
major compaction. The reason is that when filter returns SKIP, the version count is not increased. The older version is treated as the latest version. Is this the expected behavior? when maxVersions is specified in HCD, is user supposed to see the latest maxVersions or it could be affected by filters? It is not a raw scan in this example. Thanks, Huaxiang Sun

Re: Inconsistent behavior of scan with filter and maxVersions?

2017-02-27 Thread Huaxiang Sun
17-02-28 9:26 GMT+08:00 Huaxiang Sun : > >> Hi HBase Devs, >> >>Nicolae Popa found an inconsistent behavior when doing scan with >> filter, there is maxVersions configured for column family. >>Start with the example. >> >> hbase(main):001:0> c

Re: [ANNOUNCE] New HBase committer Chia-Ping Tsai

2017-03-20 Thread Huaxiang Sun
Congratulations, Chia-Ping! > On Mar 18, 2017, at 5:38 AM, Ashish Singhi > wrote: > > Many Congratulations ! > > On Sat, Mar 18, 2017 at 4:00 AM, Anoop John wrote: > >> On behalf of the Apache HBase PMC, I am pleased to announce that Chia-Ping >> Tsai >> has accepted the PMC's invitation to

Re: ANNOUNCE: Yu Li joins the Apache HBase PMC

2017-04-15 Thread Huaxiang Sun
Congratulations, Yu! > On Apr 14, 2017, at 8:17 PM, Stephen Jiang wrote: > > Congratulations, Yu! Keep up the good work! > > Thanks > Stephen > > On Fri, Apr 14, 2017 at 6:54 PM, Jerry He wrote: > >> Congratulations and welcome, Yu! >> >> On Fri, Apr 14, 2017 at 6:47 PM, Andrew Purtell >>

Re: HBASE and MOB

2017-05-15 Thread Huaxiang Sun
+1, not a trivial effort. > On May 15, 2017, at 1:31 PM, Mikhail Antonov wrote: > > +1 for not trying to backport massive new features to branch-1. > > IMO Branch-1 release lines should be continuing the path towards > maintenance mode only. > > -Mikhail > > On Mon, May 15, 2017 at 1:21 PM, T

Re: [ANNOUNCE] New HBase committer Huaxiang Sun

2017-06-19 Thread Huaxiang Sun
;>>>> is intended only for the person or entity whose address is listed >>> above. >>>>> Any use of the >>>>> information contained herein in any way (including, but not limited to, >>>>> total or partial >>>>> disclos

Re: Please congratulate our new PMC Chair Misty Stanley-Jones

2017-09-21 Thread Huaxiang Sun
Congratulations Misty! Huaxiang > On Sep 21, 2017, at 9:51 PM, Yu Li wrote: > > Congrats Misty! > > Best Regards, > Yu > > On 22 September 2017 at 11:26, Guanghao Zhang wrote: > >> Congratulations! >> >> 2017-09-22 11:20 GMT+08:00 Chia-Ping Tsai : >> >>> congrats Misty!!! >>> >>> On 201

Re: Welcome Chia-Ping Tsai to the HBase PMC

2017-09-29 Thread Huaxiang Sun
Congratulations Chia-Ping! Huaxiang > On Sep 29, 2017, at 3:52 PM, Guanghao Zhang wrote: > > Congratulations! > > 2017-09-30 6:38 GMT+08:00 Andrew Purtell : > >> Congratulations, Chia-Ping! Welcome to the PMC. >> >> On Fri, Sep 29, 2017 at 3:19 PM, Misty Stanley-Jones >> wrote: >> >>> The

Re: [ANNOUNCE] New HBase committer Zheng Hu

2017-10-23 Thread Huaxiang Sun
Congratulations, Zheng!

Re: [VOTE] Fourth release candidate for HBase 2.3.0 (RC3) is available

2020-07-09 Thread Huaxiang Sun
+1 (non-binding) * Signature: ok * Checksum : ok * Rat check (1.8.0_242): ok - mvn clean apache-rat:check * Built from source (1.8.0_242): ok - mvn clean install -DskipTests * Unit tests pass (1.8.0_242): failed - mvn packag

Re: [DISCUSS] A plan for 2.4

2020-10-14 Thread Huaxiang Sun
For meta replica work, the task jira is HBASE-18070 . The source side change has been committed, Endpoint change is under review. Meta Replica load balance support at client side is in progress. Thanks, Huaxiang On Wed, Oct 14, 2020 at 9:42 AM Ni

Re: [DISCUSS] A plan for 2.4

2020-10-27 Thread Huaxiang Sun
> > obstacles (and we can punt on it then). We'd like to deploy the > feature > > > to > > > > address hbase:meta issues we are seeing in production. > > > > > > > > What we're building should work for root if needed but will worry > abou

Re: HEAD-UP: Merging HBASE-18070 "Enable memstore replication for meta replica" to master and then back to branch-2

2020-11-16 Thread Huaxiang Sun
Folks, As I explained in the jira, before our load hits the region server's limit, the throughput is going to be similar for primary-only and meta replica Load Balance mode. We are examining our test today, trying to push up the load and will come back. Best Regards, Huaxian

Re: HEAD-UP: Merging HBASE-18070 "Enable memstore replication for meta replica" to master and then back to branch-2

2020-11-17 Thread Huaxiang Sun
Hi Duo, Happy birthday! Let me explain the reasons that why we chose to land the client patch to master along with the backend changes (HBASE-18070 branch). 1. Client patch does not work very well by itself (without "real-time" replication of meta wal edits, the gap between primary an

Re: VOTE: Merge HBASE-18070 "Enable memstore replication for meta replica" to master and then back to branch-2" (Was "HEAD-UP: Merging HBASE-18070 "Enable memstore replication for meta replica" to mas

2020-11-17 Thread Huaxiang Sun
+1 On Tue, Nov 17, 2020 at 9:21 AM Bharath Vissapragada wrote: > +1. Reviewed the design doc and the consolidated patch, great improvement, > thanks for putting this together. > > On Tue, Nov 17, 2020 at 9:09 AM Stack wrote: > > > +1 > > S > > > > On Tue, Nov 17, 2020 at 8:43 AM Stack wrote: >

Re: VOTE: Merge HBASE-18070 "Enable memstore replication for meta replica" to master and then back to branch-2" (Was "HEAD-UP: Merging HBASE-18070 "Enable memstore replication for meta replica" to mas

2020-11-18 Thread Huaxiang Sun
is > > affecting multiple people. > > > > > On Nov 17, 2020, at 5:43 PM, 张铎 wrote: > > > > > > Hi, bring my -1 from the HEAD-UP thread, this is a veto. > > > > > > My concerns have not been fully resolved. Let's work it out on ji

Re: VOTE: Merge HBASE-18070 "Enable memstore replication for meta replica" to master and then back to branch-2" (Was "HEAD-UP: Merging HBASE-18070 "Enable memstore replication for meta replica" to mas

2020-11-19 Thread Huaxiang Sun
gt; > > questions given by you. > > >> > > > > > >> > > > A clear and compelling reason why the proposed change is harmful > > or > > >> > > > >undesirable > > >> > > > > > >> > >

Re: [VOTE] First release candidate for HBase 2.4.0 (RC1) is available

2020-12-03 Thread Huaxiang Sun
Thanks Andrew. Running itbll with meta replica load balance mode now, will report back tomorrow. Huaxiang On Thu, Dec 3, 2020 at 4:05 PM Andrew Purtell wrote: > Please vote on this Apache hbase release candidate, hbase-2.4.0RC1 > > The VOTE will remain open for at least 72 hours. > > [ ] +1 Rel

Re: [ANNOUNCE] New HBase committer Yulin Niu

2020-12-04 Thread Huaxiang Sun
Congratulations, Yulin! On Fri, Dec 4, 2020 at 9:56 AM Esteban Gutierrez wrote: > Congratulations, Yulin! > > -- > Cloudera, Inc. > > > > On Fri, Dec 4, 2020 at 11:49 AM Jan Hentschel < > jan.hentsc...@ultratendency.com> wrote: > > > Congratulations and welcome! > > > > From: Guanghao Zhang > >

Re: [ANNOUNCE] New HBase committer Xin Sun

2020-12-04 Thread Huaxiang Sun
Congratulations, Xin! On Fri, Dec 4, 2020 at 9:56 AM Esteban Gutierrez wrote: > Congrats, Xin! > > > -- > Cloudera, Inc. > > > > On Fri, Dec 4, 2020 at 11:48 AM Jan Hentschel < > jan.hentsc...@ultratendency.com> wrote: > > > Congratulations and welcome! > > > > From: Guanghao Zhang > > Reply-To

Re: [VOTE] First release candidate for HBase 2.4.0 (RC1) is available

2020-12-04 Thread Huaxiang Sun
+1 (non-binding) Put 2.4.0 to a 15 node cluster (3 masters, 12 region servers), configured HBASE-18070 for both server and client. Server side, there are 1 primary meta region and 3 meta replica regions. Run itbll with serverKilling chaos monkey and added 3 billion rows. itbll finished successfull

Re: Missed signoff of a commit?

2020-12-10 Thread Huaxiang Sun
Sorry, it seems that I missed the signoff message. Let's revert and reopen a commit. On Thu, Dec 10, 2020 at 6:17 AM 张铎(Duo Zhang) wrote: > commit c1aa3b24e930e2c47ff4d7f6e286cb450458dffc > Author: Huaxiang Sun > Date: Mon Nov 30 15:58:25 2020 -0800 > > HBASE-25

Re: Time for 2.3.4

2020-12-15 Thread Huaxiang Sun
Continue this topic. I volunteered to be RM for 2.3.4. I plan to warm up this release process starting from tomorrow. Per Nick said 2 weeks ago, if there are any patch-level bug fixes you want to include in 2.3.4, please wrap them up in couple of days. Thanks, Huaxiang On Fri, Dec 4, 2020 at 8:38

Re: [DISCUSS] Move the stable pointer to 2.3.x and EOM for branch-2.2?

2020-12-15 Thread Huaxiang Sun
+1 (non-binding). On Tue, Dec 15, 2020 at 9:14 PM Viraj Jasani wrote: > I believe last time when we discussed this, we were considering stability > of migration from MasterProcWAL to MasterProc directory (WAL to region > based procedure store) during rolling upgrade from 2.2.x to 2.3.x. I hope >

[VOTE] First HBase 2.3.4 release candidate (RC10) is available

2021-01-08 Thread Huaxiang Sun
Please vote on this Apache hbase release candidate, hbase-2.3.4RC0 The VOTE will remain open for at least 72 hours. [ ] +1 Release this package as Apache hbase 2.3.4 [ ] -1 Do not release this package because ... The tag to be voted on is 2.3.4RC0: https://github.com/apache/hbase/tree/2

Re: [VOTE] First HBase 2.3.4 release candidate (RC10) is available

2021-01-09 Thread Huaxiang Sun
mmits are already part of 2.3.4RC0: > https://github.com/apache/hbase/tree/2.3.4RC0 > > Unfortunately, we will have to sink RC0. > > > On 2021/01/09 01:30:44, Huaxiang Sun wrote: > > Please vote on this Apache hbase release candidate, > > > > hbase-2.3.4RC0 > >

Re: [VOTE] First HBase 2.3.4 release candidate (RC10) is available

2021-01-11 Thread Huaxiang Sun
t; both in sync is > a common problem. I think we could synchronize them by asking everyone to > hold on from committing backports to release branch maybe just before > starting RC prep (by sending separate notice on dev@ ). > > > On Sat, 9 Jan 2021 at 11:21 PM, Huaxiang Sun > wr

Re: [VOTE] First HBase 2.3.4 release candidate (RC10) is available

2021-01-11 Thread Huaxiang Sun
I missed one step, I also need to check top couple jiras to see if they are included in the release. On Mon, Jan 11, 2021 at 10:55 AM Huaxiang Sun wrote: > Yeah, I just found out that these two jiras were resolved after we ran the > git check. 2.3.4 tag includes these two jiras, this is w

Re: Call for RMs for RCs this week

2021-01-11 Thread Huaxiang Sun
Yeah, I am working on 2.3.4 with Stack and Nick. Thanks, Huaxiang On Mon, Jan 11, 2021 at 10:59 AM Andrew Purtell wrote: > 2.4.1 - me > > 2.3.4 - Huaxiang? > Looks like we just sank RC0. Will need a RC1, ensuring all recent commits > are included. > > 2.2.x - Guanghao? > > If you can't RM this

Please hold on backports to 2.3 branch

2021-01-11 Thread Huaxiang Sun
Hi, Please hold on backports to 2.3 branch, we are preparing the release for 2.3.4. Once it is done, a notice will be sent out for backports. Thanks Huaxiang

Re: Please hold on backports to 2.3 branch

2021-01-12 Thread Huaxiang Sun
builds. > > Please check whether it affects the release process. > > Thanks. > > Huaxiang Sun 于2021年1月12日周二 上午3:12写道: > > > Hi, > > > >Please hold on backports to 2.3 branch, we are preparing the release > for > > 2.3.4. Once it is done, a no

[VOTE] HBase 2.3.4 release candidate (RC2) is available

2021-01-12 Thread Huaxiang Sun
Please vote on this Apache hbase release candidate, hbase-2.3.4RC2 The VOTE will remain open for at least 72 hours. [ ] +1 Release this package as Apache hbase 2.3.4 [ ] -1 Do not release this package because ... The tag to be voted on is 2.3.4RC2: https://github.com/apache/hbase/tree/2

Re: [VOTE] HBase 2.3.4 release candidate (RC2) is available

2021-01-14 Thread Huaxiang Sun
ira for a utility script that can > find these differences while preparing for RCs. > > > On 2021/01/13 05:13:50, Huaxiang Sun wrote: > > Please vote on this Apache hbase release candidate, > > > > hbase-2.3.4RC2 > > > > > > The VOTE will remain o

Re: [VOTE] HBase 2.3.4 release candidate (RC2) is available

2021-01-14 Thread Huaxiang Sun
I fixed all versions for HBASE-25425, HBASE-25356 and HBASE-25083, thanks Viraj to look into these issues. Yeah, I have not found a better way to check the case that commits in the branch, but not in fixVersion of the jira. On Thu, Jan 14, 2021 at 9:53 AM Huaxiang Sun wrote: > Thanks Viraj!

Re: [VOTE] HBase 2.3.4 release candidate (RC2) is available

2021-01-14 Thread Huaxiang Sun
nother RC. On Thu, Jan 14, 2021 at 10:14 AM Huaxiang Sun wrote: > I fixed all versions for HBASE-25425, HBASE-25356 and HBASE-25083, thanks > Viraj to look into these issues. > Yeah, I have not found a better way to check the case that commits in the > branch, but not in fixVersion of

Re: [VOTE] HBase 2.3.4 release candidate (RC2) is available

2021-01-14 Thread Huaxiang Sun
The RC2 failed due to the jira log issue found by Viraj, please do not spend time on this Vote. On Tue, Jan 12, 2021 at 9:13 PM Huaxiang Sun wrote: > Please vote on this Apache hbase release candidate, > > hbase-2.3.4RC2 > > > The VOTE will remain open for at least 72 h

Re: [VOTE] HBase 2.3.4 release candidate (RC2) is available

2021-01-14 Thread Huaxiang Sun
>I just have a PR with script (Phoenix): https://github.com/apache/phoenix/pull/1088 >in case you would like to use anytime soon. I just used it >for both 2.3.4 and 2.4.1 RCs. It takes project name as input. That is great! Let me try it out. On Thu, Jan 14, 2021 at 10:24 AM Huaxiang S

[VOTE] HBase 2.3.4 release candidate (RC4) is available

2021-01-14 Thread Huaxiang Sun
Please vote on this Apache hbase release candidate, hbase-2.3.4RC4 The VOTE will remain open for at least 72 hours. [ ] +1 Release this package as Apache hbase 2.3.4 [ ] -1 Do not release this package because ... The tag to be voted on is 2.3.4RC4: https://github.com/apache/hbase/tree/2

Re: [VOTE] HBase 2.3.4 release candidate (RC4) is available

2021-01-15 Thread Huaxiang Sun
? > > Are we find with HBASE-25234 showing up in CHANGELOG? > > On 2021/01/15 03:03:47, Huaxiang Sun wrote: > > Please vote on this Apache hbase release candidate, > > > > hbase-2.3.4RC4 > > > > > > The VOTE will remain open for at least 72 hours. > &

Re: Project management (JIRA fix version tracking) is in crisis

2021-01-15 Thread Huaxiang Sun
Yeah, after multiple release efforts of 2.3.4 failed, I finally did a manual check. 1. got git logs for jiras from 2.3.3. 2. did a dry-run to generate CHANGES.md. I compared these two outputs and removed the common ones. The one left in 1) are issues in git and fixVersion not correctly setup in ji

Re: [VOTE] HBase 2.3.4 release candidate (RC4) is available

2021-01-16 Thread Huaxiang Sun
, Jan 15, 2021 at 11:51 AM Huaxiang Sun wrote: > Yeah, that is true. It is fixed by HBASE-25238, I did the manual check. > Leaving this question to dev discussion. There are multiple rounds of > effort for this 2.3.4 release. > Unless it is a real issue, hope this vote does not sink jus

Re: [VOTE] HBase 2.3.4 release candidate (RC4) is available

2021-01-17 Thread Huaxiang Sun
All tests: branch-2.3 nightly runs look good > (one consistent failure with TestSplitWALManager which is not > part of this RC and the work is in progress to resolve it) > * CHANGELOG: ok > * Release Notes: ok > * CRUD: ok > > > On 2021/01/15 03:03:47, Huaxiang Sun

Re: [VOTE] Third release candidate for HBase 2.4.1 (RC2) is available

2021-01-17 Thread Huaxiang Sun
+ 1(non-binding). * Signature: ok * Checksum : ok * Rat check (1.8.0_242): ok - mvn clean apache-rat:check * Built from source (1.8.0_242): ok - mvn clean install -DskipTests * Unit tests pass (1.8.0_242): ok - mvn package

Re: [VOTE] HBase 2.3.4 release candidate (RC4) is available

2021-01-19 Thread Huaxiang Sun
Hi Folks, The 2.3.4RC4 vote has been up for 4 days, so far, we got 1 +1 (binding), 1 +1 (non-binding). When you have a moment, please vote. Thanks Your HBase Release Manager On Sun, Jan 17, 2021 at 10:08 PM Huaxiang Sun wrote: > >Put 2.4.0 to a 15 node cluster (3 masters, 12

Re: [VOTE] HBase 2.3.4 release candidate (RC4) is available

2021-01-21 Thread Huaxiang Sun
- mvn package -P runAllTests -D skipTests -D hadoop.profile=3.0 > > -Dsurefire.rerunFailingTestsCount=3 > > * bin tarball launches on JDK 11.0.8+10. > > * Revision number on webUI matches tag in git. > > * Jenkins builds have been broken lately,

Re: [VOTE] HBase 2.3.4 release candidate (RC4) is available

2021-01-22 Thread Huaxiang Sun
With four (4) binding +1 votes, and one (1) nonbinding +1 vote, and no 0 or -1 votes, this vote passes. Thanks to all who voted on the release candidate. On Thu, Jan 21, 2021 at 11:55 AM Huaxiang Sun wrote: > We have enough affirmative votes (4 binding +1s) to close this vote and > the v

[ANNOUNCE] Apache HBase 2.3.4 is now available for download

2021-01-22 Thread Huaxiang Sun
The HBase team is happy to announce the immediate availability of HBase 2.3.4. Apache HBase™ is an open-source, distributed, versioned, non-relational database. Apache HBase gives you low latency random access to billions of rows with millions of columns atop non-specialized hardware. To lear

2.3.5 RC next week

2021-03-17 Thread Huaxiang Sun
There will be a RC for 2.3.5 available for voting next week. If you have any pending work and need assistance to get it committed please let me know.

Re: Time to 2.3.5 (was: Delaying 2.3.5 another month)

2021-03-22 Thread Huaxiang Sun
Thanks Nick. I am starting the release process today. Huaxiang On Wed, Mar 17, 2021 at 10:28 AM Nick Dimiduk wrote: > Hi Everyone, > > Looks like we have a nice 40-ish commits on branch-2.3, so I think it's > time for another release. Huaxiang has again volunteered to run this > release, so I w

[VOTE] HBase 2.3.5 release candidate (RC1) is available

2021-03-26 Thread Huaxiang Sun
Please vote on this Apache hbase release candidate, hbase-2.3.5RC1 The VOTE will remain open for at least 72 hours. [ ] +1 Release this package as Apache hbase 2.3.5 [ ] -1 Do not release this package because ... The tag to be voted on is 2.3.5RC1: https://github.com/apache/hbase/tree/2

Re: [VOTE] HBase 2.3.5 release candidate (RC1) is available

2021-03-28 Thread Huaxiang Sun
+ 1 (non-binding) * Signature: ok * Checksum : ok * Rat check (1.8.0_242): ok - mvn clean apache-rat:check * Built from source (1.8.0_242): ok - mvn clean install -DskipTests * Unit tests pass (1.8.0_242): ok - mvn package

  1   2   3   4   >