Re: [ANNOUNCE] New HBase committer Hui Ruan(阮辉)

Congratulations! On Fri, Sep 15, 2023 at 2:08 AM 张铎(Duo Zhang) wrote: > On behalf of the Apache HBase PMC, I am pleased to announce that Hui > Ruan(frostruan) > has accepted the PMC's invitation to become a committer on the > project. We appreciate all > of Hui's generous contributions thus far

Re: [ANNOUNCE] Devaraj Das joins the Apache HBase PMC

Congratulations! Thanks Stephen On Wed, Jul 5, 2017 at 11:00 AM, Karan Mehta wrote: > Congrats Devraj! > > On Wed, Jul 5, 2017 at 10:59 AM ramkrishna vasudevan < > ramkrishna.s.vasude...@gmail.com> wrote: > > > Congratulations, Devaraj !!! > > > > On Wed, Jul 5, 2017 at

Re: [ANNOUNCE] New HBase committer Huaxiang Sun

Congrats and welcome to the team! Stephen On Mon, Jun 19, 2017 at 1:43 PM, Mike Drob wrote: > Great work, Huaxiang! > > On Mon, Jun 19, 2017 at 2:30 PM, Sean Busbey wrote: > > > On behalf of the Apache HBase PMC, I am pleased to announce that > > Huaxiang

Re: HBaseCon2017 Registration is now Open!

Last year's PhoenixCon live stream the talk. In the past, people paid entry fee to come to HBaseCon, so I understand that the recording would be delayed. This year, the conference is free (thanks to Google), I just wonder whether live stream the talks is possible (or considered). Thanks Stephen

Re: VOTE: Merge new Assignment Manager AMv2), HBASE-14614

+1 for merge On Tue, May 30, 2017 at 2:05 PM, Umesh Agashe wrote: > +1 for merge. I have reviewed most of this work. > > On Tue, May 30, 2017 at 10:13 AM, Andrew Purtell > > wrote: > > > +1 for merge after all unit tests are passing. No problem

Re: org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot broken in branch-1?

/builds.apache.org/job/HBASE-Find-Flaky-Tests/ > lastSuccessfulBuild/artifact/dashboard.html > > It seems the test is flaky. > > FYI > > On Wed, Apr 26, 2017 at 2:25 PM, Stephen Jiang <syuanjiang...@gmail.com> > wrote: > > > I am running "org.apache.hadoop.hb

org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot broken in branch-1?

I am running "org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot" test in my local branch-1 today and it failed. I just wonder anyone else see the same failure? --- T E S T S ---

Re: ANNOUNCE: Yu Li joins the Apache HBase PMC

Congratulations, Yu! Keep up the good work! Thanks Stephen On Fri, Apr 14, 2017 at 6:54 PM, Jerry He wrote: > Congratulations and welcome, Yu! > > On Fri, Apr 14, 2017 at 6:47 PM, Andrew Purtell > wrote: > > > Congratulations and welcome! > > > > > >

Re: [ANNOUNCE] - Welcome our new HBase committer Anastasia Braginsky

Great! Congratulations and welcome to the team! Thanks Stephen On Mon, Mar 27, 2017 at 8:53 AM, Andrew Purtell wrote: > Congratulations and welcome! > > > On Mar 27, 2017, at 5:37 AM, ramkrishna vasudevan < > ramkrishna.s.vasude...@gmail.com> wrote: > > > > Hi All >

Re: ANNOUNCE: Good news!!!! Two new PMC and a new Committer!

Congratulations! Looking forward to working with all 3 of you and make HBase better! -Stephen On Fri, Mar 17, 2017 at 12:51 PM, Anoop John wrote: > Congrats all..Well deserving... > > -Anoop- > > On Sat, Mar 18, 2017 at 12:04 AM, Umesh Agashe >

Re: A suggestion for releasing major versions faster (Was: NOTICE: Nice testimony on benefits of the offheap read-path work now up on our blog)

I don't see a point to have branch-2 from branch-1. For customer/users, we always can have a 1.x release to give them all the features they want from branch-1. My understand is that one of the difference of major release and minor release is that major release could break some backward

would clean up znodes in HBASE 0.94 version cause any problem?

I know cleaning up znode in a late verion of HBase (1.x) would not have a problem. Restarting cluster would recreate znodes. For HBase 0.94, is this still true? (my guess is yes, but I'd like to check) Thanks Stephen

Re: Merge and HMerge

all HBaseAdmin.mergeRegions, which is the same path from the merge command through 'hbase shell'). Thanks Stephen On Fri, Jan 13, 2017 at 11:29 PM, Stack <st...@duboce.net> wrote: > On Fri, Jan 13, 2017 at 7:16 PM, Stephen Jiang <syuanjiang...@gmail.com> > wrote: > > > R

Re: Merge and HMerge

Revive this thread I am in the process of removing Region Server side merge (and split) transaction code in master branch; as now we have merge (and split) procedure(s) from master doing the same thing. The Merge tool depends on RS-side merge code. I'd like to use this chance to remove the

Re: Moving 2.0 forward

Hello, Andrew, I was a helper on Matteo so that we can help each other while we are focusing on the new Assignment Manager work. Now he is not available (at least in the next few months). I have to be more focused on the new AM work; plus other work in my company; it would be too much for me to

protobuf 2.5 and 3.1

master branch is in protobuf version 3.1; branch-1.1 is in protobuf version 2.5 I upgraded to version 3.1 in my machine so that I can work on master branch; now I need to run the protobuf to generate file in branch-1.1 and get the error: *[ERROR] Failed to execute goal

Re: [ANNOUNCE] New HBase committer Lijin Bin

Congrats! Welcome to the team! On Tue, Nov 29, 2016 at 7:16 PM, Enis Söztutar wrote: > Welcome! > > Enis. > > On Tue, Nov 29, 2016 at 5:36 PM, Heng Chen > wrote: > > > Congratulations!! > > > > 2016-11-30 6:42 GMT+08:00 Andrew Purtell

Re: mini cluster not starting due to unhandled com.lmax.disruptor.dsl.Disruptor. (eclipse only, not in mvn)

Thanks, forget the 'mvn eclipse:eclipse' trick. After doing this, things working again. Thanks Stephen On Sun, Nov 27, 2016 at 6:51 PM, 张铎 <palomino...@gmail.com> wrote: > Try mvn eclispe:eclipse again? We upgraded disruptor to 3.3.6 recently. > > 2016-11-28 10:48 GMT+08:0

mini cluster not starting due to unhandled com.lmax.disruptor.dsl.Disruptor. (eclipse only, not in mvn)

I had problem to start mini cluster in eclipse in the last few days. In master branch (without any additional change), I got the following FATAL error (running the UT using maven has NO problem): 2016-11-27 18:44:58,102 FATAL [M:0;10.10.0.153:59578] master.HMaster(2241): Master server abort:

Re: Branch off of master for HDFS space quota work? (HBASE-16961)

+1 on feature branch. Good way to do it while keeping master branch stable. On Thu, Nov 17, 2016 at 10:07 AM, Ted Yu wrote: > +1 on creating a feature branch (namely HBASE-16961). > > The number of child issues is not high at this moment. > > I would be happy to merge

HBASE 2.0 release progress

Hello, fellow HBASE developers, We are making progress towards HBASE 2.0 releases. I am using the following queries to search for on-going HBASE 2.0 feature work items (project = HBase AND (fixVersion = 2.0.0 OR affectedVersion = 2.0.0) AND resolution is EMPTY AND (issuetype != Bug AND issuetype

Re: set up hbase project in eclipse after protobuf3 change

til) where I don't see the red > underline. > > I am using Neon (4.6). > Which version of Eclipse are you using ? > > Cheers > > On Mon, Oct 10, 2016 at 11:15 AM, Stephen Jiang <syuanjiang...@gmail.com> > wrote: > > > More information: > > For example,

Re: set up hbase project in eclipse after protobuf3 change

tobuf.generated"* On Mon, Oct 10, 2016 at 11:09 AM, Stephen Jiang <syuanjiang...@gmail.com> wrote: > After the protobuf3 change, I update the eclipse by adding the > hbase-protocol-shaded module in the project by "import existing maven > project". However, eclipse di

set up hbase project in eclipse after protobuf3 change

After the protobuf3 change, I update the eclipse by adding the hbase-protocol-shaded module in the project by "import existing maven project". However, eclipse did not recognize this; it shows red underlines for the org.apache.hadoop.hbase.shaded.protobuf.generated.* (interestingly, I can run

Useless Coprocessors in Split transaction?

We have a lot of CPs in Split: I know Phoenix relies on preSplit; and I think someone is using postCompleteSplit. I just wonder whether "*preSplitBeforePONR*" and "*preSplitAfterPONR*" are useful - anyone is using it other than our testing? Can I safely remove them without breaking applications.

HBASE 2.0

Hello, All, It is time to discuss about the schedule of HBase 2.0 release. HBase 2.0 release is a big major release. When we release 1.0, we had 0.99 as dev preview/beta release. We should do something similar for the 2.0 release. Matteo and I talked about this. We think about that we need

info:sn and info:server in hbase:meta table

I scanned the hbase:meta table in a fresh-build master branch and get the following results. Seems to me that info:sn and info:server are some kind of duplicate (well, info:sn has the timestamp of RS, we could store this in info:server too if we want). Searching the code in master branch, I saw

Re: namespace quota not take effect

Could you check whether the "hbase.quota.enabled" is "true". If not set, default is false. Thanks Stephen On Wed, Aug 24, 2016 at 10:42 PM, Dima Spivak wrote: > Hey who.cat, > > I can't seem to reproduce this against master: > > [root@node-1 ~]# hbase shell > 2016-08-24

Re: HBCK options to disable master maintenance threads

> think, but we should deprecate those, and do -fixOverlaps and -fixHoles > separately. These two new commands will look at BOTH hdfs and meta to > decide on what to do. > > Enis > > On Mon, Jun 20, 2016 at 12:30 PM, Stephen Jiang <syuanjiang...@gmail.co

HBCK options to disable master maintenance threads

} else if (cmd.equals("-disableBalancer")) { setDisableBalancer(); } else if (cmd.equals("-disableSplitAndMerge")) { setDisableSplitAndMerge(); In HBCK, we will either use the options to disable master maintenance work (see above) or the master maintenance are

Re: RegionCoprocessorHost.preClose() execute multiple times

thanks, Matteo. I am surprised that this ancient JIRA is still OPEN. I put my comment in the JIRA and proposed a patch. Thanks Stephen On Mon, Jun 13, 2016 at 11:21 PM, Matteo Bertozzi <theo.berto...@gmail.com> wrote: > HBASE-8075 > > Matteo > > > On Tue, Jun 14,

RegionCoprocessorHost.preClose() execute multiple times

In RSRpcServices#closeRegion(), it calls RegionCoprocessorHost#preClose() first, then calls HRegionServer#closeRegion(). In HRegionServer#closeRegion(), the RegionCoprocessorHost#preClose() is called again. I just wonder whether the RegionCoprocessorHost#preClose() call in

Re: [ANNOUNCE] New HBase committer Apekshit Sharma

Welcome! Congratulations! Stephen On Fri, Jun 3, 2016 at 2:22 PM, Esteban Gutierrez wrote: > Awesome! congratulations and welcome Appy! > > -- > Cloudera, Inc. > > > On Fri, Jun 3, 2016 at 2:10 PM, Jerry He wrote: > > > Congrats and welcome, Appy! > >

Re: A checkstyle question: indentation in switch-case statements

, Matteo Bertozzi <theo.berto...@gmail.com> wrote: > I think it is complaining because the "case" is aligned with the "switch" > and not indented > > Matteo > > > On Wed, May 4, 2016 at 7:13 AM, Stephen Jiang <syuanjiang...@gmail.com> > wrote: &g

A checkstyle question: indentation in switch-case statements

I got two checkstyle warning for the style of switch-case statements: ./hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/AddColumnFamilyProcedure.java:386: cpHost.preAddColumnFamilyAction(tableName, cfDescriptor);: error: 'block' child have incorrect indentation

coprocessors in split region

during split region, we have a lot of coprocessors in RegionCoprocessorHost (some of them were added by https://issues.apache.org/jira/browse/HBASE-6633) public void preSplit(final byte[] splitRow) throws IOException {} public void postSplit(final Region l, final Region r) throws IOException

Re: [DISCUSS] hbase-2.0.x requires jdk8

Good idea and +1. Thanks Stephen On Sun, Apr 10, 2016 at 7:12 PM, ramkrishna vasudevan < ramkrishna.s.vasude...@gmail.com> wrote: > +1 > > On Mon, Apr 11, 2016 at 4:30 AM, Gerry Morales > wrote: > > > unsubscribe > > > > On Thu, Apr 7, 2016 at 9:18 PM, Stack

Re: Please welcome new HBase Committer Francis Liu

Congratulations and welcome! Stephen On Sun, Apr 10, 2016 at 10:23 PM, rajeshb...@apache.org < chrajeshbab...@gmail.com> wrote: > Congratulations Francis!! > > On Mon, Apr 11, 2016 at 10:30 AM, Anoop John > wrote: > > > Congrats. > > > > On Mon, Apr 11, 2016 at 9:19 AM,

Re: Please welcome new HBase committer Ashish Singhi

Congratulations! Best regards! Stephen On Sun, Apr 10, 2016 at 10:29 PM, ashish singhi wrote: > Thanks everyone for your kind words. > Hopefully I can repay you all with more patch contributions and reviews. > > Regards, > Ashish > > -Original Message- > From:

Re: [ANNOUNCE] New HBase committer Yu Li

Congratulations, Yu!!! On Wed, Mar 16, 2016 at 10:57 PM, Stack wrote: > One of us! > > On Wed, Mar 16, 2016 at 6:49 PM, Nick Dimiduk wrote: > > > On behalf of the Apache HBase PMC, I am pleased to announce that Yu Li > > has accepted the PMC's invitation

Re: Branch for 1.3

Thanks for Mikhail for taking the 1.3 RM role. Looks like we have a lot of new things in 1.3 release. Based on the experience of 1.1 and 1.2 release, it takes a lot of efforts to get a stable minor release out. From this, I have my own 2-cents on 1.4 release. The plan is to have 2.0 release

Re: [VOTE] HBase 1.2.0 RC0

The administrative tasks for proc-v2 (5 JIRAs: HBASE-14107, HBASE-14108, HBASE-14487, HBASE-14488, and HBASE-14432) would be useful for debugging or unblocking hanging procedures in master DDL. The change is local and low risk. Discussing with Sean and Matteo privately, they agreed to include

Question on 1.1.4 commits

Nick, since 1.1.3 has not out yet. Should all JIRAs resolves as 1.1.4 be marked 1.1.3? I saw Sean moved a bunch of 1.2.1 to 1.2.0. I just wonder whether we need to do the same for 1.1 line. Thanks Stephen

Re: Question on 1.1.4 commits

great! thanks, Nick. On Tue, Dec 8, 2015 at 8:56 AM, Nick Dimiduk <ndimi...@apache.org> wrote: > Yeah, I'll do the same (move 1.1.4 -> 1.1.3) when I prepare release notes > for the next RC. > > > On Tuesday, December 8, 2015, Stephen Jiang <syuanjiang...@gmail.com

Re: MOB in branch-1? (Re: [RESULT][VOTE] Merge branch hbase-11339 HBase MOB to trunk)

ready to go back to branch-1 IMO. > >> > >> Are there users who'd like it backported? > >> St.Ack > >> > >> > >> On Mon, Oct 26, 2015 at 10:55 AM, Stephen Jiang < > syuanjiang...@gmail.com> > >> wrote: > >> > >>

MOB in branch-1? (Re: [RESULT][VOTE] Merge branch hbase-11339 HBase MOB to trunk)

Hello, guys, the MOB is in master branch. I saw bug fixes happening in master branch. I just wonder whether there is a plan to put MOB in branch-1. I am afraid if we don't do it now, it would be harder in the future to back port if we decide to do it in a late time. Thanks Stephen On Thu, Jul

master shell break? - LoadError: no such file to load -- shell/commands/compact_mob

When I tried to go to hbase shell in master branch this morning, I got the following error (it worked three days ago): $ ./bin/hbase shell LoadError: no such file to load -- shell/commands/compact_mob require at org/jruby/RubyKernel.java:1062 load_command at

Re: master shell break? - LoadError: no such file to load -- shell/commands/compact_mob

7. fixing. > > > > -- > Cloudera, Inc. > > > On Mon, Sep 28, 2015 at 10:46 AM, Jonathan Hsieh <j...@cloudera.com> wrote: > > > Might be related to this? > > > > https://issues.apache.org/jira/browse/HBASE-14227 > > > > Jon. > >

formatter.rb not respect width > 2 columns

It is interesting that in formatter.rb, if more than 2 columns, it would not respect the width passed in. Why is that? I am thinking about change it, but I'd like to know the reason behind it. Or is it ok to keep this way, even the output is not ideal? if args.length == 1 ...

Re: Planning for HBase 2.0

Agree. I think branch-1 will live for a long time (just like 0.98.x). My suggestion is that we should suspend more minor releases in 1.x line once 2.0 is released. Only patch releases in 1.x after 2.0 release is out. Thanks Stephen On Tue, Sep 8, 2015 at 2:41 PM, Matteo Bertozzi

Re: [DISCUSS] Updating stable release to 1.1.x

+1 love it. With 1.1 release entering into the 2nd dot release, it should be the most stable 1.x release so far. We should encourage people to download this release (instead of 1.0.x release line). Thanks Stephen On Wed, Sep 2, 2015 at 11:26 AM, Nick Dimiduk wrote: > I

Re: Proposal: Matteo for 2.0.0 RM

+1 On Fri, Aug 28, 2015 at 7:36 AM, Jonathan Hsieh j...@cloudera.com wrote: +1. On Fri, Aug 28, 2015 at 6:49 AM, Nicolas Liochon nkey...@gmail.com wrote: +1 On Fri, Aug 28, 2015 at 12:59 AM, la...@apache.org wrote: +1 From: Stack st...@duboce.net To: HBase Dev List

Re: Please welcome new HBase committer Stephen Yuan Jiang

~ -Shaohui Liu On 08/21/2015 10:12 AM, Ted Yu wrote: Congratulations Stephen. On Aug 20, 2015, at 7:09 PM, Andrew Purtell apurt...@apache.org wrote: On behalf of the Apache HBase PMC, I am pleased to announce that Stephen Jiang has

Re: DISCUSSION: lets do a developer workshop on near-term work

[Let us move back to the main topic - a meeting to talk about the next direction on HBASE development] Are we firm on the *August 26th* meeting date? Given the long list of topics from St.Ack, even a one day meeting might not cover all of them (in depth). We need to either trim the topic list

Why TableNamespaceManager#upsert abort master if failing to update zookeeper

I am working on moving namespace DDL to Proc-V2 and come to see this code. Looks like the logic exists since St.Ack implemented namespace in HBASE-8408. I just wonder whether the failure of zookeeper update is serve enough to shut down master (in my new code, I don't abort - I want to make sure

hbck -fixHdfsOverlaps and -fixHdfsHoles without -fixMeta

We have -fixHdfsOverlaps and -fixHdfsHoles options in hbck. This is to fix HDFS-level inconsistency only (can be run without HBASE running). However, I don't see how useful is this - we will create new region directory to merge overlapped regions or plug the hole in HDFS-level; however, the new

Re: Disable HBase System tables

or VisibilityController. As Srikanth mentioned, it is related to HBASE-13336. Should we avoid duplicate checking and make the logic/responsibility clear? The problem probably also exist for the delete/alter/modify table operations. Jerry On Fri, Apr 3, 2015 at 11:09 AM, Stephen Jiang syuanjiang

Re: Disable HBase System tables

it clearer :-). Now is too late :-(. On Thu, Apr 2, 2015 at 5:33 PM, Sean Busbey bus...@cloudera.com wrote: +1 disabling the visibility label table is going to be a bad time. Maybe just disallow for the whole hbase namespace? -- Sean On Apr 2, 2015 5:54 PM, Stephen Jiang syuanjiang

Disable HBase System tables

In disable table, we specifically check whether it is a META table; if a table is a META table, we disallow the table disable. However, I think other system tables should have the same treatment (is it possible that a namespace table is disable and the system is still functional without issue?).

Re: Question on DisableTableHandler#handleDisableTable()

retry, we can now (with procv2) inspect the status of the disable table operation and if it failed retry. Previously, there was no way. Enis On Tue, Mar 31, 2015 at 2:56 PM, Stephen Jiang syuanjiang...@gmail.com wrote: There is no retry in DisableTableHandler code. The sync version

Question on DisableTableHandler#handleDisableTable()

In DisableTableHandler#handleDisableTable(), we do the following: (1). Set the table state to DISABLING (2). Try to mark all regions of table (based on in-memory state of the active master) to offline (3). If 2 succeed, then set the table state to DISABLED My question is if (2) failed, it would

Re: Question on DisableTableHandler#handleDisableTable()

(in which case the new master takes over), no? On Tue, Mar 31, 2015 at 2:00 PM, Stephen Jiang syuanjiang...@gmail.com wrote: In DisableTableHandler#handleDisableTable(), we do the following: (1). Set the table state to DISABLING (2). Try to mark all regions of table (based on in-memory state

Question on HBaseFsck#checkRegionConsistency()

I am sure the following logic is a bug, but I'd like to know the rational behind it so that I can fix it correctly. In HBaseFsck#checkRegionConsistency(), we skip some regions that are recently changed. This is undesirable (at least in the situation I am testing). I can easily repro a problem

Re: Question on EnableTableHandler code

table). But result of that could be checked asyncronically from Admin. Does it make sense? On Mon, Mar 16, 2015 at 6:10 PM, Stephen Jiang syuanjiang...@gmail.com wrote: Andrey, I will take care of (1). And (2) :-) if your guys agree. Because it is not consistent, if the bulk assigned failed

Re: Question on EnableTableHandler code

to be later assigned by Balancer. On Mon, Mar 16, 2015 at 5:34 PM, Stephen Jiang syuanjiang...@gmail.com wrote: I want to make sure that the following logic in EnableTableHandler is correct: (1). In EnableTableHandler#prepare - if the table is not existed, it marked the table

Question on EnableTableHandler code

I want to make sure that the following logic in EnableTableHandler is correct: (1). In EnableTableHandler#prepare - if the table is not existed, it marked the table as deleted and not throw exception. The result is the table lock is released and the caller has no knowledge that the table not

Re: Question on EnableTableHandler code

(i.e. all internal structures reflect that fact and balancer knows about new table). But result of that could be checked asyncronically from Admin. Does it make sense? On Mon, Mar 16, 2015 at 6:10 PM, Stephen Jiang syuanjiang...@gmail.com wrote: Andrey, I will take care of (1

HBASE SHELL: Logic behind ZK cluster client port has to be the same as default port in config

In hbase shell code, the following *HMasterCommandLine#startMaster* code logic has been in the code forever :-). I just wonder what is the logic behind it why it is the case for the error message (shell will not be able to find this ZK quorum). - start zookeeper cluster and return the active ZK