Re: Not able to create a table in a single node set up with trunk

2014-11-07 Thread
You need to use different hbase-site.xml for master and regionserver, which means you should make two install directories, one for master and one for regionserver. The main reason is hbase.regionserver.port and hbase.regionserver.info.port must be different(otherwise you will get "java.net.BindExc

Re: Not able to create a table in a single node set up with trunk

2014-11-07 Thread
th the value in regionserver's hbase-site.xml Sorry for my English... 2014-11-07 21:55 GMT+08:00 张铎 : > You need to use different hbase-site.xml for master and regionserver, > which means you should make two install directories, one for master and one > for regions

Re: RS disk capacity limits

2014-12-12 Thread
I think 10 disks each 2TB is better. A disk can only seek about 50 times per second no matter it is 10TB or 2TB, so more disks means you can do more seeks and increase the random read write performance. 2014-12-13 9:04 GMT+08:00 Krishna : > > Hi, > > Is there any logical/practical limit on HBase R

Re: com/google/protobuf/Message not found Exception

2015-02-05 Thread
I'm not familiar with Karaf so I do not know what is a "feature" in Karaf. But hbase-client depends on many other jars, so usually you need to deploy them all, not only the hbase-client.jar and hadoop.jar. And for java programs, some people use maven-shade-plugin to pack a big jar with all depende

Re: [VOTE] Sixth release candidate for HBase 1.0.0 (RC5) is available. Please vote by Feb 19 2015

2015-02-18 Thread
TestCacheOnWrite itself has some problems. It uses TestHFileWriterV2.randomOrderedKey to generate a random byte array, then use first 32 bytes as row and other parts as family and qualifier, but TestHFileWriterV2.randomOrderedKey may return a byte array only contains 32 bytes, so there will be fami

Re: [VOTE] Sixth release candidate for HBase 1.0.0 (RC5) is available. Please vote by Feb 19 2015

2015-02-20 Thread
> > - Build src with hadoop versions 2.2.0 2.3.0 2.4.0 2.4.1 2.5.0 > 2.5.1 > > > > 2.5.2 2.6.0 > > > > - Deployed at a 6 node cluster with Hadoop-2.6.0 > > > > - Run LTT over tables with NONE, DIFF, FAST_DIFF, and PREFIX encoding > > > > - Ru

Re: feature request and question: "BigPut" and "BigGet"

2015-03-08 Thread
If LOB means data larger than 10MB or even 100MB, why not just use an FileSystem instead of HBase? For a FileSystem it already has the stream interface... 2015-03-09 10:55 GMT+08:00 Wilm Schumacher : > Hi, > > I have an idea for a feature in hbase which directly derives from the > idea of the MOB

I'm currently modifying the jenkins configuration

2015-03-17 Thread
Try to show jacoco coverage report. So do not worry about the "Integrated in HBase-TRUNK" error message posted on jira. I just abort a build. Or maybe more if it it does not work. I will finish this ASAP. Thanks.

Re: I'm currently modifying the jenkins configuration

2015-03-17 Thread
switch over when it does > what you want. > > -- > Sean > On Mar 17, 2015 8:01 AM, "Ted Yu" wrote: > > > Please let me know in case you need any help. > > > > Thanks > > > > > > > > > On Mar 17, 2015, at 1:19 AM, 张铎 wr

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2015-03-22 Thread
Going to change the config of HBase-TRUNK jenkins to show findbugs, checkstyle and jacoco coverage report. The config has been tested on https://builds.apache.org/job/HBase-TRUNK-jacoco for nearly 30 times. Not much different from HBase-TRUNK unless it runs ~30% slower(the overhead of collecting in

Re: [ANNOUNCE] Sean Busbey joins the Apache HBase PMC

2015-03-26 Thread
Congratulations! 2015-03-27 13:12 GMT+08:00 Rajeshbabu Chintaguntla : > Congratulations Sean! > > Thanks, > Rajeshbabu. > > On Fri, Mar 27, 2015 at 10:28 AM, liushaohui > wrote: > > > Congratulations, Sean! > > > > -Shaohui Liu > > > > > > On 03/27/2015 12:55 PM, Jerry He wrote: > > > >> Congrat

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2015-03-30 Thread
process I think, so it is safe to turn it on every time. Thanks. 2015-03-22 22:44 GMT+08:00 Ted Yu : > +1 on letting HBase-TRUNK jenkins show coverage report. > > Cheers > > On Sun, Mar 22, 2015 at 5:51 AM, 张铎 wrote: > > > Going to change the config of HBase-TRUNK

Re: Please welcome new HBase committer Srikanth Srungarapu

2015-04-02 Thread
Congratulations! 2015-04-02 15:56 GMT+08:00 Andrey Stepachev : > Congratulations, Srikanth! > > On Thu, Apr 2, 2015 at 7:57 AM, abhishek kr > wrote: > > > Congrats, Srikanth. > > > > Regards, > > Abhishek > > > > -Original Message- > > From: Andrew Purtell [mailto:apurt...@apache.org] >

Re: Please welcome new HBase committer Jing Chen (Jerry) He

2015-04-02 Thread
Congratulations! 2015-04-02 15:56 GMT+08:00 Andrey Stepachev : > Congrats, Jerry! > > On Thu, Apr 2, 2015 at 8:34 AM, abhishek kr > wrote: > > > Congrats, Jerry. > > > > Regards, > > Abhishek > > > > -Original Message- > > From: Ted Yu [mailto:yuzhih...@gmail.com] > > Sent: 02 April 2015

Re: A compact bug?

2015-04-21 Thread
I think it is a bug. According to the comment above, they just want to put system compactions(selectNow == false) to the small pool, so the code should like this ThreadPoolExecutor pool; if (selectNow) { pool = s.throttleCompaction(compaction.getRequest().getSize()) ? longCompactions : shortComp

Re: A compact bug?

2015-04-21 Thread
mpactions : > shortCompactions; > > if (this.parent != pool) { > > this.store.cancelRequestedCompaction(this.compaction); > > The above code would adjust to the correct pool, right ? > > > Cheers > > On Tue, Apr 21, 2015 at 7:10 AM, 张铎 wrote: > &g

Re: [DISCUSSION] Merge of the hbase-11339 mob branch into master.

2015-05-20 Thread
Is there any comparison between HBASE-11339 and HDFS-7240? Is their 'Object' a super set of our 'Medium Object'? 2015-05-21 10:38 GMT+08:00 Ted Yu : > This is a useful feature, Jon. > > I went over the mega-patch and left some comments on review board. > > I noticed that hbck was not included in

Re: Github PRs

2015-06-24 Thread
How does spark make use of Github? Seems they only use PRs to accept patches but still use apache jira. And for now, set up a bot that automatically comments on new PR to tell the contributor open issue on apache jira? 2015-06-25 3:45 GMT+08:00 Sean Busbey : > So for now comments on each pointin

Re: [ANNOUNCE] New HBase committer Esteban Gutierrez

2015-06-30 Thread
Congratulations! 2015-07-01 8:40 GMT+08:00 Jerry He : > Congrats and Welcome, Esteban! > > On Tue, Jun 30, 2015 at 5:37 PM, Apekshit Sharma > wrote: > > > Congrats Esteban! > > > > On Tue, Jun 30, 2015 at 5:33 PM, Jesse Yates > > wrote: > > > > > Congrats and welcome! > > > > > > On Tue, Jun 30

Re: [ANNOUNCE] New HBase committer Mikhail Antonov

2015-06-30 Thread
Congratulations! 2015-07-01 8:50 GMT+08:00 Srikanth Srungarapu : > Kudos, Mikhail! > > On Tue, Jun 30, 2015 at 5:42 PM Sean Busbey wrote: > > > congrats Mikhail! > > > > On Tue, Jun 30, 2015 at 7:14 PM, Andrew Purtell > > wrote: > > > > > On behalf of the Apache HBase PMC, I am pleased to annou

Re: Please welcome new HBase committer Stephen Yuan Jiang

2015-08-20 Thread
Congratulations! 2015-08-21 10:12 GMT+08:00 Ted Yu : > Congratulations Stephen. > > > > > On Aug 20, 2015, at 7:09 PM, Andrew Purtell wrote: > > > > On behalf of the Apache HBase PMC, I am pleased to announce that Stephen > > Jiang has accepted the PMC's invitation to become a committer on the >

Re: DISCUSS: Protobufs?

2016-02-01 Thread
https://groups.google.com/forum/#!topic/protobuf/wAqvtPLBsE8 PB2 and PB3 are wire compatible, and of course, protobuf-java is not compatible so dependency will be a problem... But I think the shaded client and server can solve the problem? Thanks. 2016-02-02 14:27 GMT+08:00 Stack : > We are run

Re: DISCUSS: Protobufs?

2016-02-02 Thread
https://github.com/grpc/grpc-java/issues/1054#issuecomment-147295224 > > > > > > St.Ack > > > > > > > > > On Mon, Feb 1, 2016 at 10:49 PM, Anoop John > > wrote: > > > > > > > UnsafeByteStrings - This may help us to avoid cop

Re: [DISCUSS] Dynamic switches in master

2016-02-03 Thread
My opinion, use conf file as default, and use code to override the config in conf file. And we need to persist the overridden value somewhere, not zk I'd say. I agree with Matteo that we should reduce the dependency of zk. Maybe we could introduce an hbase:config table? And for the dynamic configu

Re: [VOTE] HBase 1.2.0 RC2

2016-02-11 Thread
Should we include HBASE-15252? It is a data loss issue. 2016-02-12 7:34 GMT+08:00 Elliott Clark : > +1 > > Been running something close to RC in production for a while now. > Checked the layout everything looks good > Running ITBLL in a loop and there's no data loss. ( Sometimes the master > stil

Re: [VOTE] HBase 1.2.0 RC2

2016-02-12 Thread
2016 at 8:59 PM, Stack wrote: > > > On Thu, Feb 11, 2016 at 5:04 PM, Sean Busbey > > wrote: > > > >> On Feb 11, 2016 18:33, "张铎" wrote: > >> > > >> > Should we include HBASE-15252? It is a data loss issue. > >> > > >>

Re: [ANNOUNCE] New HBase committer Yu Li

2016-03-19 Thread
Congratulations! 2016-03-17 10:03 GMT+08:00 Ted Yu : > Congratulations, Yu. > > Keep up the good work. > > On Wed, Mar 16, 2016 at 6:49 PM, Nick Dimiduk wrote: > > > On behalf of the Apache HBase PMC, I am pleased to announce that Yu Li > > has accepted the PMC's invitation to become a committe

Re: Branch for 1.3

2016-03-21 Thread
At least include HBASE-15400 in 1.3 please... Otherwise these things can only be integrated in 1.4 since DTCP can not be used together with DefaultStoreEngine after HBASE-15400 getting in. 2016-03-22 2:03 GMT+08:00 Enis Söztutar : > You may want to track https://issues.apache.org/jira/browse/HBAS

Re: [DISCUSS] hbase-2.0.x requires jdk8

2016-04-08 Thread
+1 on jdk8 only. Bunch of code could be refactored with jdk8's new features, new classes and new methods. For example, most 'get->putIfAbsent->checkAndCleanUp' and 'get->lock->get again->put->unlock' can be replaced by computeIfAbsent. 2016-04-08 16:43 GMT+08:00 Elliott Clark : > As a side benefi

Re: [DISCUSS] No regions on Master node in 2.0

2016-04-08 Thread
Agree on the performance concerns. IMO we should not hurt the performance of small(maybe normal?) clusters when scaling for huge clusters. And I also agree that the current implementation which allows Master to carry system regions is not good(sorry for the chinglish...). At least, it makes the mas

Re: Please welcome new HBase Committer Francis Liu

2016-04-08 Thread
Congratulation! 2016-04-08 14:09 GMT+08:00 Heng Chen : > congrats! > > > 2016-04-08 13:30 GMT+08:00 Jesse Yates : > > > Congrats and welcome! > > > > On Thu, Apr 7, 2016 at 10:27 PM Ted Yu wrote: > > > > > Congratulations, Francis. > > > > > > > On Apr 7, 2016, at 10:19 PM, Stack wrote: > > > >

Re: Please welcome new HBase committer Ashish Singhi

2016-04-08 Thread
Congratulation! 2016-04-08 14:08 GMT+08:00 Heng Chen : > congrats! > > 2016-04-08 13:26 GMT+08:00 Ted Yu : > > > Congrats, Ashish. > > > > > On Apr 7, 2016, at 10:23 PM, Stack wrote: > > > > > > Ashish has contributed loads of stuff starting out basic doing rakes of > > > simple fixes but then r

Re: [DISCUSS] Shade protobuf so we can move to a newer version

2016-04-12 Thread
I think we could do it with some maven tricks. Just do not relocate the protobuf things in asyncwal? Move the related classes to a new sub project? Thanks. 2016-04-13 12:26 GMT+08:00 Sean Busbey : > On Tue, Apr 12, 2016 at 6:17 PM, Stack wrote: > > > > > > On an initial pass, the only difficult

Re: [DISCUSS] Make AsyncFSWAL the default WAL in 2.0

2016-04-28 Thread
Inline comments. Thanks, 2016-04-29 10:57 GMT+08:00 Sean Busbey : > I am nervous about having default out-of-the-box new HBase users reliant on > a bespoke HDFS client, especially given Hadoop's compatibility > promises and history. Answers for these questions would make me more > confident: > >

Re: [DISCUSS] Make AsyncFSWAL the default WAL in 2.0

2016-04-28 Thread
mplementation is not aim to get a good performance, just for compatibility with any FileSystem implementation. > > On Thu, Apr 28, 2016 at 8:30 PM, 张铎 wrote: > > > Inline comments. > > Thanks, > > > > 2016-04-29 10:57 GMT+08:00 Sean Busbey : > > > > >

Re: [DISCUSS] Make AsyncFSWAL the default WAL in 2.0

2016-04-28 Thread
GMT+08:00 Heng Chen : > The performance is quite great, but i think maybe we should collect some > experience on real production cluster before we make it as default. > > 2016-04-29 11:30 GMT+08:00 张铎 : > > > Inline comments. > > Thanks, > > > > 2016-04-29 10

Re: [DISCUSS] Make AsyncFSWAL the default WAL in 2.0

2016-04-28 Thread
le for their users. > You can still use FSHLog, it is not removed... But yes, this is a good point on how we choose default configs in HBase. A config that performs normally for every case, or a config that performs much better under the main scenario but worse for other scenarios... >

Re: [DISCUSS] Make AsyncFSWAL the default WAL in 2.0

2016-04-28 Thread
for their users. > > > > > Just use FSHLog instead of asyncfswal when up on WASB. Its just a config > change. > > St.Ack > > > > > On Thu, Apr 28, 2016 at 8:39 PM, 张铎 wrote: > > > > > 2016-04-29 11:35 GMT+08:00 Ted Yu : > > > > > > &

Re: [DISCUSS] Make AsyncFSWAL the default WAL in 2.0

2016-04-29 Thread
> > early. > > + The improvement in throughput is substantial > > + There are now less moving parts > > + A critical piece of our write path is much less opaque in its workings > > and no longer (effectively) immutable > > > > St.Ack > > > > > > On

Re: [DISCUSS] Make AsyncFSWAL the default WAL in 2.0

2016-05-01 Thread
I checked the code. The HdfsFileStatus returned when creating of a file inside encryption zone will contain a FileEncryptionInfo. DFSClient will create a CryptoOutputStream which wraps a DFSOutputStream based on the FileEntryptionInfo. Let me file issue to implement it. Just another piece of refle

Re: [DISCUSS] Make AsyncFSWAL the default WAL in 2.0

2016-05-02 Thread
Fine, will add the testcase. And for the RPC, we only implement a new client side DTP here and still use the original RPC. Thanks. 2016-05-03 3:20 GMT+08:00 Gary Helmling : > On Fri, Apr 29, 2016 at 6:24 PM 张铎 wrote: > > > Yes, it does. There is testcase that enumerates all

Re: [DISCUSS] Make AsyncFSWAL the default WAL in 2.0

2016-05-05 Thread
Some progress. I have filed HBASE-15743 for the transparent encryption support, and HBASE-15754 for the AES encryption UT. Now both of them are resolved. Let's resume the discussion here. Thanks. 2016-05-03 10:09 GMT+08:00 张铎 : > Fine, will add the testcase. > > And for th

Re: [DISCUSS] Make AsyncFSWAL the default WAL in 2.0

2016-05-10 Thread
; > > would be fine if you have to enable it and it has warnings and is clear > > on > > > circumstances under which there could be dataloss. > > > > > > St.Ack > > > > > > > > > > > >> btw, I'm +1 about making

Re: [DISCUSS] Make AsyncFSWAL the default WAL in 2.0

2016-05-10 Thread
of hadoop-2.8.0. Thanks. 2016-05-10 16:23 GMT+08:00 张铎 : > Yeah the 'push to upstream' work has been started already. See here > > https://issues.apache.org/jira/browse/HADOOP-12910 > > But it is much harder to push code into HDFS than HBase. It is the core of > all

Re: [DISCUSS] Make AsyncFSWAL the default WAL in 2.0

2016-05-10 Thread
See HDFS-223 and HDFS-916. There are plenty of issues related. The most important thing is that we need a suitable api and there is an asynchronous file system proposal in HADOOP-12910 which does not fit our requirements so I need to stop it being committed first... And a default choice in a later

Re: [DISCUSS] Make AsyncFSWAL the default WAL in 2.0

2016-05-11 Thread
I think at that time I will start a new project called AsyncDFSClient which will implement the whole client side logic of HDFS without using reflection :) 2016-05-12 10:27 GMT+08:00 Andrew Purtell : > If Hadoop refuses the changes before we release, we can change the default > back. > > > On May

Re: [DISCUSS] HBase-2.0 SHOULD be rolling upgradable and wire-compatible with 1.x

2016-06-21 Thread
+1 on requiring upgrading to one of the latest 1.x.y before upgrading to 2.0. 2016-06-21 14:30 GMT+08:00 Matteo Bertozzi : > I think everyone wants rolling upgrade. the discussion should probably be > around how much compatibility code do we want to keep around. > > using as example HBASE-16060,

Re: Source incompatibility between 1.2.[0,1] and 1.2.2 breaks Phoenix

2016-08-15 Thread
Yes, with jdk8 we could add new methods in interface without breaking the sub classes. So let's revert HBASE-15645 from branch-1 and branch-1,x and add default implementations in master? Is yetus OK to run pre-commit with jdk8 only on master now? Thanks. 2016-08-16 13:12 GMT+08:00 Sean Busbey :

Re: 答复: [ANNOUNCE] Duo Zhang (张铎) joins the Apache HBase PMC

2016-09-06 Thread
Thanks all. Will do my best. 2016-09-07 13:58 GMT+08:00 Honghua Feng 冯宏华 : > Congratulations, Duo. > > 发件人: Ted Yu > 发送时间: 2016年9月7日 12:31 > 收件人: u...@hbase.apache.org > 抄送: HBase Dev List > 主题: Re: [ANNOUNCE] Duo Zhang (张铎) joins

Re: [ANNOUNCE] Misty Stanley-Jones joins the Apache HBase PMC

2016-09-07 Thread
Congratulations! 2016-09-08 7:56 GMT+08:00 Jonathan Hsieh : > Congrats Misty! > > On Wed, Sep 7, 2016 at 11:40 AM, Sean Busbey wrote: > > > On behalf of the Apache HBase PMC I am pleased to announce that Misty has > > accepted our invitation to become a PMC member on the Apache HBase > project.

Re: [DISCUSS] Drop the support of jdk7 at a future 1.x release

2016-09-09 Thread
Yeah I'm currently working on HBASE-16591 to bring our master build pipeline to jdk8 only... 2016-09-10 2:11 GMT+08:00 Josh Elser : > > > Sean Busbey wrote: > >> This would be a very big breaking change in release numbering that goes >> against our compatibility guidelines. We only drop support f

Re: Failure: HBase Generate Website

2016-09-12 Thread
Ah we also need to use java8 for the jenkins jobs... Thanks for quick action. 2016-09-12 22:32 GMT+08:00 Dima Spivak : > Looks like our new Java 8 requirement for master broke this one. I'll fix > it shortly... > > On Monday, September 12, 2016, Apache Jenkins Server < > jenk...@builds.apache.or

Re: [DISCUSSION] MR jobs started by Master or RS

2016-09-22 Thread
I‘m -1 on let master or rs launch MR jobs. It is OK that some of our features depend on MR but I think the bottom line is that we should launch the jobs from outside manually or by other services. 2016-09-23 9:47 GMT+08:00 Andrew Purtell : > Ok, got it. Well "shelling out" is on the line I think,

Re: [DISCUSSION] MR jobs started by Master or RS

2016-09-22 Thread
everyone should use it, then we'd better implement it without MR dependency, like DLS. Thanks. 2016-09-23 10:11 GMT+08:00 张铎 : > I‘m -1 on let master or rs launch MR jobs. It is OK that some of our > features depend on MR but I think the bottom line is that we should launch > the job

Re: [DISCUSSION] MR jobs started by Master or RS

2016-09-22 Thread
normally (post merge). > >>> > >>> In terms of build time dependency, we have long been depending on > >>> mapreduce. Take a look at ExportSnapshot. > >>> > >>> Cheers > >>> > >>> On Thu, Sep 22, 2016 at 7:42 PM, Heng

Re: [DISCUSSION] MR jobs started by Master or RS

2016-09-22 Thread
ures run ? > > To my understanding, errors in one procedure are isolated, not having > adverse impact on Master's stability. > > On Thu, Sep 22, 2016 at 8:32 PM, 张铎 wrote: > > > So what about a standalone service other than master? You can use your > own > > proced

Re: [DISCUSSION] MR jobs started by Master or RS

2016-09-22 Thread
n the future, we find better ways of doing this without using MR, we > can certainly consider that. But IMO don't think we should block this patch > from getting merged. > > > From: 张铎 > Sent: Thursday, September 22, 2016 8:32 PM > To: dev@hbase.apache.org >

Re: [DISCUSSION] MR jobs started by Master or RS

2016-09-22 Thread
ome of the above management. > > > > Guys, just to reiterate, the patch as such is ready from the overall > > design/arch point of view (maybe code review is still pending from > Matteo). > > If in the future, we find better ways of doing this without using MR, we >

Re: [DISCUSSION] MR jobs started by Master or RS

2016-09-23 Thread
fic as to which code is ugly ? Is it in the backup / > restore mega patch ? > > Cheers > > On Thu, Sep 22, 2016 at 10:44 PM, 张铎 wrote: > > > If you guys have already implemented the feature in the MR way and the > > patch is ready for landing on master, I'm a -0 on it

Re: [NOTICE] Merge of shaded protobuf 3.1.0 (WAS => [DISCUSS] Shade protobuf so we can move to a newer version)

2016-10-01 Thread
Can we setup a compatibility checker job in jenkins? Start a minicluster in one process, and use a client in another process to communicate with it. The version of the client should be >= 0.98 and <= the version of the minicluster. Of course we need to design the testing code carefully to make sure

Re: [NOTICE] Merge of shaded protobuf 3.1.0 (WAS => [DISCUSS] Shade protobuf so we can move to a newer version)

2016-10-01 Thread
2016-10-02 0:50 GMT+08:00 Stack : > On Sat, Oct 1, 2016 at 7:20 AM, 张铎 wrote: > > > Can we setup a compatibility checker job in jenkins? Start a minicluster > in > > one process, and use a client in another process to communicate with it. > > The version of the c

Re: [NOTICE] Merge of shaded protobuf 3.1.0 (WAS => [DISCUSS] Shade protobuf so we can move to a newer version)

2016-10-01 Thread
Do we need to install protoc 3.0 manully before building HBase or the maven protobuf plugin will automatically download the protoc compiler? Maybe we need to install protoc 3.0 in the precommit docker file. 2016-10-02 14:20 GMT+08:00 张铎 : > > 2016-10-02 0:50 GMT+08:00 Stack : > >>

Re: [NOTICE] Merge of shaded protobuf 3.1.0 (WAS => [DISCUSS] Shade protobuf so we can move to a newer version)

2016-10-03 Thread
> > Unlike with the scala compiler, which is after all JVM bytecode at a > fundamental level, I don't think maven automation for automatic download > and execution is possible. protoc is a native binary. > > > On Oct 1, 2016, at 11:30 PM, 张铎 wrote: > > > >

Re: [NOTICE] Merge of shaded protobuf 3.1.0 (WAS => [DISCUSS] Shade protobuf so we can move to a newer version)

2016-10-03 Thread
mit (jenkins is being ornery). > > > > > > St.Ack > > > 1. > > > https://builds.apache.org/job/HBASE-16264/jdk=JDK%201.8%20( > > > latest),label=yahoo-not-h2/28/console > > > > > > Service Unavailable > > > > > > The

Re: [NOTICE] Merge of shaded protobuf 3.1.0 (WAS => [DISCUSS] Shade protobuf so we can move to a newer version)

2016-10-04 Thread
Oct 3, 2016 at 5:40 PM, 张铎 wrote: > > > OK, this means we will still use pb2.5 for hbase-protocol? And > > hbase-protocol-shaded is maintained manually? I still think the precommit > > job should have the ability to check the hbase-protocol-shaded... > > > > >

Re: [NOTICE] Merge of shaded protobuf 3.1.0 (WAS => [DISCUSS] Shade protobuf so we can move to a newer version)

2016-10-04 Thread
I think we could optimize the protobuf stuffs later? > > > On Oct 1, 2016, at 11:30 PM, 张铎 wrote: > > > > Do we need to install protoc 3.0 manully before building HBase or the > maven > > protobuf plugin will automatically download the protoc compiler? Maybe we > >

Re: Still Failing: HBase Generate Website

2016-10-08 Thread
This maybe related to a jruby issue. https://github.com/jruby/jruby/issues/2913 It depends on the environment thus it may fail on some machines while success on some other machines. 2016-10-09 9:29 GMT+08:00 Ted Yu : > This was the build 16750 went into: > > https://builds.apache.org/job/hbase_

Re: Still Failing: HBase Generate Website

2016-10-08 Thread
ent issue. > > Build #368 (green) was on H4 while #369 was on H0. #370 was on H1. > > On Sat, Oct 8, 2016 at 6:32 PM, 张铎 wrote: > > > This maybe related to a jruby issue. > > > > https://github.com/jruby/jruby/issues/2913 > > > > It depends on the env

Re: Still Failing: HBase Generate Website

2016-10-10 Thread
ber 9, 2016, stack wrote: > > > > > Did you do the revert meantime Ted? > > > > > > On Oct 8, 2016 19:01, "Ted Yu" > > > wrote: > > > > > > > Logged INFRA-12731 > > > > > > > > On

Re: Still Failing: HBase Generate Website

2016-10-10 Thread
; > To my knowledge, nobody has access to H0 (or any other Jenkins machines) > other than Apache admins. > > On Mon, Oct 10, 2016 at 6:32 PM, 张铎 wrote: > > > Could the infra team give us a temporary permission to login H0 and run > > some builds manually? > > > &g

Re: [ANNOUNCE] Stephen Yuan Jiang joins Apache HBase PMC

2016-10-16 Thread
Congratulations! 2016-10-17 9:07 GMT+08:00 Heng Chen : > Congrats! :) > > 2016-10-16 8:19 GMT+08:00 Jerry He : > > Congratulations, Stephen. > > > > Jerry > > > > On Fri, Oct 14, 2016 at 12:56 PM, Dima Spivak > wrote: > > > >> Congrats, Stephen! > >> > >> -Dima > >> > >> On Fri, Oct 14, 2016 at

Re: [DISCUSS] Drop legacy hadoop support at the 2.0 release

2016-10-19 Thread
OK, seems no objection. I will file a issue to modify the hadoop version support matrix. And I think we also need to change the hadoopcheck versions for our precommit check? Thanks all. 2016-10-20 1:14 GMT+08:00 Andrew Purtell : > FWIW, we are running 2.7.x in production and it's stable. > > >

Re: [DISCUSS] Drop legacy hadoop support at the 2.0 release

2016-10-20 Thread
See HBASE-16887 2016-10-20 22:50 GMT+08:00 Sean Busbey : > Unfortunately, I think this means we'll need to update the hadoopcheck > versions to vary by branch. > > On Wed, Oct 19, 2016 at 6:21 PM, 张铎 wrote: > > OK, seems no objection. I will file a issue to modify the had

Re: Please update your jenkins job configs ASAP

2016-11-13 Thread
https://builds.apache.org/job/PreCommit-HBASE-Build/4428/consoleFull This one was executed on H18 but still failed because of OOM, so I guess the problem is not H2? 2016-11-12 2:37 GMT+08:00 Stack : > Thanks Gavin. The not-h2 label was added because our jobs were failing when > they ran on h2. >

Re: DISCUSS: Strip xref from our site generation

2016-11-17 Thread
+1. 2016-11-17 15:57 GMT+08:00 Nick Dimiduk : > Agree the value add is minimal. > > On Wed, Nov 16, 2016 at 9:41 PM Stack wrote: > > > The xref pages were useful once before grepcode and easy navigation in > > apache git and github. Now, not so much. It is a long time since I've > seen > > anyon

Re: Use experience and performance data of offheap from Alibaba online cluster

2016-11-18 Thread
I can not see the images either... Du, Jingcheng 于2016年11月18日 周五16:57写道: > Thanks Yu for the sharing, great achievements. > It seems the images cannot be displayed? Maybe just me? > > Regards, > Jingcheng > > From: Yu Li [mailto:car...@gmail.com] > Sent: Friday, November 18, 2016 4:11 PM > To: u.

Re: mini cluster not starting due to unhandled com.lmax.disruptor.dsl.Disruptor. (eclipse only, not in mvn)

2016-11-27 Thread
Try mvn eclispe:eclipse again? We upgraded disruptor to 3.3.6 recently. 2016-11-28 10:48 GMT+08:00 Stephen Jiang : > I had problem to start mini cluster in eclipse in the last few days. In > master branch (without any additional change), I got the following FATAL > error (running the UT using ma

Re: meta region written by 2.0 cannot be opened by 1.x

2016-12-06 Thread
Could this be solved by hosting meta only on master? BTW, MetaCellComparator is introduced in HBASE-10800. Thanks. 2016-12-06 17:44 GMT+08:00 Ted Yu : > Hi, > When I restarted a cluster with 1.1 , I found that hbase:meta region > (written to by the previously deployed 2.0) couldn't be opened: >

Re: meta region written by 2.0 cannot be opened by 1.x

2016-12-07 Thread
#x27;t include HBASE-16189 > > >> >> > > <https://issues.apache.org/jira/browse/HBASE-16189> > > >> >> > > > > >> >> > > Once it is included, the cluster can be downgraded fine. > > >> >> > > > >

Re: meta region written by 2.0 cannot be opened by 1.x

2016-12-07 Thread
See this one https://issues.apache.org/jira/browse/HBASE-14949 2016-12-07 18:09 GMT+08:00 Ted Yu : > Which other features ? > Can you name them ? > > Thanks > > On Wed, Dec 7, 2016 at 2:06 AM, 张铎 wrote: > > > I believe there are other features that require upgradin

Re: meta region written by 2.0 cannot be opened by 1.x

2016-12-07 Thread
And a bad news is that this patch is not contained in 1.2.x and 1.1.x which means it is not safe to rolling upgrade from 1.2.x or 1.1.x to 2.0 if we change the default wal implementation to AsyncFSWA, or a user set the wal implementation to asyncfs manually... 2016-12-07 18:17 GMT+08:00 张铎

Re: meta region written by 2.0 cannot be opened by 1.x

2016-12-07 Thread
e Change ? > > On Wed, Dec 7, 2016 at 2:17 AM, 张铎 wrote: > > > See this one > > > > https://issues.apache.org/jira/browse/HBASE-14949 > > > > 2016-12-07 18:09 GMT+08:00 Ted Yu : > > > > > Which other features ? > > > Can you name t

Re: protobuf 2.5 and 3.1

2016-12-09 Thread
In master we use protobuf-maven-plugin to run protoc. The plugin will download protoc binary from the maven repo so you do not need to install protoc on your machine manually. So you can just install pb 2.5 on your machine. For the general question that how to have 2 protobuf versions on one mach

Re: [ANNOUNCE] New HBase Committer Josh Elser

2016-12-11 Thread
Congratulations! 2016-12-12 9:03 GMT+08:00 Jerry He : > Congratulations , Josh! > > Good work on the PQS too. > > Jerry > > On Sun, Dec 11, 2016 at 12:14 PM, Josh Elser wrote: > > > Thanks, all. I'm looking forward to continuing to work with you all! > > > > > > Nick Dimiduk wrote: > > > >> On b