Re: Updated 2.8.0-SNAPSHOT artifact

2016-11-09 Thread Karthik Kambatla
If there is interest in releasing off of branch-2.8, we should definitely do that. As Sangjin mentioned, there might be value in doing 2.9 off branch-2 too. How do we go about maintenance releases along those minor lines, and when would we discontinue 2.6.x/2.7.x releases? On Wed, Nov 9, 2016 at

Re: [DISCUSS] Release cadence and EOL

2016-11-09 Thread Karthik Kambatla
Fair points, Sangjin and Andrew. To get the ball rolling on this, I am willing to try the proposed policy. On Fri, Nov 4, 2016 at 12:09 PM, Andrew Wang wrote: > I'm certainly willing to try this policy. There's definitely room for > improvement when it comes to streamlining the release process.

Re: Multiple node Hadoop cluster on Docker for test and debugging

2016-11-09 Thread Roman Shaposhnik
On Wed, Nov 9, 2016 at 9:30 AM, Zhe Zhang wrote: > Nice work Kai! Quick comment: have you considered Bigtop? It allows > creating a multi-node docker cluster too. But I'm not sure if Bigtop takes > a custom built Hadoop (from the instructions I read, it builds from a > certain git branch; I'm not

Re: Updated 2.8.0-SNAPSHOT artifact

2016-11-09 Thread Ming Ma
I would also prefer releasing current 2.8 branch sooner. There are several incomplete features in branch-2 such as YARN-914 and HDFS-7877 that are better served if we can complete them in the next major release. Letting them span across multiple releases might not be desirable as there could be som

Re: Multiple node Hadoop cluster on Docker for test and debugging

2016-11-09 Thread Mingliang Liu
I know a similar tool; it has Ambari and Spark integration as well. https://github.com/weiqingy/caochong Thanks, L > On Nov 9, 2016, at 5:38 AM, Sasaki Kai wrote: > > Hi Hadoop developers > > The other day I created a tool for launching multiple node h

Apache Hadoop qbt Report: trunk+JDK8 on Linux/ppc64le

2016-11-09 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/150/ [Nov 8, 2016 3:25:10 PM] (brahma) HADOOP-13707. If kerberos is enabled while HTTP SPNEGO is not [Nov 8, 2016 10:01:26 PM] (jlowe) YARN-5356. NodeManager should communicate physical resource capability [Nov

Re: Multiple node Hadoop cluster on Docker for test and debugging

2016-11-09 Thread Zhe Zhang
Nice work Kai! Quick comment: have you considered Bigtop? It allows creating a multi-node docker cluster too. But I'm not sure if Bigtop takes a custom built Hadoop (from the instructions I read, it builds from a certain git branch; I'm not sure if that customizable). On Wed, Nov 9, 2016 at 5:39 A

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2016-11-09 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/220/ [Nov 8, 2016 9:27:56 AM] (varunsaxena) MAPREDUCE-6782. JHS task page search based on each individual column not [Nov 8, 2016 3:25:10 PM] (brahma) HADOOP-13707. If kerberos is enabled while HTTP SPNEGO is n

Multiple node Hadoop cluster on Docker for test and debugging

2016-11-09 Thread Sasaki Kai
Hi Hadoop developers The other day I created a tool for launching multiple node hadoop cluster on docker container. You can easily launch multiple node hadoop cluster from your Hadoop source code. It is useful for testing and debugging. Actually I often use it before submitting a patch to Hado