Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

2019-10-22 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/483/ [Oct 22, 2019 6:46:25 PM] (jhung) HDFS-14667. Backport [HDFS-14403] "Cost-based FairCallQueue" to [Oct 22, 2019 11:43:25 PM] (weichiu) HDFS-13901. INode access time is ignored because of race between

Re: [VOTE] Release Apache Hadoop 2.10.0 (RC0)

2019-10-22 Thread Jonathan Hung
Hi Eric, we've run some basic HDFS commands with a 3.2.1 namenode and 2.10.0 clients and datanodes. Everything worked as expected. Jonathan Hung On Tue, Oct 22, 2019 at 3:04 PM Eric Badger wrote: > Hi Jonathan, > > Thanks for putting this RC together. You stated that there are > improvements

Re: [VOTE] Release Apache Hadoop 2.10.0 (RC0)

2019-10-22 Thread Eric Badger
Hi Jonathan, Thanks for putting this RC together. You stated that there are improvements related to rolling upgrades from 2.x to 3.x and I know I have seen multiple JIRAs getting committed to that effect. Could you describe any tests that you have done to verify rolling upgrade compatibility for

Re: [VOTE] Release Apache Hadoop 2.10.0 (RC0)

2019-10-22 Thread Jonathan Hung
Thanks Konstantin and Zhankun. Unfortunately a feature slipped our radar (HDFS-14667). Since this is the first of a minor release, we would like to get it into 2.10.0. HDFS-14667 has been committed to branch-2.10.0, I will be rolling an RC1 shortly. Jonathan Hung On Tue, Oct 22, 2019 at 1:39

Re: How should we do about dependency update?

2019-10-22 Thread Wei-Chiu Chuang
Hi Sean, Thanks for the valuable feedback. Good point on not using dependency classes in public API parameters. One example is HADOOP-15502 (blame me for breaking the API) >From what I know, the biggest risk is that downstreamers include

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2019-10-22 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1297/ [Oct 21, 2019 12:50:00 PM] (ayushsaxena) HDFS-14916. RBF: line breaks are missing from the output of 'hdfs [Oct 21, 2019 1:05:12 PM] (ayushsaxena) HDFS-14913. Correct the value of available count in [Oct

Re: How should we do about dependency update?

2019-10-22 Thread Sean Busbey
speaking with my HBase hat on instead of my Hadoop hat, when the Hadoop project publishes that there's a CVE but does not include a maintenance release that mitigates it for a given minor release line, we assume that means the Hadoop project is saying that release line is EOM and should be

Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

2019-10-22 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/482/ [Oct 21, 2019 9:36:42 PM] (kihwal) HDFS-12749. DN may not send block report to NN after NN restart. -1 overall The following subsystems voted -1: asflicense findbugs hadolint pathlen unit xml

[jira] [Created] (HADOOP-16667) s3guard LimitExceededException -too many tables

2019-10-22 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-16667: --- Summary: s3guard LimitExceededException -too many tables Key: HADOOP-16667 URL: https://issues.apache.org/jira/browse/HADOOP-16667 Project: Hadoop Common

Re: [DISCUSS] ARM/aarch64 support for Hadoop

2019-10-22 Thread Zhenyu Zheng
Hi All, Some updates for ARM CI, our team has succesfully donated ARM resources and setup an ARM CI for Apache Spark: https://amplab.cs.berkeley.edu/jenkins/job/spark-master-test-maven-arm/ it will set to periodic job and then PR trigger when we think it is stable enough. I really hope we can do

Re: [VOTE] Release Apache Hadoop 2.10.0 (RC0)

2019-10-22 Thread Zhankun Tang
Thanks for the effort, Jonathan! +1 (non-binding) on RC0. - Set up a single node cluster with the binary tarball - Run Spark Pi and pySpark job BR, Zhankun On Tue, 22 Oct 2019 at 14:31, Konstantin Shvachko wrote: > +1 on RC0. > - Verified signatures > - Built from sources > - Ran unit tests

Re: [VOTE] Release Apache Hadoop 2.10.0 (RC0)

2019-10-22 Thread Konstantin Shvachko
+1 on RC0. - Verified signatures - Built from sources - Ran unit tests for new features - Checked artifacts on Nexus, made sure the sources are present. Thanks --Konstantin On Wed, Oct 16, 2019 at 6:01 PM Jonathan Hung wrote: > Hi folks, > > This is the first release candidate for the first