Re: [VOTE] Release Apache Hadoop 3.1.0 (RC1)

Hi Vinod / Arpit, I checked following versions: - 2.6.5 / 2.7.5 / 2.8.3 / 2.9.0 / 3.0.1: Jars in maven repo [1] are *always* different from jars in the binary tarball [2]: (I only checked hadoop-yarn-api-version.jar) (Following numbers are sizes of the jar) 2.6.5: - Jar in Maven: 1896185 - Jar

Apache Hadoop qbt Report: trunk+JDK8 on Windows/x64

For more details, see https://builds.apache.org/job/hadoop-trunk-win/426/ [Apr 2, 2018 2:26:01 PM] (wangda) YARN-7142. Support placement policy in yarn native services. (Gour Saha [Apr 2, 2018 2:52:40 PM] (stevel) HADOOP-15146. Remove DataOutputByteBuffer. Contributed by BELUGA BEHR. [Apr 2,

Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

For more details, see https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/184/ [Apr 3, 2018 5:55:03 AM] (xiao) HADOOP-15317. Improve NetworkTopology chooseRandom's loop. [Apr 3, 2018 6:10:35 AM] (xiao) HADOOP-15355. TestCommonConfigurationFields is broken by HADOOP-15312. [Apr 3,

Re: [VOTE] Release Apache Hadoop 3.1.0 (RC1)

+1 (non binding) * Deployed with 4 subclusters with HDFS Router-based federation. * Executed DistCp across subclusters through the Router * Checked documentation and tgz On Tue, Apr 3, 2018 at 4:25 PM, Vinod Kumar Vavilapalli wrote: > We vote on the source code. The

Re: [VOTE] Release Apache Hadoop 3.1.0 (RC1)

We vote on the source code. The binaries are convenience artifacts. This is what I would do - (a) Just replace both the maven jars as well as the binaries to be consistent and correct. And then (b) Give a couple more days for folks who tested on the binaries to reverify - I count one such clear

Re: [VOTE] Release Apache Hadoop 3.1.0 (RC1)

HI Arpit, I think it won't match if we do rebuild. It should be fine as far as they're signed, correct? I don't see any policy doesn't allow this. Thanks, Wangda On Tue, Apr 3, 2018 at 9:33 AM, Arpit Agarwal wrote: > Thanks Wangda, I see the shaded jars now. > > Are

Re: [VOTE] Release Apache Hadoop 3.1.0 (RC1)

+1 (binding) Thanks Wangda for doing the work to produce this release. I did the following to test the release: - Built from source - Installed on 6-node pseudo cluster - Interacted with RM CLI and GUI - Tested streaming jobs - Tested yarn distributed shell jobs - Tested Max AM Resource Percent

[jira] [Created] (HDFS-13393) Improve OOM logging

Wei-Chiu Chuang created HDFS-13393: -- Summary: Improve OOM logging Key: HDFS-13393 URL: https://issues.apache.org/jira/browse/HDFS-13393 Project: Hadoop HDFS Issue Type: Improvement

Re: [VOTE] Release Apache Hadoop 3.1.0 (RC1)

+1 (non-binding) - built from source - tested SparkPi on minicluster (modulo YARN-7747 ) - tested SparkPi on pseudo-distributed cluster - browsed HDFS doc in the site tarball On Tue, Apr 3, 2018 at 11:55 AM Hanisha Koneru

Re: [VOTE] Release Apache Hadoop 3.1.0 (RC1)

Correction: My vote is NON-BINDING. Sorry for the confusion. Thanks, Hanisha On 4/3/18, 11:40 AM, "Hanisha Koneru" wrote: >Thanks Wangda for putting up the RC for 3.1.0. > >+1 (binding). > >Verified the following: >- Built from source >- Deployed binary to a

Re: [VOTE] Release Apache Hadoop 3.1.0 (RC1)

Thanks Wangda for putting up the RC for 3.1.0. +1 (binding). Verified the following: - Built from source - Deployed binary to a 3-node docker cluster - Sanity checks - Basic dfs operations - MapReduce Wordcount & Grep Thanks, Hanisha On 4/3/18, 9:33 AM, "Arpit Agarwal"

[jira] [Created] (HDFS-13392) Incorrect length in Truncate CloseEvents

David Tucker created HDFS-13392: --- Summary: Incorrect length in Truncate CloseEvents Key: HDFS-13392 URL: https://issues.apache.org/jira/browse/HDFS-13392 Project: Hadoop HDFS Issue Type: Bug

Re: [VOTE] Release Apache Hadoop 3.1.0 (RC1)

Thanks Wangda, I see the shaded jars now. Are the repo jars required to be the same as the binary release? They don’t match right now, probably they got rebuilt. +1 (binding), modulo that remaining question. * Verified signatures * Verified checksums for source and binary artefacts * Sanity

[jira] [Created] (HDFS-13391) Ozone: Make dependency of internal sub-module scope as provided in maven.

Nanda kumar created HDFS-13391: -- Summary: Ozone: Make dependency of internal sub-module scope as provided in maven. Key: HDFS-13391 URL: https://issues.apache.org/jira/browse/HDFS-13391 Project: Hadoop

[jira] [Created] (HDFS-13390) AccessControlException for overwrite but not for delete

Nasir Ali created HDFS-13390: Summary: AccessControlException for overwrite but not for delete Key: HDFS-13390 URL: https://issues.apache.org/jira/browse/HDFS-13390 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-13389) Ozone: Compile Ozone/HDFS/Cblock protobuf files with proto3 compiler using maven protoc plugin

Mukul Kumar Singh created HDFS-13389: Summary: Ozone: Compile Ozone/HDFS/Cblock protobuf files with proto3 compiler using maven protoc plugin Key: HDFS-13389 URL:

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/740/ [Apr 2, 2018 2:26:01 PM] (wangda) YARN-7142. Support placement policy in yarn native services. (Gour Saha [Apr 2, 2018 2:52:40 PM] (stevel) HADOOP-15146. Remove DataOutputByteBuffer. Contributed by BELUGA

RE: [VOTE] Release Apache Hadoop 3.1.0 (RC1)

Thanks for your efforts, Wangda. Sorry for participating late. +1 (non-binding) - Verified the checksum of the tarball - Succeeded "mvn clean package -Pdist,native -Dtar -DskipTests" - Started docker hadoop cluster with 1 master and 5 slaves - Verified TeraGen/TeraSort - Verified

[jira] [Created] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

Jinglun created HDFS-13388: -- Summary: RequestHedgingProxyProvider calls multiple configured NNs all the time Key: HDFS-13388 URL: https://issues.apache.org/jira/browse/HDFS-13388 Project: Hadoop HDFS

[jira] [Created] (HDFS-13387) Make multi-thread access class thread safe

maobaolong created HDFS-13387: - Summary: Make multi-thread access class thread safe Key: HDFS-13387 URL: https://issues.apache.org/jira/browse/HDFS-13387 Project: Hadoop HDFS Issue Type:

Re: [VOTE] Release Apache Hadoop 3.1.0 (RC1)

+1 (binding) Thanks for putting this together, Wangda. I deployed a 7-node hadoop cluster and: - ran various MR jobs - ran the same jobs with a mix of opportunistic containers via centralized scheduling - ran the jobs with opportunistic containers and distributed scheduling - ran some jobs with