Re: [VOTE] Release Apache Hadoop 3.3.1 RC3

2021-06-15 Thread Wei-Chiu Chuang
Thanks all for the input! I released the maven artifacts earlier today, so soon you should be able to use the 3.3.1 dependencies in downstream applications. The official website is refreshed to include 3.3.1: https://hadoop.apache.org/ The tarball was uploaded and verified the links are good to

Re: [VOTE] Release Apache Hadoop 3.3.1 RC3

2021-06-15 Thread Xiaoqiao He
+0. - Built successfully from tag release-3.3.1-RC3 on Ubuntu 20.04 - Verified signature and checksum - Deployed pseudo-distributed cluster with 3 nodes - Ran basic HDFS shell commands and sample MR Jobs, it worked well. - Browsed NN/DN/RM/NM UI. *YARN UI2 DOES NOT work from my side.* NOTE:

Re: [VOTE] Release Apache Hadoop 3.3.1 RC3

2021-06-13 Thread Takanobu Asanuma
+1. - Verified hashes - Confirmed native build on CentOS7 - Started kerberized cluster (using docker) - Checked NN/RBF Web UI - Ran basic Erasure Coding shell commands Thanks for the great work, Wei-Chiu. - Takanobu 2021年6月13日(日) 3:25 Vinayakumar B : > +1 (Binding) > > 1. Built from Tag.

Re: [VOTE] Release Apache Hadoop 3.3.1 RC3

2021-06-12 Thread Vinayakumar B
+1 (Binding) 1. Built from Tag. 2. Successful Native Build on Ubuntu 20.04 3. Verified Checksums 4. Deployed the docker cluster with 3 nodes 5. Ran sample MR Jobs -Vinay On Sat, Jun 12, 2021 at 6:40 PM Ayush Saxena wrote: > +1, > Built from Source. > Successful Native Build on Ubuntu 20.04 >

Re: [VOTE] Release Apache Hadoop 3.3.1 RC3

2021-06-12 Thread Ayush Saxena
+1, Built from Source. Successful Native Build on Ubuntu 20.04 Verified Checksums Ran basic hdfs shell commands. Ran simple MR jobs. Browsed NN,DN,RM and NM UI. Thanx Wei-Chiu for driving the release. -Ayush > On 12-Jun-2021, at 1:45 AM, epa...@apache.org wrote: > > +1 (binding) > Eric > >

Re: [VOTE] Release Apache Hadoop 3.3.1 RC3

2021-06-11 Thread epa...@apache.org
+1 (binding) Eric On Tuesday, June 1, 2021, 5:29:49 AM CDT, Wei-Chiu Chuang wrote: Hi community, This is the release candidate RC3 of Apache Hadoop 3.3.1 line. All blocker issues have been resolved [1] again. There are 2 additional issues resolved for RC3: * Revert "MAPREDUCE-7303.

Re: [VOTE] Release Apache Hadoop 3.3.1 RC3

2021-06-10 Thread Chao Sun
+1 (non-binding) - verified signature and checksum - launched a single docker based cluster and ran some simple HDFS commands - build Spark master with 3.3.1 RC and : 1) run full Spark test suites and all success; 2) tested simple Spark commands against a S3 endpoint; 3) tested Spark on YARN with

Re: [VOTE] Release Apache Hadoop 3.3.1 RC3

2021-06-10 Thread Masatake Iwasaki
+1 Thanks for the great work, Wei-Chiu Chuang. * verified signature and checksum. * built site documentation by `mvn site` and skimmed the contents. # found that top-level index.html is not updated. * built on CentOS 8 (x86_64) and OpenJDK 8 by `mvn install -DskipTests -Pnative -Pdist`. *

Re: [VOTE] Release Apache Hadoop 3.3.1 RC3

2021-06-10 Thread Viraj Jasani
+1 (non-binding) * Signature: ok * Checksum : ok * Rat check (1.8.0_171): ok - mvn clean apache-rat:check * Built from source (1.8.0_171): ok - mvn clean install -DskipTests * HDFS basic testing in pseudo-distributed mode: ok * Built HBase 2.4.4 with Hadoop 3.3.1 RC and tested some basic

Re: [VOTE] Release Apache Hadoop 3.3.1 RC3

2021-06-09 Thread Stack
+1 * Signature: ok * Checksum : ok * Rat check (1.8.0_191): ok - mvn clean apache-rat:check * Built from source (1.8.0_191): ok - mvn clean install -DskipTests Ran a ten node cluster w/ hbase on top running its verification loadings w/

Re: [VOTE] Release Apache Hadoop 3.3.1 RC3

2021-06-08 Thread Steve Loughran
+1, binding. Awesome piece of work! I've done three forms of qualification, all related to s3 and azure storage 1. tarball validate, CLI use 2. build/test of downstream modules off maven artifacts; mine and some other ASF ones. I (and it its very much me) have broken some downstream

Re: [VOTE] Release Apache Hadoop 3.3.1 RC3

2021-06-07 Thread Masatake Iwasaki
For someone having similar issue. When I tested the RC3, ResourceManager failed to start due to following exception.:: 2021-06-07 10:50:54,715 ERROR org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error starting ResourceManager java.lang.IllegalAccessError: tried to access

Re: [VOTE] Release Apache Hadoop 3.3.1 RC3

2021-06-07 Thread Masatake Iwasaki
I found that the top page of site documentation (index.html on the top directory) has the same contents of 3.0.0 (https://hadoop.apache.org/docs/r3.0.0/). While I think it is not worth for sinking the RC3, you can update the page based on the one for 3.3.0

Re: [VOTE] Release Apache Hadoop 3.3.1 RC3

2021-06-04 Thread Wei-Chiu Chuang
Dropped them. Please check again. On Fri, Jun 4, 2021 at 1:19 PM Chao Sun wrote: > Hi Wei-Chiu, > > It seems the Maven staging repository is still pointing at RC0: > https://repository.apache.org/content/repositories/staging/org/apache/hadoop/hadoop-client/3.3.1/, > and it's probably because

Re: [VOTE] Release Apache Hadoop 3.3.1 RC3

2021-06-03 Thread Chao Sun
Hi Wei-Chiu, It seems the Maven staging repository is still pointing at RC0: https://repository.apache.org/content/repositories/staging/org/apache/hadoop/hadoop-client/3.3.1/, and it's probably because you need to drop the old RCs in Apache Nexus server. Could you do that? Thanks. Chao On Thu,

Re: [VOTE] Release Apache Hadoop 3.3.1 RC3

2021-06-03 Thread Steve Loughran
Extend for a bit from the last RC, as it takes time to qualify. I'm busy testing, doing - packaging - CLI working with abfs and s3, both fs and cloudstore library calls - building downstream projects (so validating maven artifacts). cloudstore and spark there - building downstream of downstream

Re: [VOTE] Release Apache Hadoop 3.3.1 RC3

2021-06-03 Thread Chao Sun
+1 on extending the vote. It's great to see that the S3 support in 3.3 is so much better! So far everything looks good from Spark side ( https://github.com/apache/spark/pull/30135) but I plan to test it more in the next few days. Best, Chao On Thu, Jun 3, 2021 at 9:56 AM Wei-Chiu Chuang wrote:

Re: [VOTE] Release Apache Hadoop 3.3.1 RC3

2021-06-03 Thread Wei-Chiu Chuang
So I was thinking 5+7 days from Tuesday = next Sunday so that gives everyone a whole week to validate. On Fri, Jun 4, 2021 at 12:38 AM Sean Busbey wrote: > Sounds good to me. That would be until Thursday June 10th, right? > > As a side note it’s concerning that a double-dot maintenance release

Re: [VOTE] Release Apache Hadoop 3.3.1 RC3

2021-06-03 Thread Sean Busbey
Sounds good to me. That would be until Thursday June 10th, right? As a side note it’s concerning that a double-dot maintenance release is a big release, but I get that it’s the current state of the project. > On Jun 3, 2021, at 11:30 AM, Wei-Chiu Chuang wrote: > > Hello, > do we want to

Re: [VOTE] Release Apache Hadoop 3.3.1 RC3

2021-06-03 Thread Wei-Chiu Chuang
Hello, do we want to extend the release vote? I understand a big release like this takes time to validate. I am aware a number of people are testing it: Attila tested Ozone on Hadoop 3.3.1 RC3, Stack is testing HBase, Chao tested Spark. I also learned that anecdotally Spark on S3 on Hadoop 3.3 is

[VOTE] Release Apache Hadoop 3.3.1 RC3

2021-06-01 Thread Wei-Chiu Chuang
Hi community, This is the release candidate RC3 of Apache Hadoop 3.3.1 line. All blocker issues have been resolved [1] again. There are 2 additional issues resolved for RC3: * Revert "MAPREDUCE-7303. Fix TestJobResourceUploader failures after HADOOP-16878 * Revert "HADOOP-16878. FileUtil.copy()