Thanks all for the input!
I released the maven artifacts earlier today, so soon you should be able to
use the 3.3.1 dependencies in downstream applications.
The official website is refreshed to include 3.3.1:
https://hadoop.apache.org/
The tarball was uploaded and verified the links are good to
+0.
- Built successfully from tag release-3.3.1-RC3 on Ubuntu 20.04
- Verified signature and checksum
- Deployed pseudo-distributed cluster with 3 nodes
- Ran basic HDFS shell commands and sample MR Jobs, it worked well.
- Browsed NN/DN/RM/NM UI. *YARN UI2 DOES NOT work from my side.*
NOTE:
+1.
- Verified hashes
- Confirmed native build on CentOS7
- Started kerberized cluster (using docker)
- Checked NN/RBF Web UI
- Ran basic Erasure Coding shell commands
Thanks for the great work, Wei-Chiu.
- Takanobu
2021年6月13日(日) 3:25 Vinayakumar B :
> +1 (Binding)
>
> 1. Built from Tag.
+1 (Binding)
1. Built from Tag.
2. Successful Native Build on Ubuntu 20.04
3. Verified Checksums
4. Deployed the docker cluster with 3 nodes
5. Ran sample MR Jobs
-Vinay
On Sat, Jun 12, 2021 at 6:40 PM Ayush Saxena wrote:
> +1,
> Built from Source.
> Successful Native Build on Ubuntu 20.04
>
+1,
Built from Source.
Successful Native Build on Ubuntu 20.04
Verified Checksums
Ran basic hdfs shell commands.
Ran simple MR jobs.
Browsed NN,DN,RM and NM UI.
Thanx Wei-Chiu for driving the release.
-Ayush
> On 12-Jun-2021, at 1:45 AM, epa...@apache.org wrote:
>
> +1 (binding)
> Eric
>
>
+1 (binding)
Eric
On Tuesday, June 1, 2021, 5:29:49 AM CDT, Wei-Chiu Chuang
wrote:
Hi community,
This is the release candidate RC3 of Apache Hadoop 3.3.1 line. All blocker
issues have been resolved [1] again.
There are 2 additional issues resolved for RC3:
* Revert "MAPREDUCE-7303.
+1 (non-binding)
- verified signature and checksum
- launched a single docker based cluster and ran some simple HDFS commands
- build Spark master with 3.3.1 RC and : 1) run full Spark test suites and
all success; 2) tested simple Spark commands against a S3 endpoint; 3)
tested Spark on YARN with
+1
Thanks for the great work, Wei-Chiu Chuang.
* verified signature and checksum.
* built site documentation by `mvn site` and skimmed the contents.
# found that top-level index.html is not updated.
* built on CentOS 8 (x86_64) and OpenJDK 8 by `mvn install -DskipTests -Pnative
-Pdist`.
*
+1 (non-binding)
* Signature: ok
* Checksum : ok
* Rat check (1.8.0_171): ok
- mvn clean apache-rat:check
* Built from source (1.8.0_171): ok
- mvn clean install -DskipTests
* HDFS basic testing in pseudo-distributed mode: ok
* Built HBase 2.4.4 with Hadoop 3.3.1 RC and tested some basic
+1
* Signature: ok
* Checksum : ok
* Rat check (1.8.0_191): ok
- mvn clean apache-rat:check
* Built from source (1.8.0_191): ok
- mvn clean install -DskipTests
Ran a ten node cluster w/ hbase on top running its verification loadings w/
+1, binding.
Awesome piece of work!
I've done three forms of qualification, all related to s3 and azure storage
1. tarball validate, CLI use
2. build/test of downstream modules off maven artifacts; mine and some
other ASF ones. I (and it its very much me) have broken some downstream
For someone having similar issue.
When I tested the RC3, ResourceManager failed to start due to following
exception.::
2021-06-07 10:50:54,715 ERROR
org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error starting
ResourceManager
java.lang.IllegalAccessError: tried to access
I found that the top page of site documentation (index.html on the top
directory)
has the same contents of 3.0.0 (https://hadoop.apache.org/docs/r3.0.0/).
While I think it is not worth for sinking the RC3,
you can update the page based on the one for 3.3.0
Dropped them. Please check again.
On Fri, Jun 4, 2021 at 1:19 PM Chao Sun wrote:
> Hi Wei-Chiu,
>
> It seems the Maven staging repository is still pointing at RC0:
> https://repository.apache.org/content/repositories/staging/org/apache/hadoop/hadoop-client/3.3.1/,
> and it's probably because
Hi Wei-Chiu,
It seems the Maven staging repository is still pointing at RC0:
https://repository.apache.org/content/repositories/staging/org/apache/hadoop/hadoop-client/3.3.1/,
and it's probably because you need to drop the old RCs in Apache Nexus
server. Could you do that? Thanks.
Chao
On Thu,
Extend for a bit from the last RC, as it takes time to qualify.
I'm busy testing, doing
- packaging
- CLI working with abfs and s3, both fs and cloudstore library calls
- building downstream projects (so validating maven artifacts). cloudstore
and spark there
- building downstream of downstream
+1 on extending the vote. It's great to see that the S3 support in 3.3 is
so much better! So far everything looks good from Spark side (
https://github.com/apache/spark/pull/30135) but I plan to test it more in
the next few days.
Best,
Chao
On Thu, Jun 3, 2021 at 9:56 AM Wei-Chiu Chuang
wrote:
So I was thinking 5+7 days from Tuesday = next Sunday so that gives
everyone a whole week to validate.
On Fri, Jun 4, 2021 at 12:38 AM Sean Busbey wrote:
> Sounds good to me. That would be until Thursday June 10th, right?
>
> As a side note it’s concerning that a double-dot maintenance release
Sounds good to me. That would be until Thursday June 10th, right?
As a side note it’s concerning that a double-dot maintenance release is a big
release, but I get that it’s the current state of the project.
> On Jun 3, 2021, at 11:30 AM, Wei-Chiu Chuang wrote:
>
> Hello,
> do we want to
Hello,
do we want to extend the release vote? I understand a big release like this
takes time to validate.
I am aware a number of people are testing it: Attila tested Ozone on Hadoop
3.3.1 RC3, Stack is testing HBase, Chao tested Spark.
I also learned that anecdotally Spark on S3 on Hadoop 3.3 is
Hi community,
This is the release candidate RC3 of Apache Hadoop 3.3.1 line. All blocker
issues have been resolved [1] again.
There are 2 additional issues resolved for RC3:
* Revert "MAPREDUCE-7303. Fix TestJobResourceUploader failures after
HADOOP-16878
* Revert "HADOOP-16878. FileUtil.copy()
21 matches
Mail list logo