This is a great work to be in to evolve HDFS towards cloud storage. Thanks
Chris and folks!
I had participated in the design review meeting and it looks good to me. I will
take some time to look at the cocdes closely.
+1 on the merge.
Regards,Kai
Thanks Andrew for the hard driving!!
I downloaded the source tar bao and built it successfully on a MacOS. I haven't
got the chance to try it yet, so mynon-binding +1.
Regards,Kai
--发件人:John
Zhuge
Thanks Andrew for the great effort! Here is my late vote.
+1 (binding)
- Verified checksums and signatures of tarballs
- Built source with native, Oracle Java 1.8.0_152 on Mac OS X 10.13.2
- Verified cloud connectors:
- S3A integration tests (perf tests skipped)
- Deployed
Yes, JIRAs will be filed, the wiki-page idea from YARN meetup is to record all
combinations of testing that need to be done and correspondingly capture all
the testing that someone in the community has already done and record it for
future perusal.
From what you are saying, I guess we haven't
Good stuff Andrew, and thanks everyone!
+Vinod
> On Dec 13, 2017, at 1:05 PM, Andrew Wang wrote:
>
> To close this out, the vote passes successfully with 13 binding +1s, 5
> non-binding +1s, and no -1s. Thanks everyone for voting! I'll work on staging.
>
+1
I have been reviewing some of the latest patches.
I skimmed through the patch in HDFS-9806 and it looks good.
In addition, we have ported it to 2.7.1 (minor differences to what would be
merged).
It has been running in our test cluster for a couple months.
All the issues we have been finding
Thanks to all who verified and voted!
I give my binding +1 to conclude the vote for 2.8.3 RC0, based on:
- Build from source and verify signatures
- Deploy pseudo-distributed cluster and run some simple job, like: pi, sleep,
etc.
- Verify UI of daemons, like: NameNode, DataNode, ResourceManager,
Here is my +1(binding) too.
Sorry for late vote.
Verified signatures of the source tarball.
built from source.
set up a 2-node test cluster.
Tested via HDFS commands and java API – Written bunch of files and read back.
Ran basic MR job
Thanks Andrew and others for the hard work for getting
[
https://issues.apache.org/jira/browse/HDFS-12923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lei (Eddy) Xu resolved HDFS-12923.
--
Resolution: Won't Fix
Fix Version/s: 3.0.0
Resolved as not an issue.
> DFS.concat
Hi folks,
To close this out, the vote passes successfully with 13 binding +1s, 5
non-binding +1s, and no -1s. Thanks everyone for voting! I'll work on
staging.
I'm hoping we can address YARN-7588 and any remaining rolling upgrade
issues in 3.0.x maintenance releases. Beyond a wiki page, it would
I was waiting for Daniel to post the minutes from YARN meetup to talk about
this. Anyways, in that discussion, we identified a bunch of key upgrade related
scenarios that no-one seems to have validated - atleast from the representation
in the YARN meetup. I'm going to create a wiki-page listing
Looked at RC1. Went through my usual check-list. Here's my summary.
+1 (binding) overall
Verification
- [Check] Successful recompilation from source tar-ball
- [Check] Signature verification
- [Check] Generating dist tarballs from source tar-ball
- [Check] Validating the layout of the binary
Thanks to everyone who pushed on this release, really great to see a
release coming off trunk.
+1 (binding).
Deployed the RC on a federated YARN cluster consisting of 8 sub-clusters on
CentOs 7.4 running Java 1.8.0_144.
Hit YARN-7652[1] which is not a blocker as I was able to run multiple jobs
Thanks Konstantin for working on this.
+1 (non-binding)
- Downloaded binary and verified md5
- Deployed RM HA and tested failover
Jonathan Hung
On Wed, Dec 13, 2017 at 11:02 AM, Eric Payne wrote:
> Thanks for the hard work on this release, Konstantin.
> +1
+1 from me. There are some unrelated errors building the branch right now
due to annotations in some YARN code, etc. but I was able to generate an fs
image from an S3 bucket and serve the content through HDFS on a
pseudo-distributed HDFS node this morning. Seems like a good point for a
merge.
On
Thanks for the hard work on this release, Konstantin.
+1 (binding)
- Built from source
- Verified that refreshing of queues works as expected.
- Verified can run multiple users in a single queue
- Ran terasort test
- Verified that cross-queue preemption works as expected
Thanks. Eric Payne
Hi Virajith / Chris/ Thomas / Ewan,
Thanks for developing this feature and getting to merge state.
I would like to vote +1 for this merge. Thanks for all the hard work.
Thanks
Anu
On 12/8/17, 7:11 PM, "Virajith Jalaparti" wrote:
Hi,
We have tested the
[
https://issues.apache.org/jira/browse/HDFS-12265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chen Liang resolved HDFS-12265.
---
Resolution: Fixed
Release Note: Looks like this has been handled as part of HDFS-12387, close
Thanks Junping for the release. +1 (binding)
Tested on a single node pseudo cluster, I performed the following tests:
- Downloaded the tars and verified the signatures, installed using the tar
- Successfully ran few MR jobs
- Verified few hdfs operations
- Verified RM,NM and HDFS webui's
-
For more details, see
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/621/
[Dec 12, 2017 6:56:26 PM] (jlowe) YARN-7625. Expose NM node/containers resource
utilization in JVM
[Dec 12, 2017 9:35:56 PM] (jianhe) YARN-7565. Yarn service pre-maturely
releases the container after AM
+1 (non-binding)
* Verified md5 of all artifacts
* Built with -Pdist
* Ran several s3a shell commands
* Started a pseudo-distributed HDFS and YARN cluster
* Ran grep and pi MR examples
* Sanity-checked contents of release notes, rat report, and changes
On Fri, Dec 8, 2017 at 1:31 PM, Andrew Wang
Thanks Andrew for driving this.
+1 (Binding)
Ran SLS + CS's Perf unit test and saw similar performance compared to
trunk.
Compiled from source, deployed single node cluster and ran several jobs.
Best,
Wangda
On Wed, Dec 13, 2017 at 7:29 AM, Sunil G wrote:
> +1
+1 (binding)
Thanks Andrew Wang for driving this effort and also thanks to all others
who helped in this release. Kudos!!!
I tested this RC by building it from source. I met with couple of issues
(not blocker) HADOOP-15116 and YARN-7650. This could be tracked separately.
- Ran many MR apps
+1 (non-binding),Thanks Andrew wang for driving this.
---Built from the source
--Installed 3 Node HA cluster
--Verified Basic shell commands
--Ran Sample jobs like pi,wordcount
--Verified the UI's
--Brahma Reddy Battula
-Original Message-
From: Andrew Wang
+1 (binding)
- built from source and deployed 3 node cluster
- installed RM HA cluster along with ATSv2 enabled and new YARN UI.
- verified for
-- RM HA switch / RM Restart / RM Work preserving restart
-- NM work preserving restart
-- Ran sample MR jobs and Distributed shell along with multiple
+1 (binding)
Thanks Junping for the effort.
I have deployed a cluster built from source tar ball.
- Ran few MR apps and verified UI. CLI commands are also fine related to
app.
- Tested below feature sanity
- Application priority
- Application timeout
- Tested basic
+1 (binding)
Built from source and deployed non-secure 3 node cluster
Verified for
- RM HA/RM Restart/RM work preserving restart
- Ran sample MR and Distributed shell jobs.
Thanks & Regards
Rohith Sharma K S
On 8 December 2017 at 08:52, Konstantin Shvachko
wrote:
> Hi
+1 (Binding)
Built from source and deployed non-secure 3 node cluster
Verified for
- RM HA/RM Restart/RM work preserving restart
- NM work preserving restart
- Ran sample MR and Distributed shell jobs.
Thanks & Regards
Rohith Sharma K S
On 5 December 2017 at 15:28, Junping Du
28 matches
Mail list logo