Re: [VOTE] Release Apache Hadoop 2.9.0 (RC0)

+1 (non binding) Thanks for working on this, Arun!! Tested below cases after building from source in mac , java 1.8.: 1) setup a small cluster 2) run hdfs commands 3) ran wordcount, pi and TestDFSIO tests. Thanks, Ajay On 12/10/17, 7:47 PM, "Vinod Kumar Vavilapalli" wrote:

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC0)

Missed this response on the old thread, but closing the loop here.. The incompatibility conundrum with Dot-zeroes did indeed happen, in early 2.x releases - multiple times at that. And the downstream projects did raise concerns at these unfixable situations. I wasn't advocating a new

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC0)

The labor required for these release formalisms is exceeding their value. Our minor releases have more bugs than our patch releases (we hope), but every consumer should understand how software versioning works. Every device I own has bugs on major OS updates. That doesn't imply that every minor

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC0)

Thanks Vinod for your feedback, we'll incorporate it when we spin RC1. -Subru/Arun On Wed, Nov 8, 2017 at 5:34 PM, Vinod Kumar Vavilapalli wrote: > A related point - I thought I mentioned this in one of the release > preparation threads, but in any case. > > Starting 2.7.0,

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC0)

A related point - I thought I mentioned this in one of the release preparation threads, but in any case. Starting 2.7.0, for every .0 release, we've been adding a disclaimer (to the voting thread as well as the final release) that the first release can potentially go through additional fixes

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC0)

We are canceling the RC due to the issue that Rohith/Sunil identified. The issue was difficult to track down as it only happens when you use IP for ZK (works fine with host names) and moreover if ZK and RM are co-located on same machine. We are hopeful to get the fix in tomorrow and roll out RC1.

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC0)

+1 from me too. Did the following: 1) set up a 9-node cluster; 2) ran some Gridmix jobs; 3) ran (2) after enabling opportunistic containers (used a mix of guaranteed and opportunistic containers for each job); 4) ran (3) but this time enabling distributed scheduling of opportunistic containers.

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC0)

Thanks Arun and Subru for working on this! +1 (non-binding) pending YARN-7453. 1) Setup RM HA 2) Verified leveldb/zookeeper scheduler configuration API works via REST/CLI 3) Verified configuration changes persist across restart 4) yarn rmadmin -refreshQueues works when scheduler configuration

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC0)

+1 (non-binding) pending the issue that Sunil/Rohith pointed out - Verified all hashes and checksums - Built from source on macOS 10.12.6, Java 1.8.0u65 - Deployed a pseudo cluster - Ran some example jobs Thanks, Eric On Tue, Nov 7, 2017 at 4:03 PM, Wangda Tan wrote: >

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC0)

Sunil / Rohith, Could you check if your configs are same as Jonathan posted configs? https://issues.apache.org/jira/browse/YARN-7453?focusedCommentId=16242693=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16242693 And could you try if using Jonathan's configs can still

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC0)

Thanks for testing Rohith and Sunil Can you please confirm if it is not a config issue at your end ? We (both Jonathan and myself) just tried testing this on a fresh cluster (both automatic and manual) and we are not able to reproduce this. I've updated the YARN-7453

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC0)

Thanks Sunil for confirmation. Btw, I have raised YARN-7453 JIRA to track this issue. - Rohith Sharma K S On 7 November 2017 at 16:44, Sunil G wrote: > Hi Subru and Arun. > > Thanks for driving 2.9 release. Great work! > > I

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC0)

Hi Subru and Arun. Thanks for driving 2.9 release. Great work! I installed cluster built from source. - Ran few MR jobs with application priority enabled. Runs fine. - Accessed new UI and it also seems fine. However I am also getting same issue as Rohith reported. - Started an HA cluster -

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC0)

Thanks Subru/Arun for the great work! Downloaded source and built from it. Deployed RM HA non-secured cluster along with new YARN UI and ATSv2. I am facing basic RM HA switch issue after first time successful start. *Can anyone else is facing this issue?* When RM is switched from ACTIVE to

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC0)

+1 from me. I have: 1) setup a small cluster 2) enabled the reservation system 3) submitted reservation through REST 4) ran a job within reservation 5) did few negative tests (what happens if res system is disabled and you try to reserve, what happens if a job is submitted with invalid res id,

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC0)

Here is my +1 to start. - Setup a small 4 node cluster - Verified some basic HDFS commands - Ran Pi / sleep jobs (with some mix of Opportunistic containers - both distributed and centralized scheduling) Cheers -Arun On Fri, Nov 3, 2017 at 4:38 PM, Arun Suresh wrote: > Hey

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC0)

Hey Vinod, I've cleaned up the RC directory as you requested. Cheers -Arun On Fri, Nov 3, 2017 at 4:09 PM, Vinod Kumar Vavilapalli wrote: > Arun / Subru, > > Thanks for the great work! > > Few quick comments > - Can you cleanup the RC folder to only have tar.gz and

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC0)

Arun / Subru, Thanks for the great work! Few quick comments - Can you cleanup the RC folder to only have tar.gz and src.tar.gz and their signatures and delete everything else? So that it's easy to pick up the important bits for the voters. For e.g, like this