Re: [VOTE] Release Apache Hadoop 2.9.0 (RC0)

2017-11-07 Thread Eric Badger
+1 (non-binding) pending the issue that Sunil/Rohith pointed out - Verified all hashes and checksums - Built from source on macOS 10.12.6, Java 1.8.0u65 - Deployed a pseudo cluster - Ran some example jobs Thanks, Eric On Tue, Nov 7, 2017 at 4:03 PM, Wangda Tan wrote: >

Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

2017-11-07 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/33/ [Nov 6, 2017 5:39:41 PM] (bibinchundatt) Add containerId to Localizer failed logs. Contributed by Prabhu Joseph -1 overall The following subsystems voted -1: asflicense unit xml The following

[jira] [Created] (HADOOP-15023) ValueQueue should also validate (lowWatermark * numValues) > 0 on construction

2017-11-07 Thread Xiao Chen (JIRA)
Xiao Chen created HADOOP-15023: -- Summary: ValueQueue should also validate (lowWatermark * numValues) > 0 on construction Key: HADOOP-15023 URL: https://issues.apache.org/jira/browse/HADOOP-15023

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC0)

2017-11-07 Thread Wangda Tan
Sunil / Rohith, Could you check if your configs are same as Jonathan posted configs? https://issues.apache.org/jira/browse/YARN-7453?focusedCommentId=16242693=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16242693 And could you try if using Jonathan's configs can still

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC0)

2017-11-07 Thread Arun Suresh
Thanks for testing Rohith and Sunil Can you please confirm if it is not a config issue at your end ? We (both Jonathan and myself) just tried testing this on a fresh cluster (both automatic and manual) and we are not able to reproduce this. I've updated the YARN-7453

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC0)

2017-11-07 Thread Sunil G
Hi Subru and Arun. Thanks for driving 2.9 release. Great work! I installed cluster built from source. - Ran few MR jobs with application priority enabled. Runs fine. - Accessed new UI and it also seems fine. However I am also getting same issue as Rohith reported. - Started an HA cluster -

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC0)

2017-11-07 Thread Rohith Sharma K S
Thanks Sunil for confirmation. Btw, I have raised YARN-7453 JIRA to track this issue. - Rohith Sharma K S On 7 November 2017 at 16:44, Sunil G wrote: > Hi Subru and Arun. > > Thanks for driving 2.9 release. Great work! > > I

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC0)

2017-11-07 Thread Jonathan Hung
Thanks Arun and Subru for working on this! +1 (non-binding) pending YARN-7453. 1) Setup RM HA 2) Verified leveldb/zookeeper scheduler configuration API works via REST/CLI 3) Verified configuration changes persist across restart 4) yarn rmadmin -refreshQueues works when scheduler configuration

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC0)

2017-11-07 Thread Konstantinos Karanasos
+1 from me too. Did the following: 1) set up a 9-node cluster; 2) ran some Gridmix jobs; 3) ran (2) after enabling opportunistic containers (used a mix of guaranteed and opportunistic containers for each job); 4) ran (3) but this time enabling distributed scheduling of opportunistic containers.

Re: [DISCUSS] A final minor release off branch-2?

2017-11-07 Thread Vinod Kumar Vavilapalli
Thanks for your comments, Zheng. Replies inline. > On the other hand, I've discussed with quite a few 3.0 potential users, it > looks like most of them are interested in the erasure coding feature and a > major scenario for that is to back up their large volume of data to save > storage cost.

[jira] [Created] (HADOOP-15021) Excluding private and limitiedprivate from javadoc causes broken links

2017-11-07 Thread Andras Bokor (JIRA)
Andras Bokor created HADOOP-15021: - Summary: Excluding private and limitiedprivate from javadoc causes broken links Key: HADOOP-15021 URL: https://issues.apache.org/jira/browse/HADOOP-15021 Project:

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2017-11-07 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/583/ [Nov 6, 2017 5:09:10 PM] (bibinchundatt) Add containerId to Localizer failed logs. Contributed by Prabhu Joseph [Nov 6, 2017 9:28:31 PM] (jianhe) YARN-5461. Initial code ported from slider-core module.

[jira] [Created] (HADOOP-15022) s3guard IT tests increase R/W capacity of the test table by 1

2017-11-07 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15022: --- Summary: s3guard IT tests increase R/W capacity of the test table by 1 Key: HADOOP-15022 URL: https://issues.apache.org/jira/browse/HADOOP-15022 Project:

Re: [DISCUSS] A final minor release off branch-2?

2017-11-07 Thread Sean Mackrory
>> You mentioned rolling-upgrades: It will be good to exactly outline the type of testing. For e.g., the rolling-upgrades orchestration order has direct implication on the testing done. Complete details are available in HDFS-11096 where I'm trying to get scripts to automate these tests committed