[jira] [Created] (YARN-7460) Exclude findbugs warnings on SchedulerNode.numGuaranteedContainers and numOpportunisticContainers

Haibo Chen created YARN-7460: Summary: Exclude findbugs warnings on SchedulerNode.numGuaranteedContainers and numOpportunisticContainers Key: YARN-7460 URL: https://issues.apache.org/jira/browse/YARN-7460

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC0)

+1 from me too. Did the following: 1) set up a 9-node cluster; 2) ran some Gridmix jobs; 3) ran (2) after enabling opportunistic containers (used a mix of guaranteed and opportunistic containers for each job); 4) ran (3) but this time enabling distributed scheduling of opportunistic containers.

[jira] [Created] (YARN-7457) Delay scheduling should be an individual policy instead of part of scheduler implementation

Wangda Tan created YARN-7457: Summary: Delay scheduling should be an individual policy instead of part of scheduler implementation Key: YARN-7457 URL: https://issues.apache.org/jira/browse/YARN-7457

[jira] [Created] (YARN-7459) Support RefreshNode API

darion yaphet created YARN-7459: --- Summary: Support RefreshNode API Key: YARN-7459 URL: https://issues.apache.org/jira/browse/YARN-7459 Project: Hadoop YARN Issue Type: New Feature

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC0)

Thanks Arun and Subru for working on this! +1 (non-binding) pending YARN-7453. 1) Setup RM HA 2) Verified leveldb/zookeeper scheduler configuration API works via REST/CLI 3) Verified configuration changes persist across restart 4) yarn rmadmin -refreshQueues works when scheduler configuration

[jira] [Created] (YARN-7458) TestContainerManagerSecurity is still flakey

Robert Kanter created YARN-7458: --- Summary: TestContainerManagerSecurity is still flakey Key: YARN-7458 URL: https://issues.apache.org/jira/browse/YARN-7458 Project: Hadoop YARN Issue Type: Bug

Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

For more details, see https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/33/ [Nov 6, 2017 5:39:41 PM] (bibinchundatt) Add containerId to Localizer failed logs. Contributed by Prabhu Joseph -1 overall The following subsystems voted -1: asflicense unit xml The following

[jira] [Created] (YARN-7456) TestAMRMClient.testAMRMClientWithContainerResourceChange[0] failed

Haibo Chen created YARN-7456: Summary: TestAMRMClient.testAMRMClientWithContainerResourceChange[0] failed Key: YARN-7456 URL: https://issues.apache.org/jira/browse/YARN-7456 Project: Hadoop YARN

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC0)

+1 (non-binding) pending the issue that Sunil/Rohith pointed out - Verified all hashes and checksums - Built from source on macOS 10.12.6, Java 1.8.0u65 - Deployed a pseudo cluster - Ran some example jobs Thanks, Eric On Tue, Nov 7, 2017 at 4:03 PM, Wangda Tan wrote: >

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC0)

Sunil / Rohith, Could you check if your configs are same as Jonathan posted configs? https://issues.apache.org/jira/browse/YARN-7453?focusedCommentId=16242693=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16242693 And could you try if using Jonathan's configs can still

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC0)

Thanks for testing Rohith and Sunil Can you please confirm if it is not a config issue at your end ? We (both Jonathan and myself) just tried testing this on a fresh cluster (both automatic and manual) and we are not able to reproduce this. I've updated the YARN-7453

Re: [DISCUSS] A final minor release off branch-2?

>> You mentioned rolling-upgrades: It will be good to exactly outline the type of testing. For e.g., the rolling-upgrades orchestration order has direct implication on the testing done. Complete details are available in HDFS-11096 where I'm trying to get scripts to automate these tests committed

Re: [DISCUSS] A final minor release off branch-2?

Thanks for your comments, Zheng. Replies inline. > On the other hand, I've discussed with quite a few 3.0 potential users, it > looks like most of them are interested in the erasure coding feature and a > major scenario for that is to back up their large volume of data to save > storage cost.

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/583/ [Nov 6, 2017 5:09:10 PM] (bibinchundatt) Add containerId to Localizer failed logs. Contributed by Prabhu Joseph [Nov 6, 2017 9:28:31 PM] (jianhe) YARN-5461. Initial code ported from slider-core module.

[jira] [Created] (YARN-7455) add_mounts can overrun temporary buffer

Jason Lowe created YARN-7455: Summary: add_mounts can overrun temporary buffer Key: YARN-7455 URL: https://issues.apache.org/jira/browse/YARN-7455 Project: Hadoop YARN Issue Type: Bug

[jira] [Created] (YARN-7454) RMAppAttemptMetrics#getAggregate can NPE due to double lookup

Jason Lowe created YARN-7454: Summary: RMAppAttemptMetrics#getAggregate can NPE due to double lookup Key: YARN-7454 URL: https://issues.apache.org/jira/browse/YARN-7454 Project: Hadoop YARN

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC0)

Thanks Sunil for confirmation. Btw, I have raised YARN-7453 JIRA to track this issue. - Rohith Sharma K S On 7 November 2017 at 16:44, Sunil G wrote: > Hi Subru and Arun. > > Thanks for driving 2.9 release. Great work! > > I

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC0)

Hi Subru and Arun. Thanks for driving 2.9 release. Great work! I installed cluster built from source. - Ran few MR jobs with application priority enabled. Runs fine. - Accessed new UI and it also seems fine. However I am also getting same issue as Rohith reported. - Started an HA cluster -

[jira] [Created] (YARN-7453) RM fail to switch to active after first successful start

Rohith Sharma K S created YARN-7453: --- Summary: RM fail to switch to active after first successful start Key: YARN-7453 URL: https://issues.apache.org/jira/browse/YARN-7453 Project: Hadoop YARN

[jira] [Created] (YARN-7452) Decommissioning node NaN issue

Vasudevan Skm created YARN-7452: --- Summary: Decommissioning node NaN issue Key: YARN-7452 URL: https://issues.apache.org/jira/browse/YARN-7452 Project: Hadoop YARN Issue Type: Bug