[jira] [Assigned] (YARN-5897) using drainEvent to replace sleep-wait in MockRM#waitForState

2016-11-16 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sandflee reassigned YARN-5897: -- Assignee: sandflee > using drainEvent to replace sleep-wait in MockRM#waitForState >

[jira] [Created] (YARN-5897) using drainEvent to replace sleep-wait in MockRM#waitForState

2016-11-16 Thread sandflee (JIRA)
sandflee created YARN-5897: -- Summary: using drainEvent to replace sleep-wait in MockRM#waitForState Key: YARN-5897 URL: https://issues.apache.org/jira/browse/YARN-5897 Project: Hadoop YARN Issue

[jira] [Created] (YARN-5896) add drainEvents to MockAM to reduce test failure

2016-11-16 Thread sandflee (JIRA)
sandflee created YARN-5896: -- Summary: add drainEvents to MockAM to reduce test failure Key: YARN-5896 URL: https://issues.apache.org/jira/browse/YARN-5896 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-5895) TestRMRestart#testFinishedAppRemovalAfterRMRestart is still flakey

2016-11-16 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672982#comment-15672982 ] sandflee commented on YARN-5895: I'm ok, close it with dup >

[jira] [Resolved] (YARN-5895) TestRMRestart#testFinishedAppRemovalAfterRMRestart is still flakey

2016-11-16 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sandflee resolved YARN-5895. Resolution: Duplicate > TestRMRestart#testFinishedAppRemovalAfterRMRestart is still flakey >

[jira] [Comment Edited] (YARN-5548) Random test failure TestRMRestart#testFinishedAppRemovalAfterRMRestart

2016-11-16 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672972#comment-15672972 ] sandflee edited comment on YARN-5548 at 11/17/16 6:54 AM: -- agree, and maybe we

[jira] [Commented] (YARN-5548) Random test failure TestRMRestart#testFinishedAppRemovalAfterRMRestart

2016-11-16 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672972#comment-15672972 ] sandflee commented on YARN-5548: agree, and maybe we could try to replace all MemoryStateStore with

[jira] [Commented] (YARN-5375) invoke MockRM#drainEvents implicitly in MockRM methods to reduce test failures

2016-11-16 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672967#comment-15672967 ] sandflee commented on YARN-5375: yes, to keep the patch simple, not replace MemoryRMStateStore, let's go to

[jira] [Commented] (YARN-5548) Random test failure TestRMRestart#testFinishedAppRemovalAfterRMRestart

2016-11-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672941#comment-15672941 ] Varun Saxena commented on YARN-5548: We need to use MockRMMemoryStateStore in this test now which has

[jira] [Commented] (YARN-5375) invoke MockRM#drainEvents implicitly in MockRM methods to reduce test failures

2016-11-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672939#comment-15672939 ] Varun Saxena commented on YARN-5375: [~sandflee],[~rohithsharma] looking at the patch, it seems we

[jira] [Commented] (YARN-5865) Retrospect updateApplicationPriority api to handle state store exception in align with YARN-5611

2016-11-16 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672919#comment-15672919 ] Sunil G commented on YARN-5865: --- [~jianhe] and [~rohithsharma]. Please help to review this patch. >

[jira] [Commented] (YARN-4752) [Umbrella] FairScheduler: Improve preemption

2016-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672908#comment-15672908 ] Hadoop QA commented on YARN-4752: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4752) [Umbrella] FairScheduler: Improve preemption

2016-11-16 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4752: --- Attachment: yarn-4752.4.patch > [Umbrella] FairScheduler: Improve preemption >

[jira] [Commented] (YARN-5895) TestRMRestart#testFinishedAppRemovalAfterRMRestart is still flakey

2016-11-16 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672709#comment-15672709 ] Rohith Sharma K S commented on YARN-5895: - [~sandflee] this JIRA look like dupe of YARN-5548. Can

[jira] [Commented] (YARN-5292) Support for PAUSED container state

2016-11-16 Thread Hitesh Sharma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672702#comment-15672702 ] Hitesh Sharma commented on YARN-5292: - [~asuresh], can you also please take a look at this patch? Thank

[jira] [Commented] (YARN-5292) Support for PAUSED container state

2016-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672691#comment-15672691 ] Hadoop QA commented on YARN-5292: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5895) TestRMRestart#testFinishedAppRemovalAfterRMRestart is still flakey

2016-11-16 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672634#comment-15672634 ] Bibin A Chundatt commented on YARN-5895: Look like dupe if YARN-5548. >

[jira] [Commented] (YARN-5895) TestRMRestart#testFinishedAppRemovalAfterRMRestart is still flakey

2016-11-16 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672602#comment-15672602 ] sandflee commented on YARN-5895: yes, I think there are two main places not drain Events: 1, explicitly

[jira] [Commented] (YARN-5895) TestRMRestart#testFinishedAppRemovalAfterRMRestart is still flakey

2016-11-16 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672604#comment-15672604 ] sandflee commented on YARN-5895: will do > TestRMRestart#testFinishedAppRemovalAfterRMRestart is still

[jira] [Commented] (YARN-5870) Expose getApplications API in YarnClient with GetApplicationsRequest parameter

2016-11-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672597#comment-15672597 ] Hudson commented on YARN-5870: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10851 (See

[jira] [Updated] (YARN-5871) Add support for reservation-based routing.

2016-11-16 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-5871: - Parent Issue: YARN-5597 (was: YARN-2915) > Add support for reservation-based routing. >

[jira] [Commented] (YARN-5634) Simplify initialization/use of RouterPolicy via a RouterPolicyFacade

2016-11-16 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672569#comment-15672569 ] Subru Krishnan commented on YARN-5634: -- Thanks [~curino] for the updated patch. The test case failure

[jira] [Commented] (YARN-5895) TestRMRestart#testFinishedAppRemovalAfterRMRestart is still flakey

2016-11-16 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672540#comment-15672540 ] Rohith Sharma K S commented on YARN-5895: - [~sandflee] I was looking all the test failure JIRA

[jira] [Commented] (YARN-5634) Simplify initialization/use of RouterPolicy via a RouterPolicyFacade

2016-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672534#comment-15672534 ] Hadoop QA commented on YARN-5634: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5870) Expose getApplications API in YarnClient with GetApplicationsRequest parameter

2016-11-16 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672520#comment-15672520 ] Rohith Sharma K S commented on YARN-5870: - +1 LGTM > Expose getApplications API in YarnClient with

[jira] [Commented] (YARN-5895) TestRMRestart#testFinishedAppRemovalAfterRMRestart is still flakey

2016-11-16 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672503#comment-15672503 ] Sunil G commented on YARN-5895: --- Thanks. Could we handle TestRMRestart test cases modification related to

[jira] [Commented] (YARN-5895) TestRMRestart#testFinishedAppRemovalAfterRMRestart is still flakey

2016-11-16 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672483#comment-15672483 ] sandflee commented on YARN-5895: yes. > TestRMRestart#testFinishedAppRemovalAfterRMRestart is still

[jira] [Updated] (YARN-5292) Support for PAUSED container state

2016-11-16 Thread Hitesh Sharma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Sharma updated YARN-5292: Attachment: YARN-5292.003.patch Rebasing with latest changes from trunk. > Support for PAUSED

[jira] [Commented] (YARN-5865) Retrospect updateApplicationPriority api to handle state store exception in align with YARN-5611

2016-11-16 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672454#comment-15672454 ] Sunil G commented on YARN-5865: --- Test failures are not related. > Retrospect updateApplicationPriority api

[jira] [Commented] (YARN-5877) Allow all nm-whitelist-env to get overridden during launch

2016-11-16 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672448#comment-15672448 ] Sunil G commented on YARN-5877: --- Yes. This is an option, however it will be difficult for an admin to know

[jira] [Commented] (YARN-5895) TestRMRestart#testFinishedAppRemovalAfterRMRestart is still flakey

2016-11-16 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672433#comment-15672433 ] Sunil G commented on YARN-5895: --- [~sandflee] Post YARN-5375, we can solve these issues with new mem store

[jira] [Commented] (YARN-4752) [Umbrella] FairScheduler: Improve preemption

2016-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672416#comment-15672416 ] Hadoop QA commented on YARN-4752: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4752) [Umbrella] FairScheduler: Improve preemption

2016-11-16 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4752: --- Attachment: yarn-4752.4.patch Updated cumulative patch after YARN-5885 got committed. This

[jira] [Comment Edited] (YARN-5895) TestRMRestart#testFinishedAppRemovalAfterRMRestart is still flakey

2016-11-16 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672377#comment-15672377 ] sandflee edited comment on YARN-5895 at 11/17/16 1:48 AM: -- thanks [~wilfreds] for

[jira] [Commented] (YARN-5895) TestRMRestart#testFinishedAppRemovalAfterRMRestart is still flakey

2016-11-16 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672377#comment-15672377 ] sandflee commented on YARN-5895: thanks [~wilfreds] for reporting this, before YARN-5375, drainEvents did't

[jira] [Assigned] (YARN-5895) TestRMRestart#testFinishedAppRemovalAfterRMRestart is still flakey

2016-11-16 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sandflee reassigned YARN-5895: -- Assignee: sandflee > TestRMRestart#testFinishedAppRemovalAfterRMRestart is still flakey >

[jira] [Commented] (YARN-5375) invoke MockRM#drainEvents implicitly in MockRM methods to reduce test failures

2016-11-16 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672354#comment-15672354 ] sandflee commented on YARN-5375: Thanks Rohith,Sunil, Varun for review and commit ! after this path most

[jira] [Commented] (YARN-5885) Cleanup YARN-4752 for merge

2016-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672301#comment-15672301 ] Hadoop QA commented on YARN-5885: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5885) Cleanup YARN-4752 for merge

2016-11-16 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672268#comment-15672268 ] Daniel Templeton commented on YARN-5885: +1 pending Jenkins. > Cleanup YARN-4752 for merge >

[jira] [Updated] (YARN-5634) Simplify initialization/use of RouterPolicy via a RouterPolicyFacade

2016-11-16 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-5634: --- Attachment: YARN-5634-YARN-2915.08.patch > Simplify initialization/use of RouterPolicy via a

[jira] [Commented] (YARN-5634) Simplify initialization/use of RouterPolicy via a RouterPolicyFacade

2016-11-16 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672252#comment-15672252 ] Carlo Curino commented on YARN-5634: I have just done so in the .08.patch uploaded, let's see if yetus

[jira] [Commented] (YARN-5634) Simplify initialization/use of RouterPolicy via a RouterPolicyFacade

2016-11-16 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672220#comment-15672220 ] Subru Krishnan commented on YARN-5634: -- I agree, can you add a findbugs exclusion. > Simplify

[jira] [Commented] (YARN-5792) adopt the id prefix for YARN, MR, and DS entities

2016-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672211#comment-15672211 ] Hadoop QA commented on YARN-5792: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-5836) Malicious AM can kill containers of other apps running in any node its containers are running

2016-11-16 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672208#comment-15672208 ] Subru Krishnan edited comment on YARN-5836 at 11/17/16 12:32 AM: - Congrats

[jira] [Comment Edited] (YARN-5836) Malicious AM can kill containers of other apps running in any node its containers are running

2016-11-16 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672208#comment-15672208 ] Subru Krishnan edited comment on YARN-5836 at 11/17/16 12:32 AM: - Congrats

[jira] [Commented] (YARN-5836) Malicious AM can kill containers of other apps running in any node its containers are running

2016-11-16 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672208#comment-15672208 ] Subru Krishnan commented on YARN-5836: -- Congrats [~botong] on your first patch and [~jlowe] for the

[jira] [Commented] (YARN-5136) Error in handling event type APP_ATTEMPT_REMOVED to the scheduler

2016-11-16 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672202#comment-15672202 ] Wilfred Spiegelenburg commented on YARN-5136: - Opened YARN-5895 to track the new failure in

[jira] [Created] (YARN-5895) TestRMRestart#testFinishedAppRemovalAfterRMRestart is still flakey

2016-11-16 Thread Wilfred Spiegelenburg (JIRA)
Wilfred Spiegelenburg created YARN-5895: --- Summary: TestRMRestart#testFinishedAppRemovalAfterRMRestart is still flakey Key: YARN-5895 URL: https://issues.apache.org/jira/browse/YARN-5895

[jira] [Commented] (YARN-5559) Analyse 2.8.0/3.0.0 jdiff reports and fix any issues

2016-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672190#comment-15672190 ] Hadoop QA commented on YARN-5559: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5761) Separate QueueManager from Scheduler

2016-11-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672167#comment-15672167 ] Wangda Tan commented on YARN-5761: -- Thanks [~xgong], +1 to latest patch. UT failure is not related, it

[jira] [Commented] (YARN-3053) [Security] Review and implement security in ATS v.2

2016-11-16 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672157#comment-15672157 ] Sangjin Lee commented on YARN-3053: --- Thanks for the explanation [~varun_saxena]. Given the fact that ATS

[jira] [Updated] (YARN-5885) Cleanup YARN-4752 for merge

2016-11-16 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5885: --- Attachment: yarn-5885.YARN-4752.4.patch Updated patch to address Daniels' latest round of

[jira] [Commented] (YARN-5634) Simplify initialization/use of RouterPolicy via a RouterPolicyFacade

2016-11-16 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672140#comment-15672140 ] Carlo Curino commented on YARN-5634: I think the findbug is not a problem, as we are doing

[jira] [Commented] (YARN-5761) Separate QueueManager from Scheduler

2016-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672118#comment-15672118 ] Hadoop QA commented on YARN-5761: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5885) Cleanup YARN-4752 for merge

2016-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672108#comment-15672108 ] Hadoop QA commented on YARN-5885: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5634) Simplify initialization/use of RouterPolicy via a RouterPolicyFacade

2016-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672097#comment-15672097 ] Hadoop QA commented on YARN-5634: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5836) Malicious AM can kill containers of other apps running in any node its containers are running

2016-11-16 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672091#comment-15672091 ] Botong Huang commented on YARN-5836: Great, thanks [~jlowe], [~asuresh] and [~subru]! > Malicious AM

[jira] [Commented] (YARN-5792) adopt the id prefix for YARN, MR, and DS entities

2016-11-16 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672049#comment-15672049 ] Sangjin Lee commented on YARN-5792: --- Thanks [~varun_saxena] for updating the patch! I think it's almost

[jira] [Commented] (YARN-5885) Cleanup YARN-4752 for merge

2016-11-16 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15672032#comment-15672032 ] Daniel Templeton commented on YARN-5885: I took a closer look and found more nits, but nothing

[jira] [Created] (YARN-5894) license warning in de.ruedigermoeller:fst:jar:2.24

2016-11-16 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-5894: Summary: license warning in de.ruedigermoeller:fst:jar:2.24 Key: YARN-5894 URL: https://issues.apache.org/jira/browse/YARN-5894 Project: Hadoop YARN Issue Type: Bug

[jira] [Resolved] (YARN-5880) Add sanity check for FIFO scheduler

2016-11-16 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu resolved YARN-5880. Resolution: Invalid There is already sanity check for memory in FIFO scheduler. > Add sanity check for FIFO

[jira] [Created] (YARN-5893) Experiment with using PriorityQueue for storing starved applications

2016-11-16 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created YARN-5893: -- Summary: Experiment with using PriorityQueue for storing starved applications Key: YARN-5893 URL: https://issues.apache.org/jira/browse/YARN-5893 Project: Hadoop

[jira] [Updated] (YARN-5761) Separate QueueManager from Scheduler

2016-11-16 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-5761: Attachment: YARN-5761.5.patch > Separate QueueManager from Scheduler >

[jira] [Updated] (YARN-5885) Cleanup YARN-4752 for merge

2016-11-16 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5885: --- Attachment: yarn-5885.YARN-4752.3.patch Updated patch renames {{FSAppAttempt}} methods

[jira] [Commented] (YARN-5836) Malicious AM can kill containers of other apps running in any node its containers are running

2016-11-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15671904#comment-15671904 ] Hudson commented on YARN-5836: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10849 (See

[jira] [Updated] (YARN-5634) Simplify initialization/use of RouterPolicy via a RouterPolicyFacade

2016-11-16 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-5634: --- Attachment: YARN-5634-YARN-2915.07.patch > Simplify initialization/use of RouterPolicy via a

[jira] [Commented] (YARN-5634) Simplify initialization/use of RouterPolicy via a RouterPolicyFacade

2016-11-16 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15671898#comment-15671898 ] Carlo Curino commented on YARN-5634: [~subru] per our offline discussion we can't use

[jira] [Commented] (YARN-5761) Separate QueueManager from Scheduler

2016-11-16 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15671896#comment-15671896 ] Xuan Gong commented on YARN-5761: - Several testcase failures are related. Uploaded a new patch to fix the

[jira] [Commented] (YARN-5891) yarn rmadmin -help contains a misspelled ResourceManager

2016-11-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15671855#comment-15671855 ] Hudson commented on YARN-5891: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10848 (See

[jira] [Commented] (YARN-5836) Malicious AM can kill containers of other apps running in any node its containers are running

2016-11-16 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15671849#comment-15671849 ] Jason Lowe commented on YARN-5836: -- +1 lgtm. Committing this. > Malicious AM can kill containers of

[jira] [Commented] (YARN-5851) TestContainerManagerSecurity testContainerManager[1] failed

2016-11-16 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15671802#comment-15671802 ] Haibo Chen commented on YARN-5851: -- The two TestContainerManagerSecurity failures cannot be reproduced

[jira] [Commented] (YARN-5559) Analyse 2.8.0/3.0.0 jdiff reports and fix any issues

2016-11-16 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15671798#comment-15671798 ] Andrew Wang commented on YARN-5559: --- Ping, seems like this patch is pretty close? Can we get it

[jira] [Commented] (YARN-5891) yarn rmadmin -help contains a misspelled ResourceManager

2016-11-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15671782#comment-15671782 ] Varun Saxena commented on YARN-5891: Committed to trunk, branch-2. Thanks [~gsohn] for your

[jira] [Commented] (YARN-5891) yarn rmadmin -help contains a misspelled ResourceManager

2016-11-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15671757#comment-15671757 ] Varun Saxena commented on YARN-5891: Straightforward fix. Will commit it. > yarn rmadmin -help

[jira] [Updated] (YARN-5891) yarn rmadmin -help contains a misspelled ResourceManager

2016-11-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-5891: --- Assignee: Grant Sohn > yarn rmadmin -help contains a misspelled ResourceManager >

[jira] [Comment Edited] (YARN-5792) adopt the id prefix for YARN, MR, and DS entities

2016-11-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15671745#comment-15671745 ] Varun Saxena edited comment on YARN-5792 at 11/16/16 9:51 PM: -- Thanks

[jira] [Updated] (YARN-5792) adopt the id prefix for YARN, MR, and DS entities

2016-11-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-5792: --- Attachment: YARN-5792-YARN-5355.05.patch > adopt the id prefix for YARN, MR, and DS entities >

[jira] [Commented] (YARN-5792) adopt the id prefix for YARN, MR, and DS entities

2016-11-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15671745#comment-15671745 ] Varun Saxena commented on YARN-5792: Thanks [~sjlee0] for the review. Fixed all the comments. In

[jira] [Commented] (YARN-5891) yarn rmadmin -help contains a misspelled ResourceManager

2016-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15671606#comment-15671606 ] Hadoop QA commented on YARN-5891: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5136) Error in handling event type APP_ATTEMPT_REMOVED to the scheduler

2016-11-16 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15671627#comment-15671627 ] Wilfred Spiegelenburg commented on YARN-5136: -

[jira] [Updated] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

2016-11-16 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5892: - Description: Currently, in the capacity scheduler, the {{minimum-user-limit-percent}} property is per

[jira] [Commented] (YARN-5136) Error in handling event type APP_ATTEMPT_REMOVED to the scheduler

2016-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15671546#comment-15671546 ] Hadoop QA commented on YARN-5136: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

2016-11-16 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5892: - Component/s: (was: capacity scheduler) (was: yarn)

[jira] [Moved] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

2016-11-16 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne moved MAPREDUCE-6812 to YARN-5892: - Component/s: (was: yarn) (was: capacity-sched)

[jira] [Updated] (YARN-5891) yarn rmadmin -help contains a misspelled ResourceManager

2016-11-16 Thread Grant Sohn (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Sohn updated YARN-5891: - Attachment: YARN-5891.1.patch Fix attached. > yarn rmadmin -help contains a misspelled ResourceManager >

[jira] [Created] (YARN-5891) yarn rmadmin -help contains a misspelled ResourceManager

2016-11-16 Thread Grant Sohn (JIRA)
Grant Sohn created YARN-5891: Summary: yarn rmadmin -help contains a misspelled ResourceManager Key: YARN-5891 URL: https://issues.apache.org/jira/browse/YARN-5891 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-5870) Expose getApplications API in YarnClient with GetApplicationsRequest parameter

2016-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15671467#comment-15671467 ] Hadoop QA commented on YARN-5870: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

2016-11-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15671396#comment-15671396 ] Wangda Tan commented on YARN-5889: -- Thanks [~sunilg], Haven't look at all the details, a little bit

[jira] [Comment Edited] (YARN-3053) [Security] Review and implement security in ATS v.2

2016-11-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15671338#comment-15671338 ] Varun Saxena edited comment on YARN-3053 at 11/16/16 7:38 PM: -- Well the reason

[jira] [Commented] (YARN-5870) Expose getApplications API in YarnClient with GetApplicationsRequest parameter

2016-11-16 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15671379#comment-15671379 ] Jian He commented on YARN-5870: --- The javadoc complains exception no description, but all other APIs do not

[jira] [Updated] (YARN-5870) Expose getApplications API in YarnClient with GetApplicationsRequest parameter

2016-11-16 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5870: -- Attachment: YARN-5870.2.patch > Expose getApplications API in YarnClient with GetApplicationsRequest parameter >

[jira] [Updated] (YARN-5136) Error in handling event type APP_ATTEMPT_REMOVED to the scheduler

2016-11-16 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-5136: Attachment: YARN-5136.1.patch > Error in handling event type APP_ATTEMPT_REMOVED to

[jira] [Created] (YARN-5890) FairScheduler should log information about AM-resource-usage and max-AM-share for queues

2016-11-16 Thread Yufei Gu (JIRA)
Yufei Gu created YARN-5890: -- Summary: FairScheduler should log information about AM-resource-usage and max-AM-share for queues Key: YARN-5890 URL: https://issues.apache.org/jira/browse/YARN-5890 Project:

[jira] [Commented] (YARN-5870) Expose getApplications API in YarnClient with GetApplicationsRequest parameter

2016-11-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15671353#comment-15671353 ] Wangda Tan commented on YARN-5870: -- I agree with what [~rohithsharma] mentioned, we should not break

[jira] [Commented] (YARN-5865) Retrospect updateApplicationPriority api to handle state store exception in align with YARN-5611

2016-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15671342#comment-15671342 ] Hadoop QA commented on YARN-5865: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-3053) [Security] Review and implement security in ATS v.2

2016-11-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15671338#comment-15671338 ] Varun Saxena commented on YARN-3053: Well the reason I was talking about fetching delegation token was

[jira] [Commented] (YARN-3538) TimelineServer doesn't catch/translate all exceptions raised

2016-11-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15671286#comment-15671286 ] Junping Du commented on YARN-3538: -- Sorry for slow response as in relocation... the v2 patch LGTM. +1.

[jira] [Updated] (YARN-5865) Retrospect updateApplicationPriority api to handle state store exception in align with YARN-5611

2016-11-16 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-5865: -- Attachment: YARN-5865.0006.patch Thanks [~rohithsharma] bq.After current patch change, you can remove

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

2016-11-16 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15671084#comment-15671084 ] Sunil G commented on YARN-5889: --- Sorry, earlier patch was having an error. Re-attaching correct patch. >

[jira] [Updated] (YARN-5889) Improve user-limit calculation in capacity scheduler

2016-11-16 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-5889: -- Attachment: (was: YARN-5889.v0.patch) > Improve user-limit calculation in capacity scheduler >

  1   2   >