[jira] [Commented] (YARN-6516) FairScheduler:the algorithm of assignContainer is so slow for it only can assign a thousand containers per second

2017-04-25 Thread zhangyubiao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15982465#comment-15982465 ] zhangyubiao commented on YARN-6516: --- Would you like try YARN-5483 and YARN-3139 patch. W

[jira] [Updated] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-04-25 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-2113: -- Attachment: YARN-2113.0010.patch Thank you very much [~eepayne], Nice catch! Yes, used resource has to be cloned

[jira] [Updated] (YARN-3839) Quit throwing NMNotYetReadyException

2017-04-25 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R updated YARN-3839: --- Attachment: YARN-3839.005.patch > Quit throwing NMNotYetReadyException > --

[jira] [Commented] (YARN-3839) Quit throwing NMNotYetReadyException

2017-04-25 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15982511#comment-15982511 ] Manikandan R commented on YARN-3839: Addressed all comments and attaching the new patch

[jira] [Commented] (YARN-6516) FairScheduler:the algorithm of assignContainer is so slow for it only can assign a thousand containers per second

2017-04-25 Thread JackZhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15982543#comment-15982543 ] JackZhou commented on YARN-6516: [~piaoyu zhang] How mush performance do the two patch can

[jira] [Commented] (YARN-5007) Remove deprecated constructors of MiniYARNCluster and MiniMRYarnCluster

2017-04-25 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15982680#comment-15982680 ] Andras Bokor commented on YARN-5007: It should be marked as {{deprecated}}. Using confi

[jira] [Commented] (YARN-5007) Remove deprecated constructors of MiniYARNCluster and MiniMRYarnCluster

2017-04-25 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15982687#comment-15982687 ] Akira Ajisaka commented on YARN-5007: - Thank you for reporting [~aplusplus]. I'm +1 for

[jira] [Comment Edited] (YARN-6514) Fail to launch container when distributed scheduling is enabled

2017-04-25 Thread Zheng Lv (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15980878#comment-15980878 ] Zheng Lv edited comment on YARN-6514 at 4/25/17 10:53 AM: -- [~asure

[jira] [Comment Edited] (YARN-6514) Fail to launch container when distributed scheduling is enabled

2017-04-25 Thread Zheng Lv (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15980878#comment-15980878 ] Zheng Lv edited comment on YARN-6514 at 4/25/17 11:01 AM: -- [~asure

[jira] [Commented] (YARN-3573) MiniMRYarnCluster constructor that starts the timeline server using a boolean should be marked deprecated

2017-04-25 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15982744#comment-15982744 ] Brahma Reddy Battula commented on YARN-3573: I too agree with [~boky01] ( [comm

[jira] [Commented] (YARN-3053) [Security] Review and implement authentication in ATS v.2

2017-04-25 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15982870#comment-15982870 ] Rohith Sharma K S commented on YARN-3053: - I believe that in future, there is plan

[jira] [Updated] (YARN-5881) Enable configuration of queue capacity in terms of absolute resources

2017-04-25 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-5881: -- Attachment: YARN-5881.v1.patch Attaching v1 patch with complete api set. > Enable configuration of queue capacit

[jira] [Commented] (YARN-5007) Remove deprecated constructors of MiniYARNCluster and MiniMRYarnCluster

2017-04-25 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15982939#comment-15982939 ] John Zhuge commented on YARN-5007: -- +1 Thanks [~boky01] and [~ajisakaa] for the clarificat

[jira] [Resolved] (YARN-6524) Avoid storing unnecessary information in the Memory for the finished apps

2017-04-25 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved YARN-6524. -- Resolution: Duplicate > Avoid storing unnecessary information in the Memory for the finished apps > -

[jira] [Commented] (YARN-6524) Avoid storing unnecessary information in the Memory for the finished apps

2017-04-25 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15982974#comment-15982974 ] Jason Lowe commented on YARN-6524: -- This is a duplicate of YARN-65. > Avoid storing unnec

[jira] [Commented] (YARN-6495) check docker container's exit code when writing to cgroup task files

2017-04-25 Thread Jaeboo Jeong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15983033#comment-15983033 ] Jaeboo Jeong commented on YARN-6495: I tested and developed on branch-2.7 because my cl

[jira] [Commented] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

2017-04-25 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15983076#comment-15983076 ] Jason Lowe commented on YARN-5892: -- I won't block this patch over the MULP*weight <= 100 c

[jira] [Commented] (YARN-3053) [Security] Review and implement authentication in ATS v.2

2017-04-25 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15983156#comment-15983156 ] Varun Saxena commented on YARN-3053: We will come to security for off app collectors an

[jira] [Comment Edited] (YARN-3053) [Security] Review and implement authentication in ATS v.2

2017-04-25 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15983156#comment-15983156 ] Varun Saxena edited comment on YARN-3053 at 4/25/17 4:24 PM: - W

[jira] [Comment Edited] (YARN-6428) Queue AM limit is not honored in CS always

2017-04-25 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15978691#comment-15978691 ] Bibin A Chundatt edited comment on YARN-6428 at 4/25/17 4:43 PM:

[jira] [Commented] (YARN-6202) Configuration item Dispatcher.DISPATCHER_EXIT_ON_ERROR_KEY is disregarded

2017-04-25 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15983225#comment-15983225 ] Daniel Templeton commented on YARN-6202: I hunted around, and all I could find was

[jira] [Assigned] (YARN-65) Reduce RM app memory footprint once app has completed

2017-04-25 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-65?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R reassigned YARN-65: - Assignee: Naganarasimha G R > Reduce RM app memory footprint once app has completed > --

[jira] [Commented] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

2017-04-25 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15983235#comment-15983235 ] Eric Payne commented on YARN-5892: -- I will need to upload a new patch at any rate, because

[jira] [Commented] (YARN-65) Reduce RM app memory footprint once app has completed

2017-04-25 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-65?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15983262#comment-15983262 ] Naganarasimha G R commented on YARN-65: --- [~jlowe], wow never expected to hit a issue wh

[jira] [Commented] (YARN-65) Reduce RM app memory footprint once app has completed

2017-04-25 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-65?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15983279#comment-15983279 ] Jason Lowe commented on YARN-65: Nulling fields that reference objects that are no longer nee

[jira] [Comment Edited] (YARN-6521) Yarn Log-aggregation Transform Enable not to Spam the NameNode

2017-04-25 Thread zhangyubiao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15983305#comment-15983305 ] zhangyubiao edited comment on YARN-6521 at 4/25/17 5:34 PM: [~s

[jira] [Commented] (YARN-6521) Yarn Log-aggregation Transform Enable not to Spam the NameNode

2017-04-25 Thread zhangyubiao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15983305#comment-15983305 ] zhangyubiao commented on YARN-6521: --- [~sunilg],[~varun_saxena],how about this idea? > Ya

[jira] [Commented] (YARN-65) Reduce RM app memory footprint once app has completed

2017-04-25 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-65?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15983346#comment-15983346 ] Naganarasimha G R commented on YARN-65: --- Thanks for the clarification [~jlowe], may be

[jira] [Created] (YARN-6525) Linux container executor should not propagate application errors

2017-04-25 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-6525: Summary: Linux container executor should not propagate application errors Key: YARN-6525 URL: https://issues.apache.org/jira/browse/YARN-6525 Project: Hadoop YARN

[jira] [Commented] (YARN-6516) FairScheduler:the algorithm of assignContainer is so slow for it only can assign a thousand containers per second

2017-04-25 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15983443#comment-15983443 ] Yufei Gu commented on YARN-6516: IIUC, there were only 40 containers in your cluster over t

[jira] [Commented] (YARN-6363) Extending SLS: Synthetic Load Generator

2017-04-25 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15983608#comment-15983608 ] Carlo Curino commented on YARN-6363: Thanks [~leftnoteasy]!! > Extending SLS: Synthet

[jira] [Commented] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

2017-04-25 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15983628#comment-15983628 ] Wangda Tan commented on YARN-5892: -- 1) For UsersManager - updateUserWeights: Should we re-

[jira] [Updated] (YARN-3663) Federation State and Policy Store (DBMS implementation)

2017-04-25 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-3663: --- Attachment: YARN-3663-YARN-2915.v4.patch > Federation State and Policy Store (D

[jira] [Commented] (YARN-6521) Yarn Log-aggregation Transform Enable not to Spam the NameNode

2017-04-25 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15983659#comment-15983659 ] Haibo Chen commented on YARN-6521: -- [~piaoyu zhang] Can you please provide more details on

[jira] [Commented] (YARN-6513) Fix for FindBugs getPendingLogFilesToUpload() possible NPE

2017-04-25 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15983666#comment-15983666 ] Haibo Chen commented on YARN-6513: -- Yeah, I am OK with close this as a duplicate. > Fix f

[jira] [Commented] (YARN-5983) [Umbrella] Support for FPGA as a Resource in YARN

2017-04-25 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15983668#comment-15983668 ] Wangda Tan commented on YARN-5983: -- Thanks [~tangzhankun], several questions / comments:

[jira] [Commented] (YARN-5531) UnmanagedAM pool manager for federating application across clusters

2017-04-25 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15983669#comment-15983669 ] Subru Krishnan commented on YARN-5531: -- Thanks [~botong] for the patch. I went through

[jira] [Commented] (YARN-3663) Federation State and Policy Store (DBMS implementation)

2017-04-25 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15983673#comment-15983673 ] Giovanni Matteo Fumarola commented on YARN-3663: Thanks [~curino]. I just u

[jira] [Updated] (YARN-5894) license warning in de.ruedigermoeller:fst:jar:2.24

2017-04-25 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-5894: - Attachment: YARN-5894.00.patch > license warning in de.ruedigermoeller:fst:jar:2.24 > -

[jira] [Assigned] (YARN-5894) license warning in de.ruedigermoeller:fst:jar:2.24

2017-04-25 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reassigned YARN-5894: Assignee: Haibo Chen > license warning in de.ruedigermoeller:fst:jar:2.24 >

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-04-25 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15983699#comment-15983699 ] Eric Payne commented on YARN-2113: -- Thanks [~sunilg]. I have one more (last?) concern. Sh

[jira] [Commented] (YARN-5894) license warning in de.ruedigermoeller:fst:jar:2.24

2017-04-25 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15983700#comment-15983700 ] Haibo Chen commented on YARN-5894: -- The patch upgrades fst to 2.50 which comes with Apache

[jira] [Updated] (YARN-5894) fixed license warning caused by de.ruedigermoeller:fst:jar:2.24

2017-04-25 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-5894: - Summary: fixed license warning caused by de.ruedigermoeller:fst:jar:2.24 (was: license warning in de.ruedi

[jira] [Updated] (YARN-5617) AMs only intended to run one attempt can be run more than once

2017-04-25 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-5617: - Attachment: YARN-5617-branch-2.8.003.patch Thanks, Eric! Here's the patch for branch-2.8. > AMs only inte

[jira] [Updated] (YARN-5617) AMs only intended to run one attempt can be run more than once

2017-04-25 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-5617: - Fix Version/s: 3.0.0-alpha3 2.9.0 > AMs only intended to run one attempt can be run more

[jira] [Commented] (YARN-6409) RM does not blacklist node for AM launch failures

2017-04-25 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15983707#comment-15983707 ] Haibo Chen commented on YARN-6409: -- The findbugs issues and unit test failures are unrelat

[jira] [Commented] (YARN-3663) Federation State and Policy Store (DBMS implementation)

2017-04-25 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15983736#comment-15983736 ] Carlo Curino commented on YARN-3663: Thanks [~giovanni.fumarola] for the contribution a

[jira] [Created] (YARN-6526) Refactoring SQLFederationStateStore by avoiding to recreate the connections at every call

2017-04-25 Thread Giovanni Matteo Fumarola (JIRA)
Giovanni Matteo Fumarola created YARN-6526: -- Summary: Refactoring SQLFederationStateStore by avoiding to recreate the connections at every call Key: YARN-6526 URL: https://issues.apache.org/jira/browse/YA

[jira] [Commented] (YARN-3663) Federation State and Policy Store (DBMS implementation)

2017-04-25 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15983770#comment-15983770 ] Giovanni Matteo Fumarola commented on YARN-3663: For tracking the refactori

[jira] [Commented] (YARN-6423) Queue metrics doesn't work for Fair Scheduler in SLS

2017-04-25 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15983816#comment-15983816 ] Robert Kanter commented on YARN-6423: - +1 > Queue metrics doesn't work for Fair Schedu

[jira] [Commented] (YARN-6423) Queue metrics doesn't work for Fair Scheduler in SLS

2017-04-25 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15983821#comment-15983821 ] Robert Kanter commented on YARN-6423: - Can you make a branch-2 version of the patch? I

[jira] [Created] (YARN-6527) Provide a better out-of-the-box experience for SLS

2017-04-25 Thread Robert Kanter (JIRA)
Robert Kanter created YARN-6527: --- Summary: Provide a better out-of-the-box experience for SLS Key: YARN-6527 URL: https://issues.apache.org/jira/browse/YARN-6527 Project: Hadoop YARN Issue Type

[jira] [Commented] (YARN-6423) Queue metrics doesn't work for Fair Scheduler in SLS

2017-04-25 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15983825#comment-15983825 ] Yufei Gu commented on YARN-6423: YARN-5654 is in trunk only as well. So we only commit this

[jira] [Created] (YARN-6528) Add JMX metrics for Plan Follower and Agent Placement and Plan Operations

2017-04-25 Thread Sean Po (JIRA)
Sean Po created YARN-6528: - Summary: Add JMX metrics for Plan Follower and Agent Placement and Plan Operations Key: YARN-6528 URL: https://issues.apache.org/jira/browse/YARN-6528 Project: Hadoop YARN

[jira] [Commented] (YARN-6405) Improve configuring services through REST API

2017-04-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15983860#comment-15983860 ] Hadoop QA commented on YARN-6405: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-6528) Add JMX metrics for Plan Follower and Agent Placement and Plan Operations

2017-04-25 Thread Sean Po (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Po updated YARN-6528: -- Description: YARN-1051 introduced a ReservationSytem that enables the YARN RM to handle time explicitly, i.e. use

[jira] [Created] (YARN-6529) Add JMX metrics for Priority Reservation Agent

2017-04-25 Thread Sean Po (JIRA)
Sean Po created YARN-6529: - Summary: Add JMX metrics for Priority Reservation Agent Key: YARN-6529 URL: https://issues.apache.org/jira/browse/YARN-6529 Project: Hadoop YARN Issue Type: Task

[jira] [Updated] (YARN-6529) Add JMX metrics for Priority Reservation Agent

2017-04-25 Thread Sean Po (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Po updated YARN-6529: -- Description: YARN-5211 proposes adding support for generalized priorities for reservations in the YARN Reservatio

[jira] [Created] (YARN-6530) Add JMX metrics for Priority Reservation Agent

2017-04-25 Thread Sean Po (JIRA)
Sean Po created YARN-6530: - Summary: Add JMX metrics for Priority Reservation Agent Key: YARN-6530 URL: https://issues.apache.org/jira/browse/YARN-6530 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Resolved] (YARN-6529) Add JMX metrics for Priority Reservation Agent

2017-04-25 Thread Sean Po (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Po resolved YARN-6529. --- Resolution: Duplicate Duplicate of YARN-6530. > Add JMX metrics for Priority Reservation Agent > -

[jira] [Assigned] (YARN-6530) Add JMX metrics for Priority Reservation Agent

2017-04-25 Thread Sean Po (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Po reassigned YARN-6530: - Assignee: Sean Po > Add JMX metrics for Priority Reservation Agent > -

[jira] [Updated] (YARN-6423) Queue metrics doesn't work for Fair Scheduler in SLS

2017-04-25 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-6423: Affects Version/s: (was: 2.9.0) > Queue metrics doesn't work for Fair Scheduler in SLS >

[jira] [Commented] (YARN-6423) Queue metrics doesn't work for Fair Scheduler in SLS

2017-04-25 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15983869#comment-15983869 ] Robert Kanter commented on YARN-6423: - Sorry - I got confused because the affects versi

[jira] [Commented] (YARN-6423) Queue metrics doesn't work for Fair Scheduler in SLS

2017-04-25 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15983881#comment-15983881 ] Yufei Gu commented on YARN-6423: Thanks [~rkanter] for the review and commit. Thanks [~mik

[jira] [Updated] (YARN-5411) Create a proxy chain for ApplicationClientProtocol in the Router

2017-04-25 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-5411: --- Attachment: YARN-5411-YARN-2915.v1.patch > Create a proxy chain for Application

[jira] [Updated] (YARN-5411) Create a proxy chain for ApplicationClientProtocol in the Router

2017-04-25 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-5411: --- Attachment: (was: YARN-5411-YARN-2915.v1.patch) > Create a proxy chain for

[jira] [Commented] (YARN-5894) fixed license warning caused by de.ruedigermoeller:fst:jar:2.24

2017-04-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15983921#comment-15983921 ] Hadoop QA commented on YARN-5894: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5894) fixed license warning caused by de.ruedigermoeller:fst:jar:2.24

2017-04-25 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15983928#comment-15983928 ] Robert Kanter commented on YARN-5894: - I did a diff of the jars before and after apply

[jira] [Updated] (YARN-5411) Create a proxy chain for ApplicationClientProtocol in the Router

2017-04-25 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-5411: --- Attachment: YARN-5411-YARN-2915.v1.patch > Create a proxy chain for Application

[jira] [Commented] (YARN-3053) [Security] Review and implement authentication in ATS v.2

2017-04-25 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15983954#comment-15983954 ] Robert Kanter commented on YARN-3053: - {quote}Moreover, we would need to also store the

[jira] [Commented] (YARN-6423) Queue metrics doesn't work for Fair Scheduler in SLS

2017-04-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15983957#comment-15983957 ] Hudson commented on YARN-6423: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1162

[jira] [Commented] (YARN-6512) Fix for FindBugs getProcessList() possible NPE

2017-04-25 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15984010#comment-15984010 ] Wilfred Spiegelenburg commented on YARN-6512: - I am happy to make this a duplic

[jira] [Commented] (YARN-6513) Fix for FindBugs getPendingLogFilesToUpload() possible NPE

2017-04-25 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15984011#comment-15984011 ] Wilfred Spiegelenburg commented on YARN-6513: - Yep, I am happy with making it a

[jira] [Commented] (YARN-6516) FairScheduler:the algorithm of assignContainer is so slow for it only can assign a thousand containers per second

2017-04-25 Thread JackZhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15984016#comment-15984016 ] JackZhou commented on YARN-6516: [~yufeigu] Thank you for you answers! 1. I was saw it in

[jira] [Commented] (YARN-6517) Fix warnings from Spotbugs in hadoop-yarn-common

2017-04-25 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15984036#comment-15984036 ] Naganarasimha G R commented on YARN-6517: - Mostly jenkins report is not displayed e

[jira] [Commented] (YARN-5617) AMs only intended to run one attempt can be run more than once

2017-04-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15984122#comment-15984122 ] Hadoop QA commented on YARN-5617: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-3053) [Security] Review and implement authentication in ATS v.2

2017-04-25 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15984136#comment-15984136 ] Varun Saxena commented on YARN-3053: bq. Isn't that also true for Approach 1, just that

[jira] [Comment Edited] (YARN-3053) [Security] Review and implement authentication in ATS v.2

2017-04-25 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15984136#comment-15984136 ] Varun Saxena edited comment on YARN-3053 at 4/26/17 4:10 AM: - b

[jira] [Commented] (YARN-6517) Fix warnings from Spotbugs in hadoop-yarn-common

2017-04-25 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15984145#comment-15984145 ] Wilfred Spiegelenburg commented on YARN-6517: - [~cheersyang] I have closed the

[jira] [Assigned] (YARN-6520) Fix warnings from Spotbugs in hadoop-yarn-client

2017-04-25 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R reassigned YARN-6520: -- Assignee: Manikandan R (was: Weiwei Yang) > Fix warnings from Spotbugs in hadoop-yarn-client >

[jira] [Comment Edited] (YARN-6344) Add parameter for rack locality delay in CapacityScheduler

2017-04-25 Thread Huangkaixuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15984201#comment-15984201 ] Huangkaixuan edited comment on YARN-6344 at 4/26/17 5:36 AM: - [

[jira] [Commented] (YARN-6344) Add parameter for rack locality delay in CapacityScheduler

2017-04-25 Thread Huangkaixuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15984201#comment-15984201 ] Huangkaixuan commented on YARN-6344: [~leftnoteasy] [~kkaranasos] I have verified that

[jira] [Comment Edited] (YARN-6289) Fail to achieve data locality when runing MapReduce and Spark on HDFS

2017-04-25 Thread Huangkaixuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15984202#comment-15984202 ] Huangkaixuan edited comment on YARN-6289 at 4/26/17 5:38 AM: - H

[jira] [Commented] (YARN-6289) Fail to achieve data locality when runing MapReduce and Spark on HDFS

2017-04-25 Thread Huangkaixuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15984202#comment-15984202 ] Huangkaixuan commented on YARN-6289: Hi [~leftnoteasy] I have verified that YARN-6344 i

[jira] [Comment Edited] (YARN-6289) Fail to achieve data locality when runing MapReduce and Spark on HDFS

2017-04-25 Thread Huangkaixuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15984202#comment-15984202 ] Huangkaixuan edited comment on YARN-6289 at 4/26/17 5:39 AM: - H

[jira] [Assigned] (YARN-6520) Fix warnings from Spotbugs in hadoop-yarn-client

2017-04-25 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R reassigned YARN-6520: -- Assignee: Weiwei Yang (was: Manikandan R) > Fix warnings from Spotbugs in hadoop-yarn-client >

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-04-25 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15984231#comment-15984231 ] Sunil G commented on YARN-2113: --- Thanks [~eepayne] for the comment. I almost understood this

[jira] [Updated] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-04-25 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-2113: -- Attachment: IntraQueue Preemption-Impact Analysis.pdf As mentioned earlier, I am attaching an impact analysis doc

[jira] [Updated] (YARN-5007) Remove deprecated constructors of MiniYARNCluster and MiniMRYarnCluster

2017-04-25 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-5007: Target Version/s: (was: 3.0.0-alpha3) Fix Version/s: (was: 3.0.0-alpha3) Reverted this.