[jira] [Commented] (YARN-7343) Add a junit test for ContainerScheduler recovery

2017-11-02 Thread Sampada Dehankar (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237113#comment-16237113 ] Sampada Dehankar commented on YARN-7343: [~asuresh] Please have a look at the patch submitted.

[jira] [Commented] (YARN-1015) FS should watch node resource utilization and allocate opportunistic containers if appropriate

2017-11-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237037#comment-16237037 ] Hadoop QA commented on YARN-1015: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7411) Inter-Queue preemption's computeFixpointAllocation need to handle absolute resources while computing normalizedGuarantee

2017-11-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237109#comment-16237109 ] Hadoop QA commented on YARN-7411: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7434) Router getApps REST invocation fails with multiple RMs

2017-11-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237034#comment-16237034 ] Hadoop QA commented on YARN-7434: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7434) Router getApps REST invocation fails with multiple RMs

2017-11-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237104#comment-16237104 ] Hudson commented on YARN-7434: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13183 (See

[jira] [Commented] (YARN-6394) Support specifying YARN related params in the service REST API

2017-11-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237055#comment-16237055 ] Hadoop QA commented on YARN-6394: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6128) Add support for AMRMProxy HA

2017-11-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237066#comment-16237066 ] Hadoop QA commented on YARN-6128: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7307) Allow client/AM update supported resource types via YARN APIs

2017-11-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237060#comment-16237060 ] Hadoop QA commented on YARN-7307: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7434) Router getApps REST invocation fails with multiple RMs

2017-11-02 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-7434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated YARN-7434: -- Fix Version/s: 3.0.0 2.9.0 > Router getApps REST invocation fails with multiple RMs >

[jira] [Commented] (YARN-7434) Router getApps REST invocation fails with multiple RMs

2017-11-02 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-7434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237072#comment-16237072 ] Íñigo Goiri commented on YARN-7434: --- YETUS only complained about the tests which we are tracking in

[jira] [Commented] (YARN-7102) NM heartbeat stuck when responseId overflows MAX_INT

2017-11-02 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237030#comment-16237030 ] Botong Huang commented on YARN-7102: These three unit tests seem to be timing out consistently. I will

[jira] [Commented] (YARN-7221) Add security check for privileged docker container

2017-11-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237026#comment-16237026 ] Hadoop QA commented on YARN-7221: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7427) NullPointerException in ResourceInfo when queue has not used label

2017-11-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237011#comment-16237011 ] Hadoop QA commented on YARN-7427: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7102) NM heartbeat stuck when responseId overflows MAX_INT

2017-11-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237002#comment-16237002 ] Hadoop QA commented on YARN-7102: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7337) Expose per-node over-allocation info in Node Report

2017-11-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236991#comment-16236991 ] Hadoop QA commented on YARN-7337: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7410) Cleanup FixedValueResource to avoid dependency to ResourceUtils

2017-11-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236986#comment-16236986 ] Hudson commented on YARN-7410: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13181 (See

[jira] [Commented] (YARN-7432) Fix DominantResourceFairnessPolicy serializable findbugs issues

2017-11-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236985#comment-16236985 ] Hudson commented on YARN-7432: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13181 (See

[jira] [Commented] (YARN-7139) FairScheduler: finished applications are always restored to default queue

2017-11-02 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236970#comment-16236970 ] Wilfred Spiegelenburg commented on YARN-7139: - findbugs warning is fixed via YARN-7432 >

[jira] [Commented] (YARN-7392) Render cluster information on the new yarn web ui

2017-11-02 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236967#comment-16236967 ] Sunil G commented on YARN-7392: --- +1 to latest patch. > Render cluster information on the new yarn web ui >

[jira] [Updated] (YARN-7411) Inter-Queue preemption's computeFixpointAllocation need to handle absolute resources while computing normalizedGuarantee

2017-11-02 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7411: -- Attachment: YARN-7441.YARN-5881.003.patch Patch needed rebase, Attaching v3 > Inter-Queue preemption's

[jira] [Commented] (YARN-7364) Queue dash board in new YARN UI has incorrect values

2017-11-02 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236959#comment-16236959 ] Sunil G commented on YARN-7364: --- Thanks [~leftnoteasy] for helping to review and commit the same. > Queue

[jira] [Commented] (YARN-7410) Cleanup FixedValueResource to avoid dependency to ResourceUtils

2017-11-02 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236940#comment-16236940 ] Sunil G commented on YARN-7410: --- Committing shortly. Thanks [~leftnoteasy] and [~templedf] > Cleanup

[jira] [Commented] (YARN-7434) Router getApps REST invocation fails with multiple RMs

2017-11-02 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-7434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236932#comment-16236932 ] Íñigo Goiri commented on YARN-7434: --- I added YARN-7435 to track the addition of end to end tests. >

[jira] [Commented] (YARN-7435) Add MiniYARNCluster for Federation

2017-11-02 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-7435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236929#comment-16236929 ] Íñigo Goiri commented on YARN-7435: --- This should be used in {{TestFederationInterceptorREST}}. > Add

[jira] [Comment Edited] (YARN-7434) Router getApps REST invocation fails with multiple RMs

2017-11-02 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236916#comment-16236916 ] Subru Krishnan edited comment on YARN-7434 at 11/3/17 1:25 AM: --- Thanks

[jira] [Created] (YARN-7435) Add MiniYARNCluster for Federation

2017-11-02 Thread JIRA
Íñigo Goiri created YARN-7435: - Summary: Add MiniYARNCluster for Federation Key: YARN-7435 URL: https://issues.apache.org/jira/browse/YARN-7435 Project: Hadoop YARN Issue Type: Test

[jira] [Updated] (YARN-7434) Router getApps REST invocation fails with multiple RMs

2017-11-02 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-7434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated YARN-7434: -- Attachment: YARN-7434.001.patch [~subru], moving the {{clone()}} outside works. Added patch with that.

[jira] [Commented] (YARN-7434) Router getApps REST invocation fails with multiple RMs

2017-11-02 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236916#comment-16236916 ] Subru Krishnan commented on YARN-7434: -- Thanks [~elgoiri] for the patch, couple of comments: * Can we

[jira] [Commented] (YARN-7434) Router getApps REST invocation fails with multiple RMs

2017-11-02 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-7434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236911#comment-16236911 ] Íñigo Goiri commented on YARN-7434: --- This one patch should apply to both branches. The issue might be

[jira] [Commented] (YARN-7434) Router getApps REST invocation fails with multiple RMs

2017-11-02 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236910#comment-16236910 ] Carlo Curino commented on YARN-7434: Thanks [~elgoiri] for the patch. LGTM, let's wait for Yetus. Also

[jira] [Commented] (YARN-6736) Consider writing to both ats v1 & v2 from RM for smoother upgrades

2017-11-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236895#comment-16236895 ] Hadoop QA commented on YARN-6736: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6128) Add support for AMRMProxy HA

2017-11-02 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-6128: --- Attachment: YARN-6128.v4.patch > Add support for AMRMProxy HA > > >

[jira] [Commented] (YARN-6128) Add support for AMRMProxy HA

2017-11-02 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236885#comment-16236885 ] Botong Huang commented on YARN-6128: Thanks [~subru] for the review. v4 patch uploaded addressing the

[jira] [Updated] (YARN-7432) Fix DominantResourceFairnessPolicy serializable findbugs issues

2017-11-02 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-7432: - Summary: Fix DominantResourceFairnessPolicy serializable findbugs issues (was:

[jira] [Updated] (YARN-6394) Support specifying YARN related params in the service REST API

2017-11-02 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6394: -- Attachment: YARN-6394.yarn-native-services.06.patch Uploaded a new patch which adds support for user to be able

[jira] [Commented] (YARN-7360) TestRM.testNMTokenSentForNormalContainer() should be scheduler agnostic

2017-11-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236879#comment-16236879 ] Hadoop QA commented on YARN-7360: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7434) Router getApps REST invocation fails with multiple RMs

2017-11-02 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-7434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236872#comment-16236872 ] Íñigo Goiri commented on YARN-7434: --- For testing this, we need a federated mini YARN cluster with a

[jira] [Updated] (YARN-7434) Router getApps REST invocation fails with multiple RMs

2017-11-02 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-7434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated YARN-7434: -- Attachment: YARN-7434.000.patch > Router getApps REST invocation fails with multiple RMs >

[jira] [Created] (YARN-7434) Router getApps REST invocation fails with multiple RMs

2017-11-02 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-7434: Summary: Router getApps REST invocation fails with multiple RMs Key: YARN-7434 URL: https://issues.apache.org/jira/browse/YARN-7434 Project: Hadoop YARN

[jira] [Updated] (YARN-7221) Add security check for privileged docker container

2017-11-02 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7221: Attachment: YARN-7221.001.patch Add group membership check and sudo check before allowing privileged

[jira] [Created] (YARN-7433) java.lang.RuntimeException: native snappy library not available: this version of libhadoop was built without snappy support.

2017-11-02 Thread gehaijiang (JIRA)
gehaijiang created YARN-7433: Summary: java.lang.RuntimeException: native snappy library not available: this version of libhadoop was built without snappy support. Key: YARN-7433 URL:

[jira] [Commented] (YARN-7432) DominantResourceFairnessPolicy serializable findbugs issues

2017-11-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236852#comment-16236852 ] Hadoop QA commented on YARN-7432: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7431) resource estimator has findbugs problems

2017-11-02 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236828#comment-16236828 ] Subru Krishnan commented on YARN-7431: -- Thanks [~asuresh] for the quick fix. +1 from my side as I see:

[jira] [Updated] (YARN-7427) NullPointerException in ResourceInfo when queue has not used label

2017-11-02 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-7427: Description: {noformat}Caused by: java.lang.NullPointerException at

[jira] [Commented] (YARN-7431) resource estimator has findbugs problems

2017-11-02 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236815#comment-16236815 ] Arun Suresh commented on YARN-7431: --- Looks like the patch fixes the findbugs warning (the 11 extant

[jira] [Assigned] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-02 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reassigned YARN-7430: --- Assignee: Varun Vasudev > User and Group mapping are incorrect in docker container >

[jira] [Assigned] (YARN-7427) NullPointerException in ResourceInfo when queue has not used label

2017-11-02 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung reassigned YARN-7427: --- Assignee: Jonathan Hung > NullPointerException in ResourceInfo when queue has not used label

[jira] [Commented] (YARN-7427) NullPointerException in ResourceInfo when queue has not used label

2017-11-02 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236807#comment-16236807 ] Jonathan Hung commented on YARN-7427: - So the issue only appears to be when a queue's label is unused

[jira] [Updated] (YARN-7427) NullPointerException in ResourceInfo when queue has not used label

2017-11-02 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-7427: Attachment: YARN-7427.001.patch > NullPointerException in ResourceInfo when queue has not used label

[jira] [Commented] (YARN-7431) resource estimator has findbugs problems

2017-11-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236806#comment-16236806 ] Hadoop QA commented on YARN-7431: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7431) resource estimator has findbugs problems

2017-11-02 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236804#comment-16236804 ] Carlo Curino commented on YARN-7431: The patch LGTM vs the issues listed, though let's see what yetus

[jira] [Commented] (YARN-7272) Enable timeline collector fault tolerance

2017-11-02 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236796#comment-16236796 ] Vrushali C commented on YARN-7272: -- Sharing some thoughts: Collector fault tolerance helps deal with two

[jira] [Comment Edited] (YARN-3368) [Umbrella] YARN web UI: Next generation

2017-11-02 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236786#comment-16236786 ] Vrushali C edited comment on YARN-3368 at 11/2/17 11:11 PM: Would like to just

[jira] [Updated] (YARN-1015) FS should watch node resource utilization and allocate opportunistic containers if appropriate

2017-11-02 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-1015: - Attachment: YARN-1015-YARN-1011.01.patch Upload a new patch to address the unit test failures and most of

[jira] [Updated] (YARN-7307) Allow client/AM update supported resource types via YARN APIs

2017-11-02 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7307: - Attachment: YARN-7307-branch-3.0.004.patch > Allow client/AM update supported resource types via YARN APIs

[jira] [Reopened] (YARN-7307) Allow client/AM update supported resource types via YARN APIs

2017-11-02 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reopened YARN-7307: -- Reopen to backport to 3.0. > Allow client/AM update supported resource types via YARN APIs >

[jira] [Comment Edited] (YARN-3368) [Umbrella] YARN web UI: Next generation

2017-11-02 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236786#comment-16236786 ] Vrushali C edited comment on YARN-3368 at 11/2/17 11:09 PM: Would like to just

[jira] [Commented] (YARN-3368) [Umbrella] YARN web UI: Next generation

2017-11-02 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236786#comment-16236786 ] Vrushali C commented on YARN-3368: -- Would like to just not here that the new UI has been backported to

[jira] [Commented] (YARN-5355) YARN Timeline Service v.2: alpha 2

2017-11-02 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236779#comment-16236779 ] Vrushali C commented on YARN-5355: -- Thrilled to report that Timeline Service v2 has also been back-ported

[jira] [Comment Edited] (YARN-7213) [Umbrella] Test and validate HBase-2.0.x with Atsv2

2017-11-02 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236769#comment-16236769 ] Vrushali C edited comment on YARN-7213 at 11/2/17 11:00 PM: As per the next

[jira] [Commented] (YARN-7213) [Umbrella] Test and validate HBase-2.0.x with Atsv2

2017-11-02 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236769#comment-16236769 ] Vrushali C commented on YARN-7213: -- As per the next steps document on parent jira

[jira] [Commented] (YARN-6736) Consider writing to both ats v1 & v2 from RM for smoother upgrades

2017-11-02 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236766#comment-16236766 ] Vrushali C commented on YARN-6736: -- We are thinking of considering this for the next TSv2 release. We will

[jira] [Commented] (YARN-7410) Cleanup FixedValueResource to avoid dependency to ResourceUtils

2017-11-02 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236765#comment-16236765 ] Wangda Tan commented on YARN-7410: -- [~templedf], thanks, let me prepare a list of JIRAs we need backport.

[jira] [Commented] (YARN-7413) Support resource type in SLS

2017-11-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236732#comment-16236732 ] Hadoop QA commented on YARN-7413: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7400) incorrect log preview displayed in jobhistory server ui

2017-11-02 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236713#comment-16236713 ] Junping Du commented on YARN-7400: -- Thanks [~subru]. I forget to mark jira as fixed but have commit to

[jira] [Commented] (YARN-7419) Implement Auto Queue Creation with modifications to queue mapping flow

2017-11-02 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236712#comment-16236712 ] Wangda Tan commented on YARN-7419: -- Thanks [~suma.shivaprasad] for working on this. Some comments: 1)

[jira] [Updated] (YARN-7102) NM heartbeat stuck when responseId overflows MAX_INT

2017-11-02 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-7102: --- Attachment: YARN-7102.v13.patch v13 uploaded, instead of changing

[jira] [Commented] (YARN-1015) FS should watch node resource utilization and allocate opportunistic containers if appropriate

2017-11-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236673#comment-16236673 ] Hadoop QA commented on YARN-1015: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7427) NullPointerException in ResourceInfo when queue has not used label

2017-11-02 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-7427: Description: {noformat}Caused by: java.lang.NullPointerException at

[jira] [Updated] (YARN-7427) NullPointerException in ResourceInfo when queue has not used label

2017-11-02 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-7427: Summary: NullPointerException in ResourceInfo when queue has not used label (was:

[jira] [Updated] (YARN-7431) resource estimator has findbugs problems

2017-11-02 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-7431: - Target Version/s: 2.9.0, 3.0.0, 3.1.0 > resource estimator has findbugs problems >

[jira] [Updated] (YARN-7432) DominantResourceFairnessPolicy serializable findbugs issues

2017-11-02 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-7432: - Target Version/s: 2.9.0, 3.1.0 > DominantResourceFairnessPolicy serializable findbugs issues >

[jira] [Updated] (YARN-7431) resource estimator has findbugs problems

2017-11-02 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7431: -- Attachment: YARN-7431.001.patch Attaching patch. > resource estimator has findbugs problems >

[jira] [Assigned] (YARN-7431) resource estimator has findbugs problems

2017-11-02 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reassigned YARN-7431: - Assignee: Arun Suresh > resource estimator has findbugs problems >

[jira] [Updated] (YARN-7432) DominantResourceFairnessPolicy serializable findbugs issues

2017-11-02 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-7432: --- Attachment: YARN-7432.001.patch There are three inner classes that have this issue. I added

[jira] [Assigned] (YARN-7432) DominantResourceFairnessPolicy serializable findbugs issues

2017-11-02 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton reassigned YARN-7432: -- Assignee: Daniel Templeton > DominantResourceFairnessPolicy serializable findbugs

[jira] [Updated] (YARN-7360) TestRM.testNMTokenSentForNormalContainer() should be scheduler agnostic

2017-11-02 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7360: - Attachment: YARN-7360.01.patch Upload the patch again to trigger Jenkins given I could not manage to

[jira] [Commented] (YARN-7432) DominantResourceFairnessPolicy serializable findbugs issues

2017-11-02 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236592#comment-16236592 ] Allen Wittenauer commented on YARN-7432: Then put in an exception. >

[jira] [Commented] (YARN-7432) DominantResourceFairnessPolicy serializable findbugs issues

2017-11-02 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236586#comment-16236586 ] Daniel Templeton commented on YARN-7432: Those warnings came from YARN-7374, but they don't apply

[jira] [Created] (YARN-7432) DominantResourceFairnessPolicy serializable findbugs issues

2017-11-02 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created YARN-7432: -- Summary: DominantResourceFairnessPolicy serializable findbugs issues Key: YARN-7432 URL: https://issues.apache.org/jira/browse/YARN-7432 Project: Hadoop YARN

[jira] [Commented] (YARN-7410) Cleanup FixedValueResource to avoid dependency to ResourceUtils

2017-11-02 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236579#comment-16236579 ] Daniel Templeton commented on YARN-7410: I think it's OK to get these into 3.0 since we're still

[jira] [Commented] (YARN-7413) Support resource type in SLS

2017-11-02 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236577#comment-16236577 ] Yufei Gu commented on YARN-7413: Thanks for the review, [~templedf] and [~sunilg]. Uploaded patch v2.

[jira] [Updated] (YARN-5793) Trim configuration values in DockerLinuxContainerRuntime

2017-11-02 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-5793: -- Issue Type: Sub-task (was: Bug) Parent: YARN-3611 > Trim configuration values in

[jira] [Updated] (YARN-7413) Support resource type in SLS

2017-11-02 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-7413: --- Attachment: YARN-7413.002.patch > Support resource type in SLS > > >

[jira] [Commented] (YARN-7431) resource estimator has findbugs problems

2017-11-02 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236551#comment-16236551 ] Allen Wittenauer commented on YARN-7431: It's been in the daily qbt for a while now:

[jira] [Updated] (YARN-7337) Expose per-node over-allocation info in Node Report

2017-11-02 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7337: - Attachment: YARN-7337-YARN-1011.00.patch > Expose per-node over-allocation info in Node Report >

[jira] [Commented] (YARN-7159) Normalize unit of resource objects in RM and avoid to do unit conversion in critical path

2017-11-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236546#comment-16236546 ] Hadoop QA commented on YARN-7159: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7431) resource estimator has findbugs problems

2017-11-02 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236537#comment-16236537 ] Subru Krishnan commented on YARN-7431: -- [~aw], can you share a link to the build with the findbugs

[jira] [Commented] (YARN-7371) NPE in ServiceMaster after RM is restarted and then the ServiceMaster is killed

2017-11-02 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236524#comment-16236524 ] Jian He commented on YARN-7371: --- there are some flaky tests, most of the time, if it can pass locally without

[jira] [Updated] (YARN-7431) resource estimator has findbugs problems

2017-11-02 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-7431: --- Component/s: resourcemanager > resource estimator has findbugs problems >

[jira] [Created] (YARN-7431) resource estimator has findbugs problems

2017-11-02 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created YARN-7431: -- Summary: resource estimator has findbugs problems Key: YARN-7431 URL: https://issues.apache.org/jira/browse/YARN-7431 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-7343) Add a junit test for ContainerScheduler recovery

2017-11-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236505#comment-16236505 ] Hadoop QA commented on YARN-7343: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7371) NPE in ServiceMaster after RM is restarted and then the ServiceMaster is killed

2017-11-02 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236501#comment-16236501 ] Chandni Singh commented on YARN-7371: - [~jianhe] Sounds good. Will make the changes you suggested.

[jira] [Updated] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-02 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7430: Affects Version/s: 3.0.0 2.9.0 > User and Group mapping are incorrect in docker

[jira] [Commented] (YARN-7371) NPE in ServiceMaster after RM is restarted and then the ServiceMaster is killed

2017-11-02 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236488#comment-16236488 ] Jian He commented on YARN-7371: --- Patch looks good to me overall, some comments: - This method can be removed

[jira] [Created] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-02 Thread Eric Yang (JIRA)
Eric Yang created YARN-7430: --- Summary: User and Group mapping are incorrect in docker container Key: YARN-7430 URL: https://issues.apache.org/jira/browse/YARN-7430 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-6128) Add support for AMRMProxy HA

2017-11-02 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236470#comment-16236470 ] Subru Krishnan commented on YARN-6128: -- Thanks [~botong] for the patch. Please see my comments below:

[jira] [Commented] (YARN-7371) NPE in ServiceMaster after RM is restarted and then the ServiceMaster is killed

2017-11-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236473#comment-16236473 ] Hadoop QA commented on YARN-7371: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-1015) FS should watch node resource utilization and allocate opportunistic containers if appropriate

2017-11-02 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-1015: - Attachment: YARN-1015-YARN-1011.00.patch > FS should watch node resource utilization and allocate

[jira] [Commented] (YARN-7197) Add support for a volume blacklist for docker containers

2017-11-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236421#comment-16236421 ] Hadoop QA commented on YARN-7197: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

  1   2   >