[jira] [Assigned] (YARN-7993) [UI2] yarn-service page need to consider ServiceState to show stop/delete buttons

2018-08-02 Thread Akhil PB (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akhil PB reassigned YARN-7993: -- Assignee: Akhil PB (was: Gergely Novák) > [UI2] yarn-service page need to consider ServiceState to

[jira] [Comment Edited] (YARN-7833) [PERF/TEST] Extend SLS to support simulation of a Federated Environment

2018-08-02 Thread Tanuj Nayak (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16565919#comment-16565919 ] Tanuj Nayak edited comment on YARN-7833 at 8/3/18 4:34 AM: --- Can someone take a

[jira] [Commented] (YARN-8505) AMLimit and userAMLimit check should be skipped for unmanaged AM

2018-08-02 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567715#comment-16567715 ] Tao Yang commented on YARN-8505: Thanks [~suma.shivaprasad] for your comments. IIUC, unmanaged AM should

[jira] [Commented] (YARN-8609) NM oom because of large container statuses

2018-08-02 Thread Xianghao Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567706#comment-16567706 ] Xianghao Lu commented on YARN-8609: --- Thanks for your comment. I have updated my patch according to your

[jira] [Updated] (YARN-8609) NM oom because of large container statuses

2018-08-02 Thread Xianghao Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianghao Lu updated YARN-8609: -- Attachment: YARN-8609.001.patch > NM oom because of large container statuses >

[jira] [Updated] (YARN-8609) NM oom because of large container statuses

2018-08-02 Thread Xianghao Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianghao Lu updated YARN-8609: -- Attachment: (was: YARN-8609.001.patch) > NM oom because of large container statuses >

[jira] [Updated] (YARN-8609) NM oom because of large container statuses

2018-08-02 Thread Xianghao Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianghao Lu updated YARN-8609: -- Attachment: YARN-8609.001.patch > NM oom because of large container statuses >

[jira] [Updated] (YARN-8609) NM oom because of large container statuses

2018-08-02 Thread Xianghao Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianghao Lu updated YARN-8609: -- Attachment: (was: YARN-8609.001.patch) > NM oom because of large container statuses >

[jira] [Commented] (YARN-7953) [GQ] Data structures for federation global queues calculations

2018-08-02 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567688#comment-16567688 ] Abhishek Modi commented on YARN-7953: - Thanks [~botong]. Could you please review the latest patch. >

[jira] [Updated] (YARN-8607) Incorrect annotation in ApplicationAttemptStateData#getResourceSecondsMap

2018-08-02 Thread Yeliang Cang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yeliang Cang updated YARN-8607: --- Description: In ApplicationAttemptStateData.java the annotation of getResourceSecondsMap is not

[jira] [Commented] (YARN-8287) Update documentation and yarn-default related to the Docker runtime

2018-08-02 Thread Craig Condit (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567658#comment-16567658 ] Craig Condit commented on YARN-8287: No tests as this is a documentation-only change. > Update

[jira] [Commented] (YARN-8523) Interactive docker shell

2018-08-02 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567619#comment-16567619 ] Eric Yang commented on YARN-8523: - [~divayjindal] One possible solution for option 3, embed xtermjs on

[jira] [Commented] (YARN-8448) AM HTTPS Support

2018-08-02 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567616#comment-16567616 ] genericqa commented on YARN-8448: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8619) Automate docker network configuration through YARN API

2018-08-02 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567603#comment-16567603 ] Eric Yang commented on YARN-8619: - [~shaneku...@gmail.com] "type" option can be merged as part of json

[jira] [Updated] (YARN-7974) Allow updating application tracking url after registration

2018-08-02 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-7974: Attachment: YARN-7974-branch-2.001.patch > Allow updating application tracking url after

[jira] [Updated] (YARN-7974) Allow updating application tracking url after registration

2018-08-02 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-7974: Attachment: (was: YARN-7974-branch-2.001.patch) > Allow updating application tracking url after

[jira] [Commented] (YARN-8619) Automate docker network configuration through YARN API

2018-08-02 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567596#comment-16567596 ] Shane Kumpf commented on YARN-8619: --- Thanks for the proposal, [~eyang]! I can see the value in making it

[jira] [Commented] (YARN-8287) Update documentation and yarn-default related to the Docker runtime

2018-08-02 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567566#comment-16567566 ] genericqa commented on YARN-8287: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8619) Automate docker network configuration through YARN API

2018-08-02 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567558#comment-16567558 ] Eric Yang commented on YARN-8619: - Each host may need to be configured differently, and using a file

[jira] [Commented] (YARN-7708) [GPG] Load based policy generator

2018-08-02 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567532#comment-16567532 ] genericqa commented on YARN-7708: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-8619) Automate docker network configuration through YARN API

2018-08-02 Thread Eric Yang (JIRA)
Eric Yang created YARN-8619: --- Summary: Automate docker network configuration through YARN API Key: YARN-8619 URL: https://issues.apache.org/jira/browse/YARN-8619 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-8287) Update documentation and yarn-default related to the Docker runtime

2018-08-02 Thread Craig Condit (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567514#comment-16567514 ] Craig Condit commented on YARN-8287: [~shaneku...@gmail.com], I'd like to work on this. > Update

[jira] [Assigned] (YARN-8287) Update documentation and yarn-default related to the Docker runtime

2018-08-02 Thread Craig Condit (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Condit reassigned YARN-8287: -- Assignee: Craig Condit > Update documentation and yarn-default related to the Docker runtime >

[jira] [Updated] (YARN-8618) Yarn Service: When all the components of a service have restart policy NEVER then initiation of service upgrade should fail

2018-08-02 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-8618: Description: * If all the components are NEVER, we can error out at the service level upgrade

[jira] [Created] (YARN-8618) Yarn Service: When all the components of a service have restart policy NEVER then initiation of service upgrade should fail

2018-08-02 Thread Chandni Singh (JIRA)
Chandni Singh created YARN-8618: --- Summary: Yarn Service: When all the components of a service have restart policy NEVER then initiation of service upgrade should fail Key: YARN-8618 URL:

[jira] [Commented] (YARN-8136) Add version attribute to site doc examples and quickstart

2018-08-02 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567482#comment-16567482 ] genericqa commented on YARN-8136: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7863) Modify placement constraints to support node attributes

2018-08-02 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567462#comment-16567462 ] genericqa commented on YARN-7863: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8270) Adding JMX Metrics for Timeline Collector and Reader

2018-08-02 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567442#comment-16567442 ] genericqa commented on YARN-8270: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4946) RM should not consider an application as COMPLETED when log aggregation is not in a terminal state

2018-08-02 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567434#comment-16567434 ] Robert Kanter commented on YARN-4946: - I'm not sure if any of the 3 versions of the ATS have the log

[jira] [Resolved] (YARN-8587) Delays are noticed to launch docker container

2018-08-02 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang resolved YARN-8587. - Resolution: Not A Bug > Delays are noticed to launch docker container >

[jira] [Commented] (YARN-8587) Delays are noticed to launch docker container

2018-08-02 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567431#comment-16567431 ] Eric Yang commented on YARN-8587: - DistributedShell uses YARN v1 API, which doesn't support more

[jira] [Created] (YARN-8617) Aggregated Application Logs accumulates for long running jobs

2018-08-02 Thread Prabhu Joseph (JIRA)
Prabhu Joseph created YARN-8617: --- Summary: Aggregated Application Logs accumulates for long running jobs Key: YARN-8617 URL: https://issues.apache.org/jira/browse/YARN-8617 Project: Hadoop YARN

[jira] [Commented] (YARN-8270) Adding JMX Metrics for Timeline Collector and Reader

2018-08-02 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567415#comment-16567415 ] genericqa commented on YARN-8270: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8505) AMLimit and userAMLimit check should be skipped for unmanaged AM

2018-08-02 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567413#comment-16567413 ] Suma Shivaprasad commented on YARN-8505: [~Tao Yang] Thanks for the patch. Had a question/comment

[jira] [Updated] (YARN-8403) Nodemanager logs failed to download file with INFO level

2018-08-02 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8403: Issue Type: Bug (was: Sub-task) Parent: (was: YARN-8472) > Nodemanager logs failed to download

[jira] [Commented] (YARN-8509) Fix UserLimit calculation for preemption to balance scenario after queue satisfied

2018-08-02 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567405#comment-16567405 ] Eric Payne commented on YARN-8509: -- I am very sorry for coming in late here. Please give me another day

[jira] [Updated] (YARN-6966) NodeManager metrics may return wrong negative values when NM restart

2018-08-02 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6966: - Fix Version/s: 2.10.0 > NodeManager metrics may return wrong negative values when NM restart >

[jira] [Commented] (YARN-6966) NodeManager metrics may return wrong negative values when NM restart

2018-08-02 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567394#comment-16567394 ] Haibo Chen commented on YARN-6966: -- The build has finished at

[jira] [Updated] (YARN-8608) [UI2] No information available per application appAttempt about 'Total Outstanding Resource Requests'

2018-08-02 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8608: - Reporter: Sumana Sathish (was: Akhil PB) > [UI2] No information available per application appAttempt

[jira] [Updated] (YARN-8615) [UI2] Resource Usage tab shows only memory related info. No info available for vcores/gpu.

2018-08-02 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8615: - Reporter: Sumana Sathish (was: Akhil PB) > [UI2] Resource Usage tab shows only memory related info. No

[jira] [Updated] (YARN-8270) Adding JMX Metrics for Timeline Collector and Reader

2018-08-02 Thread Sushil Ks (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushil Ks updated YARN-8270: Attachment: (was: YARN-8270.002.patch) > Adding JMX Metrics for Timeline Collector and Reader >

[jira] [Commented] (YARN-8549) Adding a NoOp timeline writer and reader plugin classes for ATSv2

2018-08-02 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567342#comment-16567342 ] genericqa commented on YARN-8549: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7953) [GQ] Data structures for federation global queues calculations

2018-08-02 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567327#comment-16567327 ] genericqa commented on YARN-7953: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7953) [GQ] Data structures for federation global queues calculations

2018-08-02 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567130#comment-16567130 ] Botong Huang commented on YARN-7953: Rebase done and re-kicked yetus for this thread.  > [GQ] Data

[jira] [Commented] (YARN-7863) Modify placement constraints to support node attributes

2018-08-02 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567127#comment-16567127 ] Sunil Govindan commented on YARN-7863: -- Attached rebased patch.   [~cheersyang], these constraints

[jira] [Updated] (YARN-7863) Modify placement constraints to support node attributes

2018-08-02 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-7863: - Attachment: YARN-7863-YARN-3409.004.patch > Modify placement constraints to support node

[jira] [Commented] (YARN-7159) Normalize unit of resource objects in RM to avoid unit conversion in critical path

2018-08-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567120#comment-16567120 ] Hudson commented on YARN-7159: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14699 (See

[jira] [Commented] (YARN-7948) Enable fair scheduler to refresh maximum allocation for multiple resource types

2018-08-02 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567118#comment-16567118 ] Szilard Nemeth commented on YARN-7948: -- Thanks [~haibochen]! > Enable fair scheduler to refresh

[jira] [Commented] (YARN-7948) Enable fair scheduler to refresh maximum allocation for multiple resource types

2018-08-02 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567097#comment-16567097 ] Haibo Chen commented on YARN-7948: -- +1 on the 04 patch. Checking it in shortly. > Enable fair scheduler

[jira] [Updated] (YARN-7948) Enable fair scheduler to refresh maximum allocation for multiple resource types

2018-08-02 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7948: - Summary: Enable fair scheduler to refresh maximum allocation for multiple resource types (was: Enable

[jira] [Updated] (YARN-8549) Adding a NoOp timeline writer and reader plugin classes for ATSv2

2018-08-02 Thread Prabha Manepalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabha Manepalli updated YARN-8549: --- Attachment: YARN-8549-branch-2.03.patch > Adding a NoOp timeline writer and reader plugin

[jira] [Commented] (YARN-8448) AM HTTPS Support

2018-08-02 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567078#comment-16567078 ] Robert Kanter commented on YARN-8448: - I'm not sure where Jenkins went, so I've just kicked one off

[jira] [Commented] (YARN-6966) NodeManager metrics may return wrong negative values when NM restart

2018-08-02 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567076#comment-16567076 ] Haibo Chen commented on YARN-6966: -- I have backported YARN-7542 to branch-2. Will kick off another

[jira] [Updated] (YARN-7542) Fix issue that causes some Running Opportunistic Containers to be recovered as PAUSED

2018-08-02 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7542: - Fix Version/s: 2.10.0 > Fix issue that causes some Running Opportunistic Containers to be recovered > as

[jira] [Commented] (YARN-7542) Fix issue that causes some Running Opportunistic Containers to be recovered as PAUSED

2018-08-02 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567074#comment-16567074 ] Haibo Chen commented on YARN-7542: -- I have cherry-picked from branch-3.0 to branch-2, FYI. > Fix issue

[jira] [Comment Edited] (YARN-8612) Fix NM Collector Service Port issue in YarnConfiguration

2018-08-02 Thread Prabha Manepalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567068#comment-16567068 ] Prabha Manepalli edited comment on YARN-8612 at 8/2/18 5:00 PM: It is a

[jira] [Updated] (YARN-7159) Normalize unit of resource objects in RM to avoid unit conversion in critical path

2018-08-02 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-7159: - Summary: Normalize unit of resource objects in RM to avoid unit conversion in critical path

[jira] [Commented] (YARN-8612) Fix NM Collector Service Port issue in YarnConfiguration

2018-08-02 Thread Prabha Manepalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567068#comment-16567068 ] Prabha Manepalli commented on YARN-8612: It is a config change and not a code change. There are no

[jira] [Commented] (YARN-4946) RM should not consider an application as COMPLETED when log aggregation is not in a terminal state

2018-08-02 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567065#comment-16567065 ] genericqa commented on YARN-4946: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7159) Normalize unit of resource objects in RM and avoid to do unit conversion in critical path

2018-08-02 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567052#comment-16567052 ] Sunil Govindan commented on YARN-7159: -- Sorry. patch command works on this. Hence no worries. Thanks.

[jira] [Commented] (YARN-7159) Normalize unit of resource objects in RM and avoid to do unit conversion in critical path

2018-08-02 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567034#comment-16567034 ] Sunil Govindan commented on YARN-7159: -- [~maniraj...@gmail.com] I think patch needs a rebase. Not

[jira] [Commented] (YARN-7948) Enable refreshing maximum allocation for multiple resource types

2018-08-02 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567025#comment-16567025 ] genericqa commented on YARN-7948: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8263) DockerClient still touches hadoop.tmp.dir

2018-08-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16567006#comment-16567006 ] Hudson commented on YARN-8263: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14698 (See

[jira] [Comment Edited] (YARN-8613) Old RM UI shows wrong vcores total value

2018-08-02 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16566557#comment-16566557 ] Bibin A Chundatt edited comment on YARN-8613 at 8/2/18 4:01 PM: [~sunilg]

[jira] [Commented] (YARN-8318) [UI2] IP address in component page shows N/A

2018-08-02 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16566961#comment-16566961 ] genericqa commented on YARN-8318: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-4946) RM should not consider an application as COMPLETED when log aggregation is not in a terminal state

2018-08-02 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16566890#comment-16566890 ] Szilard Nemeth edited comment on YARN-4946 at 8/2/18 3:27 PM: -- DEV NOTES:

[jira] [Comment Edited] (YARN-4946) RM should not consider an application as COMPLETED when log aggregation is not in a terminal state

2018-08-02 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16566890#comment-16566890 ] Szilard Nemeth edited comment on YARN-4946 at 8/2/18 3:26 PM: -- DEV NOTES: An

[jira] [Comment Edited] (YARN-4946) RM should not consider an application as COMPLETED when log aggregation is not in a terminal state

2018-08-02 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16566890#comment-16566890 ] Szilard Nemeth edited comment on YARN-4946 at 8/2/18 3:26 PM: -- DEV NOTES:

[jira] [Comment Edited] (YARN-4946) RM should not consider an application as COMPLETED when log aggregation is not in a terminal state

2018-08-02 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16566890#comment-16566890 ] Szilard Nemeth edited comment on YARN-4946 at 8/2/18 3:26 PM: -- DEV NOTES: An

[jira] [Commented] (YARN-8263) DockerClient still touches hadoop.tmp.dir

2018-08-02 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16566936#comment-16566936 ] Jason Lowe commented on YARN-8263: -- Thanks for updating the patch! +1 lgtm. There are now some unused

[jira] [Created] (YARN-8616) System.currentTimeMillis() used in RMAppImpl, instead of getting value from systemClock

2018-08-02 Thread Szilard Nemeth (JIRA)
Szilard Nemeth created YARN-8616: Summary: System.currentTimeMillis() used in RMAppImpl, instead of getting value from systemClock Key: YARN-8616 URL: https://issues.apache.org/jira/browse/YARN-8616

[jira] [Commented] (YARN-8318) [UI2] IP address in component page shows N/A

2018-08-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16566926#comment-16566926 ] Hudson commented on YARN-8318: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14697 (See

[jira] [Commented] (YARN-4946) RM should not consider an application as COMPLETED when log aggregation is not in a terminal state

2018-08-02 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16566903#comment-16566903 ] Szilard Nemeth commented on YARN-4946: -- Hi [~csingh]! I think the log aggregation status is only

[jira] [Commented] (YARN-4946) RM should not consider an application as COMPLETED when log aggregation is not in a terminal state

2018-08-02 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16566896#comment-16566896 ] Szilard Nemeth commented on YARN-4946: -- uploaded patch002 to fix whitespace issues. The unit test

[jira] [Updated] (YARN-4946) RM should not consider an application as COMPLETED when log aggregation is not in a terminal state

2018-08-02 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-4946: - Attachment: YARN-4946.002.patch > RM should not consider an application as COMPLETED when log

[jira] [Commented] (YARN-4946) RM should not consider an application as COMPLETED when log aggregation is not in a terminal state

2018-08-02 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16566890#comment-16566890 ] Szilard Nemeth commented on YARN-4946: -- DEV NOTES: An initial implementation could have looked it

[jira] [Updated] (YARN-8318) [UI2] IP address in component page shows N/A

2018-08-02 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8318: - Summary: [UI2] IP address in component page shows N/A (was: IP address in component page shows

[jira] [Commented] (YARN-8318) IP address in component page shows N/A

2018-08-02 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16566875#comment-16566875 ] Sunil Govindan commented on YARN-8318: -- This patch looks good and straightforward. Some how fell out

[jira] [Updated] (YARN-7948) Enable refreshing maximum allocation for multiple resource types

2018-08-02 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-7948: - Attachment: YARN-7948.004.patch > Enable refreshing maximum allocation for multiple resource

[jira] [Commented] (YARN-7948) Enable refreshing maximum allocation for multiple resource types

2018-08-02 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16566839#comment-16566839 ] Szilard Nemeth commented on YARN-7948: -- Hi [~haibochen]! You are right about the imports, not sure

[jira] [Commented] (YARN-8559) Expose mutable-conf scheduler's configuration in RM /scheduler-conf endpoint

2018-08-02 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16566711#comment-16566711 ] Sunil Govindan commented on YARN-8559: -- Thanks [~cheersyang]. Looks good. Only concern was that

[jira] [Commented] (YARN-6966) NodeManager metrics may return wrong negative values when NM restart

2018-08-02 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16566683#comment-16566683 ] Szilard Nemeth commented on YARN-6966: -- Hi [~haibochen]! I found out what is causing the test to

[jira] [Commented] (YARN-8592) [UI2] rmip:port/ui2 endpoint shows a blank page in windows OS and Chrome browser

2018-08-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16566629#comment-16566629 ] Hudson commented on YARN-8592: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14694 (See

[jira] [Updated] (YARN-8592) [UI2] rmip:port/ui2 endpoint shows a blank page in windows OS and Chrome browser

2018-08-02 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8592: - Summary: [UI2] rmip:port/ui2 endpoint shows a blank page in windows OS and Chrome browser (was:

[jira] [Commented] (YARN-8592) [UI2] Resource Manager Web UI V2 shows a blank page in windows OS And Chrome browser

2018-08-02 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16566589#comment-16566589 ] Sunil Govindan commented on YARN-8592: -- Thanks [~akhilpb]. This looks fine to me.  I tested in a

[jira] [Commented] (YARN-8613) Old RM UI shows wrong vcores total value

2018-08-02 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16566557#comment-16566557 ] Bibin A Chundatt commented on YARN-8613: [~sunilg] Yes . Looks like queue metrics issue . IIRC

[jira] [Commented] (YARN-8615) [UI2] Resource Usage tab shows only memory related info. No info available for vcores/gpu.

2018-08-02 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16566547#comment-16566547 ] genericqa commented on YARN-8615: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8615) [UI2] Resource Usage tab shows only memory related info. No info available for vcores/gpu.

2018-08-02 Thread Akhil PB (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akhil PB updated YARN-8615: --- Summary: [UI2] Resource Usage tab shows only memory related info. No info available for vcores/gpu. (was:

[jira] [Created] (YARN-8615) [UI2] Resource Usage tab shows only memory related info. Drop Down box disappears to select vcores/gpu

2018-08-02 Thread Akhil PB (JIRA)
Akhil PB created YARN-8615: -- Summary: [UI2] Resource Usage tab shows only memory related info. Drop Down box disappears to select vcores/gpu Key: YARN-8615 URL: https://issues.apache.org/jira/browse/YARN-8615

[jira] [Commented] (YARN-8509) Fix UserLimit calculation for preemption to balance scenario after queue satisfied

2018-08-02 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16566490#comment-16566490 ] Zian Chen commented on YARN-8509: - Thanks [~csingh] for the review. The failed UT are not related.  

[jira] [Commented] (YARN-8614) Some typos in YarnConfiguration

2018-08-02 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16566488#comment-16566488 ] genericqa commented on YARN-8614: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8594) [UI2] Display current logged in user

2018-08-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16566451#comment-16566451 ] Hudson commented on YARN-8594: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14693 (See

[jira] [Assigned] (YARN-8614) Some typos in YarnConfiguration

2018-08-02 Thread Sen Zhao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sen Zhao reassigned YARN-8614: -- Assignee: Sen Zhao > Some typos in YarnConfiguration > --- > >

[jira] [Updated] (YARN-8614) Some typos in YarnConfiguration

2018-08-02 Thread Sen Zhao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sen Zhao updated YARN-8614: --- Attachment: YARN-8614.001.patch > Some typos in YarnConfiguration > --- > >

[jira] [Created] (YARN-8614) Some typos in YarnConfiguration

2018-08-02 Thread Sen Zhao (JIRA)
Sen Zhao created YARN-8614: -- Summary: Some typos in YarnConfiguration Key: YARN-8614 URL: https://issues.apache.org/jira/browse/YARN-8614 Project: Hadoop YARN Issue Type: Bug Reporter:

[jira] [Commented] (YARN-8594) [UI2] Display current logged in user

2018-08-02 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16566434#comment-16566434 ] Sunil Govindan commented on YARN-8594: -- Looks good +1 > [UI2] Display current logged in user >

[jira] [Commented] (YARN-8613) Old RM UI shows wrong vcores total value

2018-08-02 Thread Sen Zhao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16566433#comment-16566433 ] Sen Zhao commented on YARN-8613: Is it possible to use {{rs.getClusterResource().getVirtualCores()}}

[jira] [Updated] (YARN-8594) [UI2] Display current logged in user

2018-08-02 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8594: - Summary: [UI2] Display current logged in user (was: [UI2] Show the current logged in user in

[jira] [Commented] (YARN-8594) [UI2] Show the current logged in user in UI2

2018-08-02 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16566429#comment-16566429 ] genericqa commented on YARN-8594: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8613) Old RM UI shows wrong vcores total value

2018-08-02 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16566422#comment-16566422 ] Sunil Govindan commented on YARN-8613: -- This looks like a QueuMetrics issue. cc [~rohithsharma]

  1   2   >