[jira] [Updated] (YARN-7129) Application Catalog for YARN applications

2019-01-24 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7129: Attachment: YARN-7129.017.patch > Application Catalog for YARN applications >

[jira] [Commented] (YARN-8901) Restart "NEVER" policy does not work with component dependency

2019-01-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751499#comment-16751499 ] Hadoop QA commented on YARN-8901: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8901) Restart "NEVER" policy does not work with component dependency

2019-01-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751563#comment-16751563 ] Hadoop QA commented on YARN-8901: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8867) Retrieve the status of resource localization

2019-01-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751656#comment-16751656 ] Hadoop QA commented on YARN-8867: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8867) Retrieve the status of resource localization

2019-01-24 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751698#comment-16751698 ] Eric Yang commented on YARN-8867: - +1 for patch 008. Committing to trunk. > Retrieve the status of

[jira] [Commented] (YARN-6616) YARN AHS shows submitTime for jobs same as startTime

2019-01-24 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751491#comment-16751491 ] Eric Payne commented on YARN-6616: -- I will review today > YARN AHS shows submitTime for jobs same as

[jira] [Commented] (YARN-7088) Add application launch time to Resource Manager REST API

2019-01-24 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751619#comment-16751619 ] Jonathan Hung commented on YARN-7088: - Thx, will commit the backports by EOD. > Add application

[jira] [Commented] (YARN-8867) Retrieve the status of resource localization

2019-01-24 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751681#comment-16751681 ] Chandni Singh commented on YARN-8867: - Ran these unit tests couple of time locally and they do pass.

[jira] [Commented] (YARN-7088) Add application launch time to Resource Manager REST API

2019-01-24 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751444#comment-16751444 ] Arun Suresh commented on YARN-7088: --- [~jhung] the backport for branch-2 look pretty straightforward.

[jira] [Commented] (YARN-9188) Port YARN-7136 to branch-2

2019-01-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751624#comment-16751624 ] Hadoop QA commented on YARN-9188: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9181) Backport YARN-6232 for generic resource type usage to branch-2

2019-01-24 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-9181: Attachment: YARN-9181-YARN-8200.001-addendum.patch > Backport YARN-6232 for generic resource type

[jira] [Commented] (YARN-9227) DistributedShell RelativePath is not removed at end

2019-01-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751463#comment-16751463 ] Hadoop QA commented on YARN-9227: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7088) Add application launch time to Resource Manager REST API

2019-01-24 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751451#comment-16751451 ] Jonathan Hung commented on YARN-7088: - Thx [~asuresh], I think the javadoc is not related: {noformat}

[jira] [Commented] (YARN-7088) Add application launch time to Resource Manager REST API

2019-01-24 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751482#comment-16751482 ] Arun Suresh commented on YARN-7088: --- +1 in that case > Add application launch time to Resource Manager

[jira] [Updated] (YARN-9221) Add a flag to enable dynamic auxiliary service feature

2019-01-24 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-9221: - Attachment: YARN-9221.02.patch > Add a flag to enable dynamic auxiliary service feature >

[jira] [Commented] (YARN-9221) Add a flag to enable dynamic auxiliary service feature

2019-01-24 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751591#comment-16751591 ] Billie Rinaldi commented on YARN-9221: -- Thanks [~eyang]! I improved the documentation in patch 2, as

[jira] [Assigned] (YARN-7136) Additional Performance Improvement for Resource Profile Feature

2019-01-24 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung reassigned YARN-7136: --- Assignee: Wangda Tan (was: Jonathan Hung) > Additional Performance Improvement for Resource

[jira] [Commented] (YARN-9221) Add a flag to enable dynamic auxiliary service feature

2019-01-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751707#comment-16751707 ] Hadoop QA commented on YARN-9221: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8901) Restart "NEVER" policy does not work with component dependency

2019-01-24 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751437#comment-16751437 ] Suma Shivaprasad commented on YARN-8901: Added UT > Restart "NEVER" policy does not work with

[jira] [Commented] (YARN-9181) Backport YARN-6232 for generic resource type usage to branch-2

2019-01-24 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751470#comment-16751470 ] Jonathan Hung commented on YARN-9181: - FYI I uploaded an addendum patch for a real compilation issue

[jira] [Commented] (YARN-9188) Port YARN-7136 to branch-2

2019-01-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751492#comment-16751492 ] Hadoop QA commented on YARN-9188: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-7136) Additional Performance Improvement for Resource Profile Feature

2019-01-24 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung reassigned YARN-7136: --- Assignee: Jonathan Hung (was: Wangda Tan) > Additional Performance Improvement for Resource

[jira] [Commented] (YARN-9221) Add a flag to enable dynamic auxiliary service feature

2019-01-24 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751710#comment-16751710 ] Eric Yang commented on YARN-9221: - [~billie.rinaldi] Patch 2 contains an error for YarnConfiguration class

[jira] [Commented] (YARN-8867) Retrieve the status of resource localization

2019-01-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751714#comment-16751714 ] Hudson commented on YARN-8867: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15824 (See

[jira] [Commented] (YARN-9222) Print launchTime in ApplicationSummary

2019-01-24 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751747#comment-16751747 ] Jonathan Hung commented on YARN-9222: - uploaded 001 which prints launchTime in app summary > Print

[jira] [Commented] (YARN-7848) Force removal of docker containers that do not get removed on first try

2019-01-24 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751820#comment-16751820 ] Eric Yang commented on YARN-7848: - [~ebadger] YARN-9074 does not force removal of container. Hence, this

[jira] [Commented] (YARN-8498) Yarn NodeManager OOM Listener Fails Compilation on Ubuntu 18.04

2019-01-24 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751903#comment-16751903 ] Vinayakumar B commented on YARN-8498: - Yes. We can get this in. > Yarn NodeManager OOM Listener Fails

[jira] [Updated] (YARN-9209) When nodePartition is not set in Placement Constraints, containers are allocated only in default partition

2019-01-24 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi updated YARN-9209: --- Attachment: YARN-9209.001.patch > When nodePartition is not set in Placement Constraints, containers

[jira] [Assigned] (YARN-9209) When nodePartition is not set in Placement Constraints, containers are allocated only in default partition

2019-01-24 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi reassigned YARN-9209: -- Assignee: Tarun Parimi > When nodePartition is not set in Placement Constraints, containers

[jira] [Updated] (YARN-9060) [YARN-8851] Phase 1 - Support device isolation in native container-executor

2019-01-24 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-9060: --- Attachment: YARN-9060-trunk.011.patch > [YARN-8851] Phase 1 - Support device isolation in native

[jira] [Updated] (YARN-9222) Print launchTime in ApplicationSummary

2019-01-24 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-9222: Attachment: YARN-9222.001.patch > Print launchTime in ApplicationSummary >

[jira] [Commented] (YARN-6616) YARN AHS shows submitTime for jobs same as startTime

2019-01-24 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751752#comment-16751752 ] Eric Payne commented on YARN-6616: -- [~Prabhu Joseph], Thanks for the hard work on this issue. I'm sorry

[jira] [Updated] (YARN-9188) Port YARN-7136 to branch-2

2019-01-24 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-9188: Attachment: YARN-9188-YARN-8200.002.patch > Port YARN-7136 to branch-2 > --

[jira] [Commented] (YARN-9188) Port YARN-7136 to branch-2

2019-01-24 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751784#comment-16751784 ] Jonathan Hung commented on YARN-9188: - 002 fixes findbugs error > Port YARN-7136 to branch-2 >

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-24 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751934#comment-16751934 ] Zac Zhou commented on YARN-9161: [~sunilg], Thanks a lot for your comments~ {quote}I have some doubts

[jira] [Comment Edited] (YARN-9234) NPE Exception Occurred on Resourcemanager

2019-01-24 Thread Amithsha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751266#comment-16751266 ] Amithsha edited comment on YARN-9234 at 1/25/19 6:57 AM: - [~sunilg] Thanks for the

[jira] [Commented] (YARN-9039) App ACLs are not validated when serving logs from LogWebService

2019-01-24 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751972#comment-16751972 ] Bibin A Chundatt commented on YARN-9039: [~suma.shivaprasad] Any update on this jira.. IIRC

[jira] [Commented] (YARN-9222) Print launchTime in ApplicationSummary

2019-01-24 Thread Keqiu Hu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751860#comment-16751860 ] Keqiu Hu commented on YARN-9222: +1 lgtm straightforward > Print launchTime in ApplicationSummary >

[jira] [Commented] (YARN-9195) RM Queue's pending container number might get decreased unexpectedly or even become negative once RM failover

2019-01-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751889#comment-16751889 ] Wangda Tan commented on YARN-9195: -- [~ssy] add you to contributor list so you can assign Jira to yourself

[jira] [Assigned] (YARN-9195) RM Queue's pending container number might get decreased unexpectedly or even become negative once RM failover

2019-01-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-9195: Assignee: Shengyang Sha > RM Queue's pending container number might get decreased unexpectedly or

[jira] [Commented] (YARN-5336) Limit the flow name size & consider cleanup for hex chars

2019-01-24 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751899#comment-16751899 ] Vrushali C commented on YARN-5336: -- Also, if we are updating the patch, could you add some comments

[jira] [Commented] (YARN-6539) Create SecureLogin inside Router

2019-01-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751916#comment-16751916 ] Hadoop QA commented on YARN-6539: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9233) RM may report allocated container which is killed (but not acquired by AM ) to AM which can cause spark AM confused

2019-01-24 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751925#comment-16751925 ] Bibin A Chundatt commented on YARN-9233: Thank you [~BilwaST] for raising this issue If the

[jira] [Comment Edited] (YARN-9221) Add a flag to enable dynamic auxiliary service feature

2019-01-24 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751710#comment-16751710 ] Eric Yang edited comment on YARN-9221 at 1/25/19 12:29 AM: --- [~billie.rinaldi]

[jira] [Commented] (YARN-9222) Print launchTime in ApplicationSummary

2019-01-24 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751851#comment-16751851 ] Jonathan Hung commented on YARN-9222: - TestCapacitySchedulerMetrics.testCSMetrics passes locally for

[jira] [Commented] (YARN-9150) Making TimelineSchemaCreator support different backends for Timeline Schema Creation in ATSv2

2019-01-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751894#comment-16751894 ] Hadoop QA commented on YARN-9150: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9060) [YARN-8851] Phase 1 - Support device isolation in native container-executor

2019-01-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751915#comment-16751915 ] Hadoop QA commented on YARN-9060: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9231) TestDistributedShell fix timeout

2019-01-24 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9231: Description: TestDistributedShell runs all test cases in parallel. All test cases are reusing

[jira] [Commented] (YARN-9209) When nodePartition is not set in Placement Constraints, containers are allocated only in default partition

2019-01-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751998#comment-16751998 ] Weiwei Yang commented on YARN-9209: --- Hi [~tarunparimi] Thanks for the patch. But this seems to be an

[jira] [Commented] (YARN-9195) RM Queue's pending container number might get decreased unexpectedly or even become negative once RM failover

2019-01-24 Thread Shengyang Sha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16752008#comment-16752008 ] Shengyang Sha commented on YARN-9195: - [~leftnoteasy] I've been occupied by some urgent things

[jira] [Updated] (YARN-9060) [YARN-8851] Phase 1 - Support device isolation in native container-executor

2019-01-24 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-9060: --- Attachment: YARN-9060-trunk.010.patch > [YARN-8851] Phase 1 - Support device isolation in native

[jira] [Commented] (YARN-6616) YARN AHS shows submitTime for jobs same as startTime

2019-01-24 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751829#comment-16751829 ] Prabhu Joseph commented on YARN-6616: - Thanks [~eepayne] for the review. The submitTime is different

[jira] [Commented] (YARN-9086) [CSI] Run csi-driver-adaptor as aux service

2019-01-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751878#comment-16751878 ] Hadoop QA commented on YARN-9086: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9195) RM Queue's pending container number might get decreased unexpectedly or even become negative once RM failover

2019-01-24 Thread Shengyang Sha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shengyang Sha updated YARN-9195: Attachment: patch.YARN-9195.diff > RM Queue's pending container number might get decreased

[jira] [Commented] (YARN-9188) Port YARN-7136 to branch-2

2019-01-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751886#comment-16751886 ] Hadoop QA commented on YARN-9188: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9195) RM Queue's pending container number might get decreased unexpectedly or even become negative once RM failover

2019-01-24 Thread Shengyang Sha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shengyang Sha updated YARN-9195: Attachment: YARN-9195.001.patch > RM Queue's pending container number might get decreased

[jira] [Updated] (YARN-9086) [CSI] Run csi-driver-adaptor as aux service

2019-01-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9086: -- Attachment: YARN-9086.003.patch > [CSI] Run csi-driver-adaptor as aux service >

[jira] [Commented] (YARN-9195) RM Queue's pending container number might get decreased unexpectedly or even become negative once RM failover

2019-01-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751887#comment-16751887 ] Wangda Tan commented on YARN-9195: -- Thanks [~ssy],   Could u rename the patch to YARN-9175.001.patch?

[jira] [Commented] (YARN-7129) Application Catalog for YARN applications

2019-01-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751897#comment-16751897 ] Hadoop QA commented on YARN-7129: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5336) Limit the flow name size & consider cleanup for hex chars

2019-01-24 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751898#comment-16751898 ] Vrushali C commented on YARN-5336: -- Thanks Sushil! Patch 002 looks better but there is one place L206 in

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-24 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751938#comment-16751938 ] Zac Zhou commented on YARN-9161: There are some code conflicts with 

[jira] [Updated] (YARN-9231) TestDistributedShell fix timeout

2019-01-24 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9231: Summary: TestDistributedShell fix timeout (was: TestDistributedShell reuse hdfs and yarn cluster

[jira] [Reopened] (YARN-8193) YARN RM hangs abruptly (stops allocating resources) when running successive applications.

2019-01-24 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan reopened YARN-8193: -- reopening for backporting to branch-2 > YARN RM hangs abruptly (stops allocating resources) when

[jira] [Commented] (YARN-7088) Add application launch time to Resource Manager REST API

2019-01-24 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751737#comment-16751737 ] Jonathan Hung commented on YARN-7088: - Backported to branch-3.1/branch-3.0/branch-2/branch-2.9. Thanks

[jira] [Commented] (YARN-9222) Print launchTime in ApplicationSummary

2019-01-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751844#comment-16751844 ] Hadoop QA commented on YARN-9222: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9231) TestDistributedShell fix timeout

2019-01-24 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9231: Issue Type: Bug (was: Improvement) > TestDistributedShell fix timeout >

[jira] [Commented] (YARN-9227) DistributedShell RelativePath is not removed at end

2019-01-24 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751943#comment-16751943 ] Prabhu Joseph commented on YARN-9227: - Testcases timeout are due to an existing bug handled as part of

[jira] [Updated] (YARN-9231) TestDistributedShell fix timeout

2019-01-24 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9231: Description: TestDistributedShell test cases time out. (was: TestDistributedShell runs all test

[jira] [Commented] (YARN-9206) RMServerUtils does not count SHUTDOWN as an accepted state

2019-01-24 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16750881#comment-16750881 ] Sunil Govindan commented on YARN-9206: -- Thanks [~kshukla] This logic seems better as it can avoid

[jira] [Updated] (YARN-9227) DistributedShell RelativePath is not removed at end

2019-01-24 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9227: Attachment: 0001-YARN-9227.patch > DistributedShell RelativePath is not removed at end >

[jira] [Commented] (YARN-9225) user can submit applications even though they are not in the submit acl

2019-01-24 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16750958#comment-16750958 ] Sunil Govindan commented on YARN-9225: -- [~yangjiandan] As per me, current behavior of YARN is fine.

[jira] [Updated] (YARN-9216) The user and queue link address in the Timeline Server webapp are unknown

2019-01-24 Thread Sen Zhao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sen Zhao updated YARN-9216: --- Description: Precondition: 1. ResourceManager HA is enable; 2. ResourceManager and Timeline Server are not on

[jira] [Updated] (YARN-9216) The user and queue link address in the Timeline Server webapp are unknown

2019-01-24 Thread Sen Zhao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sen Zhao updated YARN-9216: --- Description: Precondition: 1. ResourceManager HA is enable; 2. ResourceManager and Timeline Server are not on

[jira] [Updated] (YARN-7761) [UI2] Clicking 'master container log' or 'Link' next to 'log' under application's appAttempt goes to Old UI's Log link

2019-01-24 Thread Akhil PB (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akhil PB updated YARN-7761: --- Attachment: YARN-7761.002.patch > [UI2] Clicking 'master container log' or 'Link' next to 'log' under >

[jira] [Commented] (YARN-7761) [UI2] Clicking 'master container log' or 'Link' next to 'log' under application's appAttempt goes to Old UI's Log link

2019-01-24 Thread Akhil PB (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16750922#comment-16750922 ] Akhil PB commented on YARN-7761: Attached v2 patch, which implements following: # Provides two links for

[jira] [Commented] (YARN-7761) [UI2] Clicking 'master container log' or 'Link' next to 'log' under application's appAttempt goes to Old UI's Log link

2019-01-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16750964#comment-16750964 ] Hadoop QA commented on YARN-7761: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-24 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16750882#comment-16750882 ] Sunil Govindan commented on YARN-9161: -- Thanks [~yuan_zac] For the first point,  # In

[jira] [Updated] (YARN-9086) [CSI] Run csi-driver-adaptor as aux service

2019-01-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9086: -- Attachment: YARN-9086.002.patch > [CSI] Run csi-driver-adaptor as aux service >

[jira] [Updated] (YARN-9116) Capacity Scheduler: implements queue level maximum-allocation inheritance

2019-01-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9116: -- Hadoop Flags: Reviewed Fix Version/s: 3.3.0 Release Note: After this change, capacity

[jira] [Created] (YARN-9232) YarnConfiguration#timelineServiceV1Enabled returns true for 1.5

2019-01-24 Thread Prabhu Joseph (JIRA)
Prabhu Joseph created YARN-9232: --- Summary: YarnConfiguration#timelineServiceV1Enabled returns true for 1.5 Key: YARN-9232 URL: https://issues.apache.org/jira/browse/YARN-9232 Project: Hadoop YARN

[jira] [Resolved] (YARN-9232) YarnConfiguration#timelineServiceV1Enabled returns true for 1.5

2019-01-24 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph resolved YARN-9232. - Resolution: Invalid > YarnConfiguration#timelineServiceV1Enabled returns true for 1.5 >

[jira] [Commented] (YARN-8961) [UI2] Flow Run End Time shows 'Invalid date'

2019-01-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16750950#comment-16750950 ] Hudson commented on YARN-8961: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15817 (See

[jira] [Commented] (YARN-9116) Capacity Scheduler: implements queue level maximum-allocation inheritance

2019-01-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16750956#comment-16750956 ] Hudson commented on YARN-9116: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #15818 (See

[jira] [Commented] (YARN-9116) Capacity Scheduler: implements queue level maximum-allocation inheritance

2019-01-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16750955#comment-16750955 ] Weiwei Yang commented on YARN-9116: --- Committed to trunk, thanks for the contribution [~aihuaxu], and

[jira] [Commented] (YARN-9060) [YARN-8851] Phase 1 - Support device isolation in native container-executor

2019-01-24 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751008#comment-16751008 ] Zhankun Tang commented on YARN-9060: [~cheersyang] , [~sunilg] , The patch consists below key things:

[jira] [Comment Edited] (YARN-9060) [YARN-8851] Phase 1 - Support device isolation in native container-executor

2019-01-24 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751008#comment-16751008 ] Zhankun Tang edited comment on YARN-9060 at 1/24/19 10:56 AM: -- [~cheersyang]

[jira] [Commented] (YARN-9086) [CSI] Run csi-driver-adaptor as aux service

2019-01-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751012#comment-16751012 ] Hadoop QA commented on YARN-9086: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9234) NPE Exception Occurred on Resourcemanager

2019-01-24 Thread Amithsha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751076#comment-16751076 ] Amithsha commented on YARN-9234: Added the stacktrace of the exceptions. Also no other error on RM log.

[jira] [Commented] (YARN-9234) NPE Exception Occurred on Resourcemanager

2019-01-24 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751089#comment-16751089 ] Sunil Govindan commented on YARN-9234: -- YARN-8193 should land on branch-2.9 to fix this issue.

[jira] [Created] (YARN-9233) RM may report allocated container which is killed (but not acquired by AM ) to AM which can cause spark AM confused

2019-01-24 Thread Bilwa S T (JIRA)
Bilwa S T created YARN-9233: --- Summary: RM may report allocated container which is killed (but not acquired by AM ) to AM which can cause spark AM confused Key: YARN-9233 URL:

[jira] [Commented] (YARN-9233) RM may report allocated container which is killed (but not acquired by AM ) to AM which can cause spark AM confused

2019-01-24 Thread Bilwa S T (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16750977#comment-16750977 ] Bilwa S T commented on YARN-9233: - cc [~bibinchundatt] [~cheersyang]  > RM may report allocated container

[jira] [Updated] (YARN-9060) [YARN-8851] Phase 1 - Support device isolation in native container-executor

2019-01-24 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-9060: --- Attachment: YARN-9060-trunk.009.patch > [YARN-8851] Phase 1 - Support device isolation in native

[jira] [Created] (YARN-9235) If linux container executor is not set for a GPU cluster GpuResourceHandlerImpl is not initialized and NPE is thrown

2019-01-24 Thread JIRA
Antal Bálint Steinbach created YARN-9235: Summary: If linux container executor is not set for a GPU cluster GpuResourceHandlerImpl is not initialized and NPE is thrown Key: YARN-9235 URL:

[jira] [Assigned] (YARN-9233) RM may report allocated container which is killed (but not acquired by AM ) to AM which can cause spark AM confused

2019-01-24 Thread Bilwa S T (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilwa S T reassigned YARN-9233: --- Assignee: Bilwa S T > RM may report allocated container which is killed (but not acquired by AM ) >

[jira] [Commented] (YARN-9227) DistributedShell RelativePath is not removed at end

2019-01-24 Thread Feng Yuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16750991#comment-16750991 ] Feng Yuan commented on YARN-9227: - Thank [~Prabhu Joseph] raise this issue, i can get reproduction. If

[jira] [Issue Comment Deleted] (YARN-9227) DistributedShell RelativePath is not removed at end

2019-01-24 Thread Feng Yuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feng Yuan updated YARN-9227: Comment: was deleted (was: Thank [~Prabhu Joseph] raise this issue, i can get reproduction. If should fix

[jira] [Commented] (YARN-8498) Yarn NodeManager OOM Listener Fails Compilation on Ubuntu 18.04

2019-01-24 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751004#comment-16751004 ] Sunil Govindan commented on YARN-8498: -- This should be fine.  Could we get this in? > Yarn

[jira] [Commented] (YARN-9227) DistributedShell RelativePath is not removed at end

2019-01-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751022#comment-16751022 ] Hadoop QA commented on YARN-9227: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-9234) NPE Exception Occurred on Resourcemanager

2019-01-24 Thread Amithsha (JIRA)
Amithsha created YARN-9234: -- Summary: NPE Exception Occurred on Resourcemanager Key: YARN-9234 URL: https://issues.apache.org/jira/browse/YARN-9234 Project: Hadoop YARN Issue Type: New Feature

[jira] [Commented] (YARN-9098) Separate mtab file reader code and cgroups file system hierarchy parser code from CGroupsHandlerImpl and ResourceHandlerModule

2019-01-24 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751123#comment-16751123 ] Peter Bacsko commented on YARN-9098: Minor things: 1. Delete the {{tmpDir}} in {{testSelectCgroup}}

  1   2   >