[jira] [Commented] (YARN-8011) TestOpportunisticContainerAllocatorAMService#testContainerPromoteAndDemoteBeforeContainerStart fails sometimes in trunk

2018-03-07 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390857#comment-16390857 ] Tao Yang commented on YARN-8011: Thanks Weiwei Yang for your suggestions. Yes, we can fix this problem in

[jira] [Updated] (YARN-8011) TestOpportunisticContainerAllocatorAMService#testContainerPromoteAndDemoteBeforeContainerStart fails sometimes in trunk

2018-03-07 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8011: --- Attachment: YARN-8011.002.patch >

[jira] [Commented] (YARN-8002) Support NOT_SELF and ALL namespace types for allocation tag

2018-03-07 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390843#comment-16390843 ] Weiwei Yang commented on YARN-8002: --- Hi [~asuresh], [~leftnoteasy], [~kkaranasos], any chance to help to

[jira] [Updated] (YARN-8012) Support Unmanaged Container Cleanup

2018-03-07 Thread Yuqi Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuqi Wang updated YARN-8012: Description: An *unmanaged container / leaked container* is a container which is no longer managed by NM.

[jira] [Updated] (YARN-8012) Support Unmanaged Container Cleanup

2018-03-07 Thread Yuqi Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuqi Wang updated YARN-8012: Description: An *unmanaged container / leaked container* is a container which is no longer managed by NM.

[jira] [Updated] (YARN-8012) Support Unmanaged Container Cleanup

2018-03-07 Thread Yuqi Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuqi Wang updated YARN-8012: Description: An *unmanaged container / leaked container* is a container which is no longer managed by NM.

[jira] [Comment Edited] (YARN-8012) Support Unmanaged Container Cleanup

2018-03-07 Thread Yuqi Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390782#comment-16390782 ] Yuqi Wang edited comment on YARN-8012 at 3/8/18 6:14 AM: - *Initial patch for

[jira] [Comment Edited] (YARN-8012) Support Unmanaged Container Cleanup

2018-03-07 Thread Yuqi Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390782#comment-16390782 ] Yuqi Wang edited comment on YARN-8012 at 3/8/18 6:13 AM: - *Initial patch for

[jira] [Commented] (YARN-8011) TestOpportunisticContainerAllocatorAMService#testContainerPromoteAndDemoteBeforeContainerStart fails sometimes in trunk

2018-03-07 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390796#comment-16390796 ] Weiwei Yang commented on YARN-8011: --- Hi [~Tao Yang] Thanks for the patch, just one comment. Can we

[jira] [Updated] (YARN-8012) Support Unmanaged Container Cleanup

2018-03-07 Thread Yuqi Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuqi Wang updated YARN-8012: Description: An *unmanaged container / leaked container* is a container which is no longer managed by NM.

[jira] [Updated] (YARN-8012) Support Unmanaged Container Cleanup

2018-03-07 Thread Yuqi Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuqi Wang updated YARN-8012: Description: An *unmanaged container / leaked container* is a container which is no longer managed by NM.

[jira] [Commented] (YARN-5028) RMStateStore should trim down app state for completed applications

2018-03-07 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390792#comment-16390792 ] Yufei Gu commented on YARN-5028: It is a nice-to-have one. Trunk is good enough. Thanks [~leftnoteasy]. >

[jira] [Updated] (YARN-8012) Support Unmanaged Container Cleanup

2018-03-07 Thread Yuqi Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuqi Wang updated YARN-8012: Description: An *unmanaged container* is a container which is no longer managed by NM. Thus, it is cannot

[jira] [Updated] (YARN-8012) Support Unmanaged Container Cleanup

2018-03-07 Thread Yuqi Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuqi Wang updated YARN-8012: Attachment: YARN-8012-branch-2.7.1.001.patch > Support Unmanaged Container Cleanup >

[jira] [Created] (YARN-8012) Support Unmanaged Container Cleanup

2018-03-07 Thread Yuqi Wang (JIRA)
Yuqi Wang created YARN-8012: --- Summary: Support Unmanaged Container Cleanup Key: YARN-8012 URL: https://issues.apache.org/jira/browse/YARN-8012 Project: Hadoop YARN Issue Type: New Feature

[jira] [Updated] (YARN-7872) labeled node cannot be used to satisfy locality specified request

2018-03-07 Thread Yuqi Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuqi Wang updated YARN-7872: Target Version/s: 3.0.0, 2.7.2 (was: 2.7.2) > labeled node cannot be used to satisfy locality specified

[jira] [Updated] (YARN-8010) add config in FederationRMFailoverProxy to not bypass facade cache when failing over

2018-03-07 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8010: --- Attachment: YARN-8010.v1.patch > add config in FederationRMFailoverProxy to not bypass facade cache

[jira] [Updated] (YARN-8010) add config in FederationRMFailoverProxy to not bypass facade cache when failing over

2018-03-07 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8010: --- Issue Type: Sub-task (was: Task) Parent: YARN-5597 > add config in FederationRMFailoverProxy

[jira] [Commented] (YARN-8011) TestOpportunisticContainerAllocatorAMService#testContainerPromoteAndDemoteBeforeContainerStart fails sometimes in trunk

2018-03-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390762#comment-16390762 ] genericqa commented on YARN-8011: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8006) Make Hbase-2 profile as default for YARN-7055 branch

2018-03-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390756#comment-16390756 ] genericqa commented on YARN-8006: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5015) Support sliding window retry capability for container restart

2018-03-07 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390735#comment-16390735 ] Chandni Singh commented on YARN-5015: - @[~leftnoteasy] You are correct that this logic is only needed

[jira] [Updated] (YARN-7944) Remove master node link from headers of application pages

2018-03-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7944: - Fix Version/s: (was: 3.1.0) > Remove master node link from headers of application pages >

[jira] [Commented] (YARN-7944) Remove master node link from headers of application pages

2018-03-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390710#comment-16390710 ] Wangda Tan commented on YARN-7944: -- And [~yeshavora], just removed fix version, it should be only set by

[jira] [Commented] (YARN-7944) Remove master node link from headers of application pages

2018-03-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390709#comment-16390709 ] Wangda Tan commented on YARN-7944: -- [~sunilg], did you commit this one? I saw this is still in PA state

[jira] [Commented] (YARN-5028) RMStateStore should trim down app state for completed applications

2018-03-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390707#comment-16390707 ] Wangda Tan commented on YARN-5028: -- [~yufeigu], since this isn't committed to branch-3.1, just set fix

[jira] [Updated] (YARN-5028) RMStateStore should trim down app state for completed applications

2018-03-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-5028: - Target Version/s: (was: 3.1.0) > RMStateStore should trim down app state for completed applications >

[jira] [Updated] (YARN-5028) RMStateStore should trim down app state for completed applications

2018-03-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-5028: - Fix Version/s: (was: 3.1.0) 3.2.0 > RMStateStore should trim down app state for

[jira] [Commented] (YARN-7952) RM should be able to recover log aggregation status after restart/fail-over

2018-03-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390685#comment-16390685 ] genericqa commented on YARN-7952: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8011) TestOpportunisticContainerAllocatorAMService#testContainerPromoteAndDemoteBeforeContainerStart fails sometimes in trunk

2018-03-07 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8011: --- Attachment: YARN-8011.001.patch >

[jira] [Updated] (YARN-8011) TestOpportunisticContainerAllocatorAMService#testContainerPromoteAndDemoteBeforeContainerStart fails sometimes in trunk

2018-03-07 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8011: --- Description: TestOpportunisticContainerAllocatorAMService#testContainerPromoteAndDemoteBeforeContainerStart

[jira] [Created] (YARN-8011) TestOpportunisticContainerAllocatorAMService#testContainerPromoteAndDemoteBeforeContainerStart fails sometimes in trunk

2018-03-07 Thread Tao Yang (JIRA)
Tao Yang created YARN-8011: -- Summary: TestOpportunisticContainerAllocatorAMService#testContainerPromoteAndDemoteBeforeContainerStart fails sometimes in trunk Key: YARN-8011 URL:

[jira] [Commented] (YARN-7952) RM should be able to recover log aggregation status after restart/fail-over

2018-03-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390650#comment-16390650 ] Wangda Tan commented on YARN-7952: -- Thanks [~xgong] for update, mostly looks good, few nits: 1)

[jira] [Commented] (YARN-7999) Docker launch fails when user private filecache directory is missing

2018-03-07 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390634#comment-16390634 ] Eric Yang commented on YARN-7999: - +1 This patch helps to pass the error message, but docker container

[jira] [Commented] (YARN-5015) Support sliding window retry capability for container restart

2018-03-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390626#comment-16390626 ] Wangda Tan commented on YARN-5015: -- [~csingh], could you explain a bit about how this logic will be shared

[jira] [Commented] (YARN-5764) NUMA awareness support for launching containers

2018-03-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390534#comment-16390534 ] genericqa commented on YARN-5764: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-8010) add config in FederationRMFailoverProxy to not bypass facade cache when failing over

2018-03-07 Thread Botong Huang (JIRA)
Botong Huang created YARN-8010: -- Summary: add config in FederationRMFailoverProxy to not bypass facade cache when failing over Key: YARN-8010 URL: https://issues.apache.org/jira/browse/YARN-8010

[jira] [Commented] (YARN-7952) RM should be able to recover log aggregation status after restart/fail-over

2018-03-07 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390501#comment-16390501 ] Xuan Gong commented on YARN-7952: - rebase the patch, and kill off the jenkins > RM should be able to

[jira] [Updated] (YARN-7952) RM should be able to recover log aggregation status after restart/fail-over

2018-03-07 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-7952: Attachment: YARN-7952.5.patch > RM should be able to recover log aggregation status after restart/fail-over

[jira] [Comment Edited] (YARN-5015) Support sliding window retry capability for container restart

2018-03-07 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390490#comment-16390490 ] Chandni Singh edited comment on YARN-5015 at 3/8/18 12:17 AM: --  [~leftnoteasy]

[jira] [Commented] (YARN-5015) Support sliding window retry capability for container restart

2018-03-07 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390490#comment-16390490 ] Chandni Singh commented on YARN-5015: -  [~leftnoteasy] Please find my answers below to some of the

[jira] [Commented] (YARN-7891) LogAggregationIndexedFileController should support read from HAR file

2018-03-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390476#comment-16390476 ] Hudson commented on YARN-7891: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13793 (See

[jira] [Commented] (YARN-7891) LogAggregationIndexedFileController should support read from HAR file

2018-03-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390457#comment-16390457 ] Wangda Tan commented on YARN-7891: -- oops, I committed a wrong patch, just reverted from trunk and pushed a

[jira] [Updated] (YARN-7952) RM should be able to recover log aggregation status after restart/fail-over

2018-03-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7952: - Attachment: (was: YARN-7952.4.patch) > RM should be able to recover log aggregation status after

[jira] [Updated] (YARN-7952) RM should be able to recover log aggregation status after restart/fail-over

2018-03-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7952: - Attachment: (was: YARN-7952.4.patch) > RM should be able to recover log aggregation status after

[jira] [Updated] (YARN-7952) RM should be able to recover log aggregation status after restart/fail-over

2018-03-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7952: - Attachment: YARN-7952.4.patch > RM should be able to recover log aggregation status after

[jira] [Commented] (YARN-5015) Support sliding window retry capability for container restart

2018-03-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390428#comment-16390428 ] Wangda Tan commented on YARN-5015: -- Thanks [~csingh], see my comments below: 1) Instead of adding

[jira] [Updated] (YARN-5764) NUMA awareness support for launching containers

2018-03-07 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj K updated YARN-5764: Attachment: YARN-5764-v8.patch > NUMA awareness support for launching containers >

[jira] [Commented] (YARN-7952) RM should be able to recover log aggregation status after restart/fail-over

2018-03-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390353#comment-16390353 ] genericqa commented on YARN-7952: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7952) RM should be able to recover log aggregation status after restart/fail-over

2018-03-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7952: - Attachment: YARN-7952.4.patch > RM should be able to recover log aggregation status after

[jira] [Commented] (YARN-7952) RM should be able to recover log aggregation status after restart/fail-over

2018-03-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390237#comment-16390237 ] Wangda Tan commented on YARN-7952: -- Thanks [~xgong], I just updated title/description based on your

[jira] [Updated] (YARN-7952) RM should be able to recover log aggregation status after restart/fail-over

2018-03-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7952: - Summary: RM should be able to recover log aggregation status after restart/fail-over (was: Find a way to

[jira] [Commented] (YARN-7952) Find a way to persist the log aggregation status

2018-03-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390233#comment-16390233 ] genericqa commented on YARN-7952: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7952) RM should be able to recover log aggregation status after restart/fail-over

2018-03-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7952: - Description: Right now, the NM would send its own log aggregation status to RM periodically to RM. And RM

[jira] [Updated] (YARN-5015) Support sliding window retry capability for container restart

2018-03-07 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-5015: Description: We support sliding window retry policy for AM restarts (Introduced in YARN-611).

[jira] [Updated] (YARN-5015) Support sliding window retry capability for container restart

2018-03-07 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-5015: Description: We support sliding window retry policy for AM restarts (Refer to YARN-3669). Similar

[jira] [Commented] (YARN-7626) Allow regular expression matching in container-executor.cfg for devices and named docker volumes mount

2018-03-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390123#comment-16390123 ] Hudson commented on YARN-7626: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13789 (See

[jira] [Commented] (YARN-7891) LogAggregationIndexedFileController should support read from HAR file

2018-03-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390122#comment-16390122 ] Hudson commented on YARN-7891: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13789 (See

[jira] [Commented] (YARN-8009) YARN limit number of simultaneously running containers in the application level

2018-03-07 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390116#comment-16390116 ] Miklos Szegedi commented on YARN-8009: -- Thank you for raising this [~sachinjose2...@gmail.com].

[jira] [Commented] (YARN-5015) Support sliding window retry capability for container restart

2018-03-07 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390106#comment-16390106 ] Chandni Singh commented on YARN-5015: - [~leftnoteasy] I have updated the description. I have followed

[jira] [Commented] (YARN-7626) Allow regular expression matching in container-executor.cfg for devices and named docker volumes mount

2018-03-07 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390095#comment-16390095 ] Miklos Szegedi commented on YARN-7626: -- Thank you for the contribution [~Zian Chen] and for the commit

[jira] [Updated] (YARN-5015) Support sliding window retry capability for container restart

2018-03-07 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-5015: Description: We support sliding window retry policy for AM restarts. Similar sliding window  retry

[jira] [Updated] (YARN-5015) Support sliding window retry capability for container restart

2018-03-07 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-5015: Description: We support sliding window retry policy for AM restart. Similar sliding window  retry

[jira] [Updated] (YARN-5015) Support sliding window retry capability for container restart

2018-03-07 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-5015: Description: We support sliding window retry policy for AM restart. Similar sliding window  retry

[jira] [Updated] (YARN-5015) Support sliding window retry capability for container restart

2018-03-07 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-5015: Description: We support sliding window retry policy for AM restart. Similar sliding window retry

[jira] [Updated] (YARN-5015) Support sliding window retry capability for container restart

2018-03-07 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-5015: Summary: Support sliding window retry capability for container restart (was: Unify restart

[jira] [Comment Edited] (YARN-7626) Allow regular expression matching in container-executor.cfg for devices and named docker volumes mount

2018-03-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390081#comment-16390081 ] Wangda Tan edited comment on YARN-7626 at 3/7/18 7:32 PM: -- Committed to trunk,

[jira] [Commented] (YARN-5015) Unify restart policies across AM and container restarts

2018-03-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390068#comment-16390068 ] Wangda Tan commented on YARN-5015: -- [~csingh], could you please elaborate approach and scope of this patch

[jira] [Created] (YARN-8009) YARN limit number of simultaneously running containers in the application level

2018-03-07 Thread Sachin Jose (JIRA)
Sachin Jose created YARN-8009: - Summary: YARN limit number of simultaneously running containers in the application level Key: YARN-8009 URL: https://issues.apache.org/jira/browse/YARN-8009 Project:

[jira] [Updated] (YARN-7891) LogAggregationIndexedFileController should support read from HAR file

2018-03-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7891: - Summary: LogAggregationIndexedFileController should support read from HAR file (was:

[jira] [Comment Edited] (YARN-7654) Support ENTRY_POINT for docker container

2018-03-07 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389883#comment-16389883 ] Eric Yang edited comment on YARN-7654 at 3/7/18 6:01 PM: - Hi [~ebadger]

[jira] [Commented] (YARN-7654) Support ENTRY_POINT for docker container

2018-03-07 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389883#comment-16389883 ] Eric Yang commented on YARN-7654: - Hi [~ebadger] [~billie.rinaldi] [~shaneku...@gmail.com] Here is an early

[jira] [Commented] (YARN-8001) Newly created Yarn application ID lost after RM failover

2018-03-07 Thread shanyu zhao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389881#comment-16389881 ] shanyu zhao commented on YARN-8001: --- The failure is a pig job. After a client submitted an application

[jira] [Updated] (YARN-7654) Support ENTRY_POINT for docker container

2018-03-07 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7654: Attachment: YARN-7654.001.patch > Support ENTRY_POINT for docker container >

[jira] [Commented] (YARN-7968) Reset the queue name in submission context while recovering an application

2018-03-07 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389794#comment-16389794 ] Wilfred Spiegelenburg commented on YARN-7968: - During recovery we only have the queue name in

[jira] [Resolved] (YARN-1495) Allow moving apps between queues

2018-03-07 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YARN-1495. - Resolution: Fixed Closing as last open jira YARN-1558 was done in 2.9 as part of

[jira] [Resolved] (YARN-1558) After apps are moved across queues, store new queue info in the RM state store

2018-03-07 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YARN-1558. - Resolution: Duplicate Closing as YARN-5932 is in 2.9 and later > After apps are

[jira] [Commented] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

2018-03-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389707#comment-16389707 ] Hudson commented on YARN-7677: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13786 (See

[jira] [Commented] (YARN-7998) RM crashes with NPE during recovering if ACL configuration was changed

2018-03-07 Thread Oleksandr Shevchenko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389655#comment-16389655 ] Oleksandr Shevchenko commented on YARN-7998: The failed tests are not related to the patch. I

[jira] [Commented] (YARN-4781) Support intra-queue preemption for fairness ordering policy.

2018-03-07 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389649#comment-16389649 ] Eric Payne commented on YARN-4781: -- Thanks a lot for the review [~sunilg]. {quote} my concern is over case

[jira] [Commented] (YARN-6136) YARN registry service should avoid scanning whole ZK tree for every container/application finish

2018-03-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389632#comment-16389632 ] Steve Loughran commented on YARN-6136: -- It's just trying to do a cleanup at the end, no matter how

[jira] [Commented] (YARN-7996) Allow user supplied Docker client configurations with YARN native services

2018-03-07 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389603#comment-16389603 ] Shane Kumpf commented on YARN-7996: --- I believe this is ready for review, [~billie.rinaldi] [~gsaha] >

[jira] [Commented] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

2018-03-07 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389562#comment-16389562 ] Shane Kumpf commented on YARN-7677: --- +1 (non-binding) from me as well. I ran my usual suite of tests with

[jira] [Comment Edited] (YARN-8007) Support specifying placement constraint for task containers in SLS

2018-03-07 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389557#comment-16389557 ] Weiwei Yang edited comment on YARN-8007 at 3/7/18 1:37 PM: --- Hi [~yangjiandan]

[jira] [Commented] (YARN-8007) Support specifying placement constraint for task containers in SLS

2018-03-07 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389557#comment-16389557 ] Weiwei Yang commented on YARN-8007: --- Hi [~yangjiandan] Thanks for initiating this, it makes a lot of

[jira] [Commented] (YARN-7905) Parent directory permission incorrect during public localization

2018-03-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389535#comment-16389535 ] genericqa commented on YARN-7905: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-7905) Parent directory permission incorrect during public localization

2018-03-07 Thread Bilwa S T (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389508#comment-16389508 ] Bilwa S T edited comment on YARN-7905 at 3/7/18 12:56 PM: -- [~bibinchundatt]  i 

[jira] [Commented] (YARN-7905) Parent directory permission incorrect during public localization

2018-03-07 Thread Bilwa S T (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389508#comment-16389508 ] Bilwa S T commented on YARN-7905: - [~bibinchundatt]  i have taken care of above comments given . Please

[jira] [Updated] (YARN-7905) Parent directory permission incorrect during public localization

2018-03-07 Thread Bilwa S T (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilwa S T updated YARN-7905: Attachment: YARN-7905-003.patch > Parent directory permission incorrect during public localization >

[jira] [Updated] (YARN-7905) Parent directory permission incorrect during public localization

2018-03-07 Thread Bilwa S T (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilwa S T updated YARN-7905: Attachment: (was: YARN-7905-003.patch) > Parent directory permission incorrect during public

[jira] [Commented] (YARN-7905) Parent directory permission incorrect during public localization

2018-03-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389495#comment-16389495 ] genericqa commented on YARN-7905: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7905) Parent directory permission incorrect during public localization

2018-03-07 Thread Bilwa S T (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilwa S T updated YARN-7905: Attachment: YARN-7905-003.patch > Parent directory permission incorrect during public localization >

[jira] [Commented] (YARN-8007) Support specifying placement constraint for task containers in SLS

2018-03-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389451#comment-16389451 ] genericqa commented on YARN-8007: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-8008) Admin command to manage global placement constraints

2018-03-07 Thread Weiwei Yang (JIRA)
Weiwei Yang created YARN-8008: - Summary: Admin command to manage global placement constraints Key: YARN-8008 URL: https://issues.apache.org/jira/browse/YARN-8008 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-8007) Support specifying placement constraint for task containers in SLS

2018-03-07 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-8007: Attachment: YARN-8007.001.patch > Support specifying placement constraint for task containers in SLS

[jira] [Commented] (YARN-8006) Make Hbase-2 profile as default for YARN-7055 branch

2018-03-07 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389361#comment-16389361 ] Rohith Sharma K S commented on YARN-8006: - [~haibochen] could you review patch? It appears like

[jira] [Commented] (YARN-8006) Make Hbase-2 profile as default for YARN-7055 branch

2018-03-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389348#comment-16389348 ] genericqa commented on YARN-8006: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7975) Add an optional arg to yarn cluster -list-node-labels to list nodes collection partitioned by labels

2018-03-07 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389327#comment-16389327 ] Sunil G commented on YARN-7975: --- [~shenyinjie], could u pls write some UT cases to verify the case which you

[jira] [Commented] (YARN-8000) Yarn Service: component instance name shows up as component name in container record

2018-03-07 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389324#comment-16389324 ] Sunil G commented on YARN-8000: --- Yes. As mentioned by [~gsaha], if the data is published to ATS correct, UI

[jira] [Commented] (YARN-2442) ResourceManager JMX UI does not give HA State

2018-03-07 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389322#comment-16389322 ] Bibin A Chundatt commented on YARN-2442: Thank you [~rohithsharma] for quick patch Over all patch

[jira] [Commented] (YARN-4781) Support intra-queue preemption for fairness ordering policy.

2018-03-07 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389289#comment-16389289 ] Sunil G commented on YARN-4781: --- Thanks [~eepayne] for bringing this thread alive.. bq.Then, while all 4

  1   2   >