[jira] [Commented] (YARN-6467) CSQueueMetrics needs to update the current metrics for default partition only

[ https://issues.apache.org/jira/browse/YARN-6467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16057021#comment-16057021 ] Manikandan R commented on YARN-6467: Rectified patch and attached the same. > CSQueueMetrics needs to

[jira] [Updated] (YARN-6467) CSQueueMetrics needs to update the current metrics for default partition only

[ https://issues.apache.org/jira/browse/YARN-6467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R updated YARN-6467: --- Attachment: YARN-6467-branch-2.008.patch > CSQueueMetrics needs to update the current metrics for

[jira] [Updated] (YARN-6725) NodeManager cannot localize files when URL contains opaque authority

[ https://issues.apache.org/jira/browse/YARN-6725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Angus Davis updated YARN-6725: -- Attachment: YARN-6725.001.patch > NodeManager cannot localize files when URL contains opaque authority >

[jira] [Updated] (YARN-6725) NodeManager cannot localize files when URL contains opaque authority

[ https://issues.apache.org/jira/browse/YARN-6725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Angus Davis updated YARN-6725: -- Attachment: (was: YARN-6721.001.patch) > NodeManager cannot localize files when URL contains opaque

[jira] [Updated] (YARN-6725) NodeManager cannot localize files when URL contains opaque authority

[ https://issues.apache.org/jira/browse/YARN-6725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Angus Davis updated YARN-6725: -- Attachment: YARN-6721.001.patch First pass at adding authority to YARN URL pb. > NodeManager cannot

[jira] [Created] (YARN-6725) NodeManager cannot localize files when URL contains opaque authority

Angus Davis created YARN-6725: - Summary: NodeManager cannot localize files when URL contains opaque authority Key: YARN-6725 URL: https://issues.apache.org/jira/browse/YARN-6725 Project: Hadoop YARN

[jira] [Commented] (YARN-2919) Potential race between renew and cancel in DelegationTokenRenwer

[ https://issues.apache.org/jira/browse/YARN-2919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056749#comment-16056749 ] Naganarasimha G R commented on YARN-2919: - Testcases failures (except

[jira] [Commented] (YARN-6668) Use cgroup to get container resource utilization

[ https://issues.apache.org/jira/browse/YARN-6668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056730#comment-16056730 ] ASF GitHub Bot commented on YARN-6668: -- Github user haibchen commented on a diff in the pull request:

[jira] [Commented] (YARN-1558) After apps are moved across queues, store new queue info in the RM state store

[ https://issues.apache.org/jira/browse/YARN-1558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056731#comment-16056731 ] Wilfred Spiegelenburg commented on YARN-1558: - This issue is fixed as part of YARN-5932 in

[jira] [Commented] (YARN-6716) Native services support for specifying component start order

[ https://issues.apache.org/jira/browse/YARN-6716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056722#comment-16056722 ] Jian He commented on YARN-6716: --- looks good overall, minor comments - what's the difference between {code}

[jira] [Comment Edited] (YARN-6710) There is a heavy bug in FSLeafQueue#amResourceUsage which will let the fair scheduler not assign container to the queue

[ https://issues.apache.org/jira/browse/YARN-6710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056662#comment-16056662 ] Yufei Gu edited comment on YARN-6710 at 6/20/17 11:25 PM: -- Thanks [~daemon] for

[jira] [Commented] (YARN-6710) There is a heavy bug in FSLeafQueue#amResourceUsage which will let the fair scheduler not assign container to the queue

[ https://issues.apache.org/jira/browse/YARN-6710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056662#comment-16056662 ] Yufei Gu commented on YARN-6710: Thanks [~daemon] for the detailed information. Basically you are saying

[jira] [Commented] (YARN-6668) Use cgroup to get container resource utilization

[ https://issues.apache.org/jira/browse/YARN-6668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056659#comment-16056659 ] ASF GitHub Bot commented on YARN-6668: -- Github user haibchen commented on a diff in the pull request:

[jira] [Commented] (YARN-6668) Use cgroup to get container resource utilization

[ https://issues.apache.org/jira/browse/YARN-6668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056657#comment-16056657 ] ASF GitHub Bot commented on YARN-6668: -- Github user haibchen commented on a diff in the pull request:

[jira] [Commented] (YARN-6668) Use cgroup to get container resource utilization

[ https://issues.apache.org/jira/browse/YARN-6668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056658#comment-16056658 ] ASF GitHub Bot commented on YARN-6668: -- Github user haibchen commented on a diff in the pull request:

[jira] [Commented] (YARN-6668) Use cgroup to get container resource utilization

[ https://issues.apache.org/jira/browse/YARN-6668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056656#comment-16056656 ] ASF GitHub Bot commented on YARN-6668: -- Github user haibchen commented on a diff in the pull request:

[jira] [Commented] (YARN-6127) Add support for work preserving NM restart when AMRMProxy is enabled

[ https://issues.apache.org/jira/browse/YARN-6127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056648#comment-16056648 ] Arun Suresh commented on YARN-6127: --- Based on our offline discussions, I think I am OK with pushing the

[jira] [Comment Edited] (YARN-6355) Preprocessor framework for AM and Client interactions with the RM

[ https://issues.apache.org/jira/browse/YARN-6355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056622#comment-16056622 ] Arun Suresh edited comment on YARN-6355 at 6/20/17 11:06 PM: - Thanks for the

[jira] [Updated] (YARN-6355) Preprocessor framework for AM and Client interactions with the RM

[ https://issues.apache.org/jira/browse/YARN-6355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6355: -- Attachment: YARN-6355-one-pager.pdf Attaching a one pager design doc. > Preprocessor framework for AM

[jira] [Commented] (YARN-6673) Add cpu cgroup configurations for opportunistic containers

[ https://issues.apache.org/jira/browse/YARN-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056614#comment-16056614 ] ASF GitHub Bot commented on YARN-6673: -- Github user haibchen commented on a diff in the pull request:

[jira] [Commented] (YARN-6673) Add cpu cgroup configurations for opportunistic containers

[ https://issues.apache.org/jira/browse/YARN-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056526#comment-16056526 ] ASF GitHub Bot commented on YARN-6673: -- Github user szegedim commented on a diff in the pull request:

[jira] [Commented] (YARN-2919) Potential race between renew and cancel in DelegationTokenRenwer

[ https://issues.apache.org/jira/browse/YARN-2919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056482#comment-16056482 ] Hadoop QA commented on YARN-2919: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6673) Add cpu cgroup configurations for opportunistic containers

[ https://issues.apache.org/jira/browse/YARN-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056467#comment-16056467 ] ASF GitHub Bot commented on YARN-6673: -- Github user haibchen commented on a diff in the pull request:

[jira] [Commented] (YARN-6673) Add cpu cgroup configurations for opportunistic containers

[ https://issues.apache.org/jira/browse/YARN-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056420#comment-16056420 ] ASF GitHub Bot commented on YARN-6673: -- Github user szegedim commented on a diff in the pull request:

[jira] [Commented] (YARN-6655) We should validate yarn native services application submission side to ensure that the hostname should be less than 63 characters

[ https://issues.apache.org/jira/browse/YARN-6655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056406#comment-16056406 ] Jian He commented on YARN-6655: --- lgtm, committing > We should validate yarn native services application

[jira] [Created] (YARN-6724) Add ability to blacklist sub-clusters when invoking Routing policies

Subru Krishnan created YARN-6724: Summary: Add ability to blacklist sub-clusters when invoking Routing policies Key: YARN-6724 URL: https://issues.apache.org/jira/browse/YARN-6724 Project: Hadoop

[jira] [Commented] (YARN-6655) We should validate yarn native services application submission side to ensure that the hostname should be less than 63 characters

[ https://issues.apache.org/jira/browse/YARN-6655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056302#comment-16056302 ] Hadoop QA commented on YARN-6655: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6467) CSQueueMetrics needs to update the current metrics for default partition only

[ https://issues.apache.org/jira/browse/YARN-6467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056264#comment-16056264 ] Naganarasimha G R commented on YARN-6467: - [~maniraj...@gmail.com], can you please check the patch

[jira] [Commented] (YARN-6047) Documentation updates for TimelineService v2

[ https://issues.apache.org/jira/browse/YARN-6047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056261#comment-16056261 ] Haibo Chen commented on YARN-6047: -- I think we should explicitly call out the data loss issue when HBase

[jira] [Comment Edited] (YARN-2919) Potential race between renew and cancel in DelegationTokenRenwer

[ https://issues.apache.org/jira/browse/YARN-2919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056258#comment-16056258 ] Naganarasimha G R edited comment on YARN-2919 at 6/20/17 6:38 PM: -- Sorry

[jira] [Updated] (YARN-2919) Potential race between renew and cancel in DelegationTokenRenwer

[ https://issues.apache.org/jira/browse/YARN-2919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-2919: Attachment: YARN-2919.002.patch Sorry [~djp] for the really long delay for the simple fix.

[jira] [Commented] (YARN-6674) Add memory cgroup settings for opportunistic containers

[ https://issues.apache.org/jira/browse/YARN-6674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056212#comment-16056212 ] ASF GitHub Bot commented on YARN-6674: -- Github user haibchen commented on a diff in the pull request:

[jira] [Commented] (YARN-6674) Add memory cgroup settings for opportunistic containers

[ https://issues.apache.org/jira/browse/YARN-6674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056213#comment-16056213 ] ASF GitHub Bot commented on YARN-6674: -- Github user haibchen commented on a diff in the pull request:

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056189#comment-16056189 ] Hadoop QA commented on YARN-2113: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6127) Add support for work preserving NM restart when AMRMProxy is enabled

[ https://issues.apache.org/jira/browse/YARN-6127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056153#comment-16056153 ] Arun Suresh commented on YARN-6127: --- Thanks for the patch [~botong] Couple of comments: * It looks like

[jira] [Commented] (YARN-6714) RM crashed with IllegalStateException while handling APP_ATTEMPT_REMOVED event when async-scheduling enabled in CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-6714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056116#comment-16056116 ] Wangda Tan commented on YARN-6714: -- bq. Can I move these test cases to

[jira] [Commented] (YARN-6678) Committer thread crashes with IllegalStateException in async-scheduling mode of CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-6678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056108#comment-16056108 ] Wangda Tan commented on YARN-6678: -- bq. It's necessary to add new method if spy on app attempt. I'll try

[jira] [Commented] (YARN-6673) Add cpu cgroup configurations for opportunistic containers

[ https://issues.apache.org/jira/browse/YARN-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056093#comment-16056093 ] ASF GitHub Bot commented on YARN-6673: -- Github user haibchen commented on a diff in the pull request:

[jira] [Commented] (YARN-6673) Add cpu cgroup configurations for opportunistic containers

[ https://issues.apache.org/jira/browse/YARN-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056096#comment-16056096 ] ASF GitHub Bot commented on YARN-6673: -- Github user haibchen commented on a diff in the pull request:

[jira] [Commented] (YARN-6673) Add cpu cgroup configurations for opportunistic containers

[ https://issues.apache.org/jira/browse/YARN-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056095#comment-16056095 ] ASF GitHub Bot commented on YARN-6673: -- Github user haibchen commented on a diff in the pull request:

[jira] [Commented] (YARN-6673) Add cpu cgroup configurations for opportunistic containers

[ https://issues.apache.org/jira/browse/YARN-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056094#comment-16056094 ] ASF GitHub Bot commented on YARN-6673: -- Github user haibchen commented on a diff in the pull request:

[jira] [Updated] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-2113: - Attachment: YARN-2113.branch-2.0019.patch Hi [~sunilg] and [~leftnoteasy]. I am also attaching the

[jira] [Commented] (YARN-6315) Improve LocalResourcesTrackerImpl#isResourcePresent to return false for corrupted files

[ https://issues.apache.org/jira/browse/YARN-6315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055849#comment-16055849 ] Kuhu Shukla commented on YARN-6315: --- Adding an 'actualSize' for LocalizedResource and then checking it

[jira] [Commented] (YARN-6713) Fix dead link in the Javadoc of FairSchedulerEventLog.java

[ https://issues.apache.org/jira/browse/YARN-6713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055570#comment-16055570 ] Hudson commented on YARN-6713: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11892 (See

[jira] [Commented] (YARN-6713) Fix dead link in the Javadoc of FairSchedulerEventLog.java

[ https://issues.apache.org/jira/browse/YARN-6713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055515#comment-16055515 ] Weiwei Yang commented on YARN-6713: --- Thanks [~ajisakaa]! > Fix dead link in the Javadoc of

[jira] [Comment Edited] (YARN-6714) RM crashed with IllegalStateException while handling APP_ATTEMPT_REMOVED event when async-scheduling enabled in CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-6714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055413#comment-16055413 ] Tao Yang edited comment on YARN-6714 at 6/20/17 9:47 AM: - Thanks [~leftnoteasy] for

[jira] [Comment Edited] (YARN-6714) RM crashed with IllegalStateException while handling APP_ATTEMPT_REMOVED event when async-scheduling enabled in CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-6714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055413#comment-16055413 ] Tao Yang edited comment on YARN-6714 at 6/20/17 9:38 AM: - Thanks [~leftnoteasy] for

[jira] [Comment Edited] (YARN-6714) RM crashed with IllegalStateException while handling APP_ATTEMPT_REMOVED event when async-scheduling enabled in CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-6714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055413#comment-16055413 ] Tao Yang edited comment on YARN-6714 at 6/20/17 9:08 AM: - Thanks [~leftnoteasy] for

[jira] [Commented] (YARN-6714) RM crashed with IllegalStateException while handling APP_ATTEMPT_REMOVED event when async-scheduling enabled in CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-6714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055413#comment-16055413 ] Tao Yang commented on YARN-6714: Thanks [~leftnoteasy] for reviewing the patch. {quote} Could you move test

[jira] [Commented] (YARN-6712) Moving logging APIs over to slf4j in hadoop-yarn-server-common

[ https://issues.apache.org/jira/browse/YARN-6712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055367#comment-16055367 ] Hadoop QA commented on YARN-6712: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6713) Fix dead link in the Javadoc of FairSchedulerEventLog.java

[ https://issues.apache.org/jira/browse/YARN-6713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055327#comment-16055327 ] Akira Ajisaka commented on YARN-6713: - +1, checking this in. > Fix dead link in the Javadoc of

[jira] [Commented] (YARN-6678) Committer thread crashes with IllegalStateException in async-scheduling mode of CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-6678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055310#comment-16055310 ] Tao Yang commented on YARN-6678: Thanks [~leftnoteasy] for your comments. {quote} Instead of using

[jira] [Commented] (YARN-6467) CSQueueMetrics needs to update the current metrics for default partition only

[ https://issues.apache.org/jira/browse/YARN-6467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055271#comment-16055271 ] Hadoop QA commented on YARN-6467: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6712) Moving logging APIs over to slf4j in hadoop-yarn-server-common

[ https://issues.apache.org/jira/browse/YARN-6712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-6712: Target Version/s: 2.9.0, 3.0.0-beta1 (was: 2.9.0) > Moving logging APIs over to slf4j in

[jira] [Updated] (YARN-6712) Moving logging APIs over to slf4j in hadoop-yarn-server-common

[ https://issues.apache.org/jira/browse/YARN-6712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-6712: Attachment: YARN-6712.01.patch Attaching a patch for hadoop-yarn-server-common module. > Moving

[jira] [Updated] (YARN-6712) Moving logging APIs over to slf4j in hadoop-yarn-server-common

[ https://issues.apache.org/jira/browse/YARN-6712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-6712: Summary: Moving logging APIs over to slf4j in hadoop-yarn-server-common (was: Moving logging APIs

[jira] [Commented] (YARN-6712) Moving logging APIs over to slf4j in hadoop-yarn-server

[ https://issues.apache.org/jira/browse/YARN-6712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055197#comment-16055197 ] Akira Ajisaka commented on YARN-6712: - There are too many occurrence. I'll split the jira. {code} $