[jira] [Updated] (YARN-6259) Support pagination and optimize data transfer with zero-copy approach for containerlogs REST API in NMWebServices

[ https://issues.apache.org/jira/browse/YARN-6259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-6259: --- Attachment: YARN-6259.001.patch Attach a patch for review > Support pagination and optimize data transfer

[jira] [Created] (YARN-6259) Support pagination and optimize data transfer with zero-copy approach for containerlogs REST API in NMWebServices

Tao Yang created YARN-6259: -- Summary: Support pagination and optimize data transfer with zero-copy approach for containerlogs REST API in NMWebServices Key: YARN-6259 URL: https://issues.apache.org/jira/browse/YARN-6259

[jira] [Updated] (YARN-6257) CapacityScheduler REST API produces incorrect JSON - JSON object operationsInfo contains deplicate key

[ https://issues.apache.org/jira/browse/YARN-6257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-6257: --- Description: In response string of CapacityScheduler REST API, scheduler/schedulerInfo/health/operationsInfo

[jira] [Commented] (YARN-6257) CapacityScheduler REST API produces incorrect JSON - JSON object operationsInfo contains deplicate key

[ https://issues.apache.org/jira/browse/YARN-6257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889796#comment-15889796 ] Tao Yang commented on YARN-6257: Hi, [~sunilg]. Thank you for looking into the issue. {quote} It will break

[jira] [Updated] (YARN-6257) CapacityScheduler REST API produces incorrect JSON - JSON object operationsInfo contains deplicate key

[ https://issues.apache.org/jira/browse/YARN-6257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-6257: --- Attachment: YARN-6257.001.patch Attach a patch for review. > CapacityScheduler REST API produces incorrect

[jira] [Updated] (YARN-6257) CapacityScheduler REST API produces incorrect JSON - JSON object operationsInfo contains deplicate key

[ https://issues.apache.org/jira/browse/YARN-6257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-6257: --- Description: In response string of CapacityScheduler REST API, scheduler/schedulerInfo/health/operationsInfo

[jira] [Created] (YARN-6257) CapacityScheduler REST API produces incorrect JSON - JSON object operationsInfo contains deplicate key

Tao Yang created YARN-6257: -- Summary: CapacityScheduler REST API produces incorrect JSON - JSON object operationsInfo contains deplicate key Key: YARN-6257 URL: https://issues.apache.org/jira/browse/YARN-6257

[jira] [Commented] (YARN-6092) Refreshing CapacityScheduler page throws NPE

[ https://issues.apache.org/jira/browse/YARN-6092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15874229#comment-15874229 ] Tao Yang commented on YARN-6092: Hi，[~ajithshetty]. I found this problem when doing test on hadoop-2.9, and

[jira] [Commented] (YARN-5139) [Umbrella] Move YARN scheduler towards global scheduler

[ https://issues.apache.org/jira/browse/YARN-5139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15855496#comment-15855496 ] Tao Yang commented on YARN-5139: Hi, [~leftnoteasy]. YARN-5716 seems not to be able to lookup multiple

[jira] [Commented] (YARN-6029) CapacityScheduler deadlock when ParentQueue#getQueueUserAclInfo is called by Thread_A at the moment that Thread_B calls LeafQueue#assignContainers to release a reserved

[ https://issues.apache.org/jira/browse/YARN-6029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15794011#comment-15794011 ] Tao Yang commented on YARN-6029: Hi，[~Naganarasimha] I thought the application could be finished in another

[jira] [Created] (YARN-6044) Resource bar of Capacity Scheduler UI does not show correctly

Tao Yang created YARN-6044: -- Summary: Resource bar of Capacity Scheduler UI does not show correctly Key: YARN-6044 URL: https://issues.apache.org/jira/browse/YARN-6044 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-6029) CapacityScheduler deadlock when ParentQueue#getQueueUserAclInfo is called by Thread_A at the moment that Thread_B calls LeafQueue#assignContainers to release a reserved

[ https://issues.apache.org/jira/browse/YARN-6029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15786715#comment-15786715 ] Tao Yang commented on YARN-6029: Patch updated. Update Assignee to [~leftnoteasy] since I have made little

[jira] [Updated] (YARN-6029) CapacityScheduler deadlock when ParentQueue#getQueueUserAclInfo is called by Thread_A at the moment that Thread_B calls LeafQueue#assignContainers to release a reserved co

[ https://issues.apache.org/jira/browse/YARN-6029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-6029: --- Assignee: Wangda Tan (was: Tao Yang) > CapacityScheduler deadlock when ParentQueue#getQueueUserAclInfo is

[jira] [Updated] (YARN-6029) CapacityScheduler deadlock when ParentQueue#getQueueUserAclInfo is called by Thread_A at the moment that Thread_B calls LeafQueue#assignContainers to release a reserved co

[ https://issues.apache.org/jira/browse/YARN-6029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-6029: --- Attachment: YARN-6029-branch-2.8.001.patch > CapacityScheduler deadlock when ParentQueue#getQueueUserAclInfo

[jira] [Commented] (YARN-6029) CapacityScheduler deadlock when ParentQueue#getQueueUserAclInfo is called by Thread_A at the moment that Thread_B calls LeafQueue#assignContainers to release a reserved

[ https://issues.apache.org/jira/browse/YARN-6029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15786683#comment-15786683 ] Tao Yang commented on YARN-6029: Thanks [~wangda] for correcting me. I missed to realize that

[jira] [Commented] (YARN-6029) CapacityScheduler deadlock when ParentQueue#getQueueUserAclInfo is called by Thread_A at the moment that Thread_B calls LeafQueue#assignContainers to release a reserved

[ https://issues.apache.org/jira/browse/YARN-6029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15784388#comment-15784388 ] Tao Yang commented on YARN-6029: Thanks [~wangda]. Updated priority to Critical and Attached new patch for

[jira] [Updated] (YARN-6029) CapacityScheduler deadlock when ParentQueue#getQueueUserAclInfo is called by Thread_A at the moment that Thread_B calls LeafQueue#assignContainers to release a reserved co

[ https://issues.apache.org/jira/browse/YARN-6029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-6029: --- Attachment: YARN-6029.002.patch > CapacityScheduler deadlock when ParentQueue#getQueueUserAclInfo is called by

[jira] [Updated] (YARN-6029) CapacityScheduler deadlock when ParentQueue#getQueueUserAclInfo is called by Thread_A at the moment that Thread_B calls LeafQueue#assignContainers to release a reserved co

[ https://issues.apache.org/jira/browse/YARN-6029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-6029: --- Priority: Critical (was: Blocker) > CapacityScheduler deadlock when ParentQueue#getQueueUserAclInfo is called

[jira] [Commented] (YARN-6029) CapacityScheduler deadlock when ParentQueue#getQueueUserAclInfo is called by Thread_A at the moment that Thread_B calls LeafQueue#assignContainers to release a reserved

[ https://issues.apache.org/jira/browse/YARN-6029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15782578#comment-15782578 ] Tao Yang commented on YARN-6029: Thanks [~wangda] & [~Naganarasimha] ! {quote} Agree but IIUC based on 2.8

[jira] [Commented] (YARN-6029) CapacityScheduler deadlock when ParentQueue#getQueueUserAclInfo is called by Thread_A at the moment that Thread_B calls LeafQueue#assignContainers to release a reserved

[ https://issues.apache.org/jira/browse/YARN-6029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15782067#comment-15782067 ] Tao Yang commented on YARN-6029: Thanks [~gtCarrera9] for correcting me. There is something wrong in my

[jira] [Commented] (YARN-6029) CapacityScheduler deadlock when ParentQueue#getQueueUserAclInfo is called by Thread_A at the moment that Thread_B calls LeafQueue#assignContainers to release a reserved

[ https://issues.apache.org/jira/browse/YARN-6029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15781969#comment-15781969 ] Tao Yang commented on YARN-6029: Thanks [~Naganarasimha] [~djp] [~leftnoteasy] for your suggestions.

[jira] [Updated] (YARN-6029) CapacityScheduler deadlock when ParentQueue#getQueueUserAclInfo is called by Thread_A at the moment that Thread_B calls LeafQueue#assignContainers to release a reserved co

[ https://issues.apache.org/jira/browse/YARN-6029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-6029: --- Attachment: YARN-6029.001.patch deadlock.jstack > CapacityScheduler deadlock when

[jira] [Created] (YARN-6029) CapacityScheduler deadlock when ParentQueue#getQueueUserAclInfo is called by Thread_A at the moment that Thread_B calls LeafQueue#assignContainers to release a reserved co

Tao Yang created YARN-6029: -- Summary: CapacityScheduler deadlock when ParentQueue#getQueueUserAclInfo is called by Thread_A at the moment that Thread_B calls LeafQueue#assignContainers to release a reserved container Key: YARN-6029

[jira] [Resolved] (YARN-5749) Fail to localize resources after health status for local dirs changed

[ https://issues.apache.org/jira/browse/YARN-5749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang resolved YARN-5749. Resolution: Duplicate > Fail to localize resources after health status for local dirs changed >

[jira] [Commented] (YARN-5749) Fail to localize resources after health status for local dirs changed

[ https://issues.apache.org/jira/browse/YARN-5749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15588266#comment-15588266 ] Tao Yang commented on YARN-5749: Contacted with [~ajisakaa]], This problem can be solved by the patch in

[jira] [Updated] (YARN-5749) Fail to localize resources after health status for local dirs changed

[ https://issues.apache.org/jira/browse/YARN-5749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-5749: --- Description: HADOOP-13440 updated FileContext#setUMask method to change umask from local variable to global

[jira] [Updated] (YARN-5749) Fail to localize resources after health status for local dirs changed

[ https://issues.apache.org/jira/browse/YARN-5749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-5749: --- Summary: Fail to localize resources after health status for local dirs changed (was: Fail to localize

[jira] [Created] (YARN-5749) Fail to localize resources after health status for local dirs changed occurred by the change of FileContext#setUMask

Tao Yang created YARN-5749: -- Summary: Fail to localize resources after health status for local dirs changed occurred by the change of FileContext#setUMask Key: YARN-5749 URL:

[jira] [Updated] (YARN-5683) Support specifying storage type for per-application local dirs

[ https://issues.apache.org/jira/browse/YARN-5683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-5683: --- Attachment: YARN-5683-3.patch > Support specifying storage type for per-application local dirs >

[jira] [Commented] (YARN-5683) Support specifying storage type for per-application local dirs

[ https://issues.apache.org/jira/browse/YARN-5683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15565030#comment-15565030 ] Tao Yang commented on YARN-5683: Add YARN-5683-2.patch and update the description. Updates: (1) Fix

[jira] [Updated] (YARN-5683) Support specifying storage type for per-application local dirs

[ https://issues.apache.org/jira/browse/YARN-5683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-5683: --- Description: h3. Introduction * Some applications of various frameworks (Flink, Spark and MapReduce etc)

[jira] [Updated] (YARN-5683) Support specifying storage type for per-application local dirs

[ https://issues.apache.org/jira/browse/YARN-5683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-5683: --- Attachment: YARN-5683-2.patch flow_diagram_for_MapReduce-2.png > Support specifying storage

[jira] [Updated] (YARN-5683) Support specifying storage type for per-application local dirs

[ https://issues.apache.org/jira/browse/YARN-5683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-5683: --- Description: h3. Introduction * Some applications of various frameworks (Flink, Spark and MapReduce etc)

[jira] [Commented] (YARN-5683) Support specifying storage type for per-application local dirs

[ https://issues.apache.org/jira/browse/YARN-5683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531569#comment-15531569 ] Tao Yang commented on YARN-5683: Thanks for comments, [~grey]. We think

[jira] [Updated] (YARN-5683) Support specifying storage type for per-application local dirs

[ https://issues.apache.org/jira/browse/YARN-5683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-5683: --- Description: h3. Introduction * Some applications of various frameworks (Flink, Spark and MapReduce etc)

[jira] [Updated] (YARN-5683) Support specifying storage type for per-application local dirs

[ https://issues.apache.org/jira/browse/YARN-5683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-5683: --- Description: h3. Introduction * Some applications of various frameworks (Flink, Spark and MapReduce etc)

[jira] [Updated] (YARN-5683) Support specifying storage type for per-application local dirs

[ https://issues.apache.org/jira/browse/YARN-5683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-5683: --- Description: h3. Introduction * Some applications of various frameworks (Flink, Spark and MapReduce etc)

[jira] [Updated] (YARN-5683) Support specifying storage type for per-application local dirs

[ https://issues.apache.org/jira/browse/YARN-5683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-5683: --- Attachment: flow_diagram_for_MapReduce.png > Support specifying storage type for per-application local dirs >

[jira] [Updated] (YARN-5683) Support specifying storage type for per-application local dirs

[ https://issues.apache.org/jira/browse/YARN-5683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-5683: --- Attachment: YARN-5683-1.patch > Support specifying storage type for per-application local dirs >

[jira] [Updated] (YARN-5683) Support specifying storage type for per-application local dirs

[ https://issues.apache.org/jira/browse/YARN-5683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-5683: --- Description: h1. Introduction * Some applications of various frameworks (Flink, Spark and MapReduce etc)

[jira] [Created] (YARN-5683) Support specifying storage type for per-application local dirs

Tao Yang created YARN-5683: -- Summary: Support specifying storage type for per-application local dirs Key: YARN-5683 URL: https://issues.apache.org/jira/browse/YARN-5683 Project: Hadoop YARN Issue

<    5   6   7   8   9   10