[jira] [Commented] (YARN-18) Make locatlity in YARN's container assignment and task scheduling pluggable for other deployment topology

[ https://issues.apache.org/jira/browse/YARN-18?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13666427#comment-13666427 ] Junping Du commented on YARN-18: [~acmurthy] As our discussion yesterday, let's schedule a

[jira] [Commented] (YARN-760) NodeManager throws AvroRuntimeException on failed start

[ https://issues.apache.org/jira/browse/YARN-760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13675881#comment-13675881 ] Junping Du commented on YARN-760: - +1. Patch looks good to me. Kick off jenkins for you.

[jira] [Commented] (YARN-760) NodeManager throws AvroRuntimeException on failed start

[ https://issues.apache.org/jira/browse/YARN-760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13677152#comment-13677152 ] Junping Du commented on YARN-760: - Niranjan, Thanks for the patch. The test in

[jira] [Commented] (YARN-760) NodeManager throws AvroRuntimeException on failed start

[ https://issues.apache.org/jira/browse/YARN-760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13678109#comment-13678109 ] Junping Du commented on YARN-760: - Patch looks good to me. Someone can help to review and

[jira] [Updated] (YARN-18) Make locatlity in YARN's container assignment and task scheduling pluggable for other deployment topology

[ https://issues.apache.org/jira/browse/YARN-18?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-18: --- Attachment: YARN-18-v7.patch In v7 patch, abstract topology related logic within Schedulers (Fifo, Capacity

[jira] [Updated] (YARN-18) Make locatlity in YARN's container assignment and task scheduling pluggable for other deployment topology

[ https://issues.apache.org/jira/browse/YARN-18?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-18: --- Attachment: YARN-18-v7.1.patch Sync with latest trunk changes. Make locatlity in YARN's

[jira] [Updated] (YARN-18) Make locatlity in YARN's container assignment and task scheduling pluggable for other deployment topology

[ https://issues.apache.org/jira/browse/YARN-18?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-18: --- Attachment: YARN-18-v7.2.patch Make locatlity in YARN's container assignment and task scheduling pluggable

[jira] [Updated] (YARN-18) Make locatlity in YARN's container assignment and task scheduling pluggable for other deployment topology

[ https://issues.apache.org/jira/browse/YARN-18?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-18: --- Attachment: YARN-18-v7.3.patch Make locatlity in YARN's container assignment and task scheduling pluggable

[jira] [Commented] (YARN-18) Make locatlity in YARN's container assignment and task scheduling pluggable for other deployment topology

[ https://issues.apache.org/jira/browse/YARN-18?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13679544#comment-13679544 ] Junping Du commented on YARN-18: The findbugs warning seems to be unrelated. [~vicaya] and

[jira] [Commented] (YARN-801) Expose container locations and capabilities in the RM REST APIs

[ https://issues.apache.org/jira/browse/YARN-801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13681878#comment-13681878 ] Junping Du commented on YARN-801: - Sandy, shall we include ContainerState and running task

[jira] [Updated] (YARN-291) Dynamic resource configuration

[ https://issues.apache.org/jira/browse/YARN-291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-291: Description: The current Hadoop YARN resource management logic assumes per node resource is static during

[jira] [Commented] (YARN-291) Dynamic resource configuration

[ https://issues.apache.org/jira/browse/YARN-291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13682124#comment-13682124 ] Junping Du commented on YARN-291: - Hi [~tucu00], thanks for comments above. Actually, just

[jira] [Commented] (YARN-291) Dynamic resource configuration

[ https://issues.apache.org/jira/browse/YARN-291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13682936#comment-13682936 ] Junping Du commented on YARN-291: - Sure. I will add more unit tests later to cover this case

[jira] [Commented] (YARN-291) Dynamic resource configuration

[ https://issues.apache.org/jira/browse/YARN-291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13683024#comment-13683024 ] Junping Du commented on YARN-291: - I think we are just not sure if non-yarn process is still

[jira] [Updated] (YARN-311) Dynamic node resource configuration: core changes

[ https://issues.apache.org/jira/browse/YARN-311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-311: Summary: Dynamic node resource configuration: core changes (was: Dynamic node resource configuration on RM

[jira] [Updated] (YARN-311) Dynamic node resource configuration: core changes

[ https://issues.apache.org/jira/browse/YARN-311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-311: Description: As the first step, we go for resource change on RM side and expose admin APIs (admin protocol,

[jira] [Updated] (YARN-311) Dynamic node resource configuration: core scheduler changes

[ https://issues.apache.org/jira/browse/YARN-311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-311: Summary: Dynamic node resource configuration: core scheduler changes (was: Dynamic node resource

[jira] [Updated] (YARN-311) Dynamic node resource configuration: core changes

[ https://issues.apache.org/jira/browse/YARN-311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-311: Description: As the first step, we go for resource change on RM side and expose admin APIs (admin protocol,

[jira] [Commented] (YARN-311) Dynamic node resource configuration: core scheduler changes

[ https://issues.apache.org/jira/browse/YARN-311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13683044#comment-13683044 ] Junping Du commented on YARN-311: - According to discussion above, let's split JMX api into a

[jira] [Assigned] (YARN-771) AMRMClient support for resource blacklisting

[ https://issues.apache.org/jira/browse/YARN-771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned YARN-771: --- Assignee: Junping Du AMRMClient support for resource blacklisting

[jira] [Commented] (YARN-750) Allow for black-listing resources in YARN API and Impl in CS

[ https://issues.apache.org/jira/browse/YARN-750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13691499#comment-13691499 ] Junping Du commented on YARN-750: - Filed YARN-877 to address the black-listing

[jira] [Updated] (YARN-877) Allow for black-listing resources in FifoScheduler

[ https://issues.apache.org/jira/browse/YARN-877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-877: Attachment: YARN-877.patch Upload a patch to add implementation and unit test. Allow for

[jira] [Commented] (YARN-395) RM should have a way to disable scheduling to a set of nodes

[ https://issues.apache.org/jira/browse/YARN-395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13691502#comment-13691502 ] Junping Du commented on YARN-395: - [~bikassaha]Hi, I think this JIRA should already be

[jira] [Created] (YARN-878) Test failed on trunk for TestAMAuthorization.testUnauthorizedAccess

Junping Du created YARN-878: --- Summary: Test failed on trunk for TestAMAuthorization.testUnauthorizedAccess Key: YARN-878 URL: https://issues.apache.org/jira/browse/YARN-878 Project: Hadoop YARN

[jira] [Commented] (YARN-877) Allow for black-listing resources in FifoScheduler

[ https://issues.apache.org/jira/browse/YARN-877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13691514#comment-13691514 ] Junping Du commented on YARN-877: - The test failure is unrelated to this patch as previous

[jira] [Updated] (YARN-879) Fix NPE in Application.getResources()

[ https://issues.apache.org/jira/browse/YARN-879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-879: Attachment: YARN-879.patch Upload a patch to fix NPE issue. Fix NPE in

[jira] [Updated] (YARN-877) Allow for black-listing resources in FifoScheduler

[ https://issues.apache.org/jira/browse/YARN-877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-877: Attachment: YARN-877-2.patch Remove some unnecessary changes that fix warnings, we can address them

[jira] [Commented] (YARN-878) Test failed on trunk for TestAMAuthorization.testUnauthorizedAccess

[ https://issues.apache.org/jira/browse/YARN-878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13696430#comment-13696430 ] Junping Du commented on YARN-878: - This jira is duplicated with YARN-874. Resolve it as

[jira] [Resolved] (YARN-878) Test failed on trunk for TestAMAuthorization.testUnauthorizedAccess

[ https://issues.apache.org/jira/browse/YARN-878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du resolved YARN-878. - Resolution: Duplicate Test failed on trunk for TestAMAuthorization.testUnauthorizedAccess

[jira] [Commented] (YARN-871) Failed to run MR example against latest trunk

[ https://issues.apache.org/jira/browse/YARN-871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13698267#comment-13698267 ] Junping Du commented on YARN-871: - Hi [~zjshen], given YARN-874 is committed, shall we

[jira] [Updated] (YARN-7) Add support for DistributedShell to ask for CPUs along with memory

[ https://issues.apache.org/jira/browse/YARN-7?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-7: -- Attachment: YARN-7-v2.patch Sync up patch with latest trunk branch. Add support for

[jira] [Updated] (YARN-347) YARN node CLI should also show CPU info as memory info in node status

[ https://issues.apache.org/jira/browse/YARN-347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-347: Attachment: YARN-347-v2.patch YARN node CLI should also show CPU info as memory info in node status

[jira] [Commented] (YARN-347) YARN node CLI should also show CPU info as memory info in node status

[ https://issues.apache.org/jira/browse/YARN-347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13702723#comment-13702723 ] Junping Du commented on YARN-347: - Sure. Rebase this patch against trunk in v2 patch.

[jira] [Commented] (YARN-347) YARN node CLI should also show CPU info as memory info in node status

[ https://issues.apache.org/jira/browse/YARN-347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13702967#comment-13702967 ] Junping Du commented on YARN-347: - The test failure seems to be unrelated. It is also failed

[jira] [Commented] (YARN-347) YARN node CLI should also show CPU info as memory info in node status

[ https://issues.apache.org/jira/browse/YARN-347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13703025#comment-13703025 ] Junping Du commented on YARN-347: - Thanks Zhijie for review and a quick response.

[jira] [Commented] (YARN-292) ResourceManager throws ArrayIndexOutOfBoundsException while handling CONTAINER_ALLOCATED for application attempt

[ https://issues.apache.org/jira/browse/YARN-292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13703179#comment-13703179 ] Junping Du commented on YARN-292: - I think it is just caused by following code: {code:xml}

[jira] [Commented] (YARN-879) Fix NPE in Application.getResources()

[ https://issues.apache.org/jira/browse/YARN-879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13704136#comment-13704136 ] Junping Du commented on YARN-879: - Oh. I see it. Thanks Devaraj for kindly reminder. BTW, do

[jira] [Commented] (YARN-347) YARN node CLI should also show CPU info as memory info in node status

[ https://issues.apache.org/jira/browse/YARN-347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13704161#comment-13704161 ] Junping Du commented on YARN-347: - Thanks! Can someone commit this in?

[jira] [Commented] (YARN-879) Fix NPE in Application.getResources()

[ https://issues.apache.org/jira/browse/YARN-879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13704583#comment-13704583 ] Junping Du commented on YARN-879: - The history may not show this if tests are commented

[jira] [Commented] (YARN-879) Fix NPE in test/o.a.h.y.server.resourcemanager.Application.getResources()

[ https://issues.apache.org/jira/browse/YARN-879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13705501#comment-13705501 ] Junping Du commented on YARN-879: - Sure. Vinod. I will try to make tests work. Thanks for

[jira] [Commented] (YARN-347) YARN node CLI should also show CPU info as memory info in node status

[ https://issues.apache.org/jira/browse/YARN-347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13705512#comment-13705512 ] Junping Du commented on YARN-347: - Hi, [~acmurthy] The patch is rebase to latest trunk.

[jira] [Commented] (YARN-292) ResourceManager throws ArrayIndexOutOfBoundsException while handling CONTAINER_ALLOCATED for application attempt

[ https://issues.apache.org/jira/browse/YARN-292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13706579#comment-13706579 ] Junping Du commented on YARN-292: - Hi [~zjshen], I think your work above reveal the root

[jira] [Updated] (YARN-18) Configurable Hierarchical Topology for YARN

[ https://issues.apache.org/jira/browse/YARN-18?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-18: --- Summary: Configurable Hierarchical Topology for YARN (was: Make locatlity in YARN's container assignment and

[jira] [Updated] (YARN-18) Make locatlity in YARN's container assignment and task scheduling pluggable for other deployment topology

[ https://issues.apache.org/jira/browse/YARN-18?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-18: --- Attachment: HierachicalTopologyForYARNr1.pdf Make locatlity in YARN's container assignment and task

[jira] [Updated] (YARN-18) Configurable Hierarchical Topology for YARN

[ https://issues.apache.org/jira/browse/YARN-18?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-18: --- Description: Per discussion in the design lounge of Hadoop Summit 2013, we agreed to change the design of

[jira] [Commented] (YARN-18) Configurable Hierarchical Topology for YARN

[ https://issues.apache.org/jira/browse/YARN-18?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13720603#comment-13720603 ] Junping Du commented on YARN-18: Hi, according to our discussion in the design lounge at

[jira] [Commented] (YARN-873) YARNClient.getApplicationReport(unknownAppId) returns a null report

[ https://issues.apache.org/jira/browse/YARN-873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13720913#comment-13720913 ] Junping Du commented on YARN-873: - Hi [~bikassaha] and [~jeffgx619], TestNonExistentJob on

[jira] [Reopened] (YARN-885) TestBinaryTokenFile (and others) fail

[ https://issues.apache.org/jira/browse/YARN-885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reopened YARN-885: - It seems TestBinaryTokenFile is still failed from recent jenkins job on trunk, (please refer:

[jira] [Updated] (YARN-347) YARN node CLI should also show CPU info as memory info in node status

[ https://issues.apache.org/jira/browse/YARN-347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-347: Attachment: YARN-347-v3.patch Sync up with latest trunk. YARN node CLI should also show

[jira] [Commented] (YARN-347) YARN node CLI should also show CPU info as memory info in node status

[ https://issues.apache.org/jira/browse/YARN-347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13721443#comment-13721443 ] Junping Du commented on YARN-347: - Thanks Luke for review! YARN node CLI

[jira] [Commented] (YARN-347) YARN node CLI should also show CPU info as memory info in node status

[ https://issues.apache.org/jira/browse/YARN-347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13721454#comment-13721454 ] Junping Du commented on YARN-347: - So we replace all 'M' to 'MB' here? Sounds reasonable to

[jira] [Updated] (YARN-347) YARN node CLI should also show CPU info as memory info in node status

[ https://issues.apache.org/jira/browse/YARN-347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-347: Attachment: YARN-347-v4.patch Thanks for review. Vinod! v4 patch incorporate your comments. Please help to

[jira] [Commented] (YARN-347) YARN CLI should show CPU info besides memory info in node status

[ https://issues.apache.org/jira/browse/YARN-347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13721482#comment-13721482 ] Junping Du commented on YARN-347: - The test failure is unrelated as previous discussion

[jira] [Updated] (YARN-84) Use Builder to get RPC server in YARN

[ https://issues.apache.org/jira/browse/YARN-84?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-84: --- Attachment: YARN-84-branch2.patch Backport to branch2 as blocking HADOOP-9756 which remove RPC.getServer()

[jira] [Created] (YARN-996) REST API support for node resource configuration

Junping Du created YARN-996: --- Summary: REST API support for node resource configuration Key: YARN-996 URL: https://issues.apache.org/jira/browse/YARN-996 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Created] (YARN-998) Persistent resource change during NM restart

Junping Du created YARN-998: --- Summary: Persistent resource change during NM restart Key: YARN-998 URL: https://issues.apache.org/jira/browse/YARN-998 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Created] (YARN-997) JMX support for node resource configuration

Junping Du created YARN-997: --- Summary: JMX support for node resource configuration Key: YARN-997 URL: https://issues.apache.org/jira/browse/YARN-997 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Created] (YARN-1000) Dynamic resource configuration feature can be configured to enable or disable and persistent on setting or not

Junping Du created YARN-1000: Summary: Dynamic resource configuration feature can be configured to enable or disable and persistent on setting or not Key: YARN-1000 URL:

[jira] [Updated] (YARN-996) REST API support for node resource configuration

[ https://issues.apache.org/jira/browse/YARN-996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-996: Description: Besides admin protocol and CLI, REST API should also be supported for node resource

[jira] [Updated] (YARN-1000) Dynamic resource configuration feature can be configured to enable or disable and persistent on setting or not

[ https://issues.apache.org/jira/browse/YARN-1000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-1000: - Description: There are some configurations for feature of dynamic resource configuration: 1. enable or

[jira] [Created] (YARN-999) In case of long running tasks, reduce node resource should balloon out resource quickly by calling preemption API and suspending running task.

Junping Du created YARN-999: --- Summary: In case of long running tasks, reduce node resource should balloon out resource quickly by calling preemption API and suspending running task. Key: YARN-999 URL:

[jira] [Updated] (YARN-999) In case of long running tasks, reduce node resource should balloon out resource quickly by calling preemption API and suspending running task.

[ https://issues.apache.org/jira/browse/YARN-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-999: Description: In current design and implementation, when we decrease resource on node to less than resource

[jira] [Commented] (YARN-997) JMX support for node resource configuration

[ https://issues.apache.org/jira/browse/YARN-997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13724022#comment-13724022 ] Junping Du commented on YARN-997: - Hi Philip, thanks for your comments. I saw your comments

[jira] [Commented] (YARN-291) Dynamic resource configuration

[ https://issues.apache.org/jira/browse/YARN-291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13724758#comment-13724758 ] Junping Du commented on YARN-291: - Hi [~tucu00], as we discussed in Hadoop Summit, I agree

[jira] [Commented] (YARN-997) JMX support for node resource configuration

[ https://issues.apache.org/jira/browse/YARN-997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13725310#comment-13725310 ] Junping Du commented on YARN-997: - I think Luke already address you previous question on

[jira] [Commented] (YARN-1024) Define a virtual core unambigiously

[ https://issues.apache.org/jira/browse/YARN-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13730622#comment-13730622 ] Junping Du commented on YARN-1024: -- I would also prefer #1 in scheduling resources as #2

[jira] [Updated] (YARN-313) Add Admin API for supporting node resource configuration in command line

[ https://issues.apache.org/jira/browse/YARN-313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-313: Description: We should provide some admin interface, e.g. yarn rmadmin -refreshResources to support changes

[jira] [Commented] (YARN-1042) add ability to specify affinity/anti-affinity in container requests

[ https://issues.apache.org/jira/browse/YARN-1042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13733249#comment-13733249 ] Junping Du commented on YARN-1042: -- Yes. It is pretty useful in cases specified in

[jira] [Commented] (YARN-1042) add ability to specify affinity/anti-affinity in container requests

[ https://issues.apache.org/jira/browse/YARN-1042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13736520#comment-13736520 ] Junping Du commented on YARN-1042: -- Agree. IMO, YARN-796 just address more admin labels

[jira] [Updated] (YARN-291) Dynamic resource configuration

[ https://issues.apache.org/jira/browse/YARN-291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-291: Attachment: YARN-291-CoreAndAdmin.patch Update patch against latest trunk with core changes and admin

[jira] [Commented] (YARN-292) ResourceManager throws ArrayIndexOutOfBoundsException while handling CONTAINER_ALLOCATED for application attempt

[ https://issues.apache.org/jira/browse/YARN-292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13739302#comment-13739302 ] Junping Du commented on YARN-292: - Thanks for the patch. Zhijie! Patch looks good to me.

[jira] [Commented] (YARN-292) ResourceManager throws ArrayIndexOutOfBoundsException while handling CONTAINER_ALLOCATED for application attempt

[ https://issues.apache.org/jira/browse/YARN-292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13739316#comment-13739316 ] Junping Du commented on YARN-292: - Also, I see you only address Fifo and Fair, but not

[jira] [Commented] (YARN-292) ResourceManager throws ArrayIndexOutOfBoundsException while handling CONTAINER_ALLOCATED for application attempt

[ https://issues.apache.org/jira/browse/YARN-292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13739424#comment-13739424 ] Junping Du commented on YARN-292: - bq. I'll document it as the comment in

[jira] [Commented] (YARN-291) Dynamic resource configuration

[ https://issues.apache.org/jira/browse/YARN-291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13741858#comment-13741858 ] Junping Du commented on YARN-291: - Hi [~vicaya] Thanks for suggestions. Yes. That should be

[jira] [Commented] (YARN-1074) Clean up YARN CLI app list to show only running apps.

[ https://issues.apache.org/jira/browse/YARN-1074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13743498#comment-13743498 ] Junping Du commented on YARN-1074: -- Shall we have column for info like app start time? If

[jira] [Updated] (YARN-879) Fix NPE in test/o.a.h.y.server.resourcemanager.Application.getResources()

[ https://issues.apache.org/jira/browse/YARN-879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-879: Attachment: YARN-879-v2.patch In v2 patch, fix unit test in TestCapacityScheduler and TestResourceManager

[jira] [Commented] (YARN-879) Fix NPE in test/o.a.h.y.server.resourcemanager.Application.getResources()

[ https://issues.apache.org/jira/browse/YARN-879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13744804#comment-13744804 ] Junping Du commented on YARN-879: - It seems jenkins didn't trigger the test-patch. Cancel

[jira] [Commented] (YARN-879) Fix NPE in test/o.a.h.y.server.resourcemanager.Application.getResources()

[ https://issues.apache.org/jira/browse/YARN-879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13745699#comment-13745699 ] Junping Du commented on YARN-879: - [~vinodkv] and [~devaraj.k], would you help to review

[jira] [Updated] (YARN-879) Fix tests w.r.t o.a.h.y.server.resourcemanager.Application

[ https://issues.apache.org/jira/browse/YARN-879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-879: Summary: Fix tests w.r.t o.a.h.y.server.resourcemanager.Application (was: Fix NPE in

[jira] [Updated] (YARN-771) AMRMClient support for resource blacklisting

[ https://issues.apache.org/jira/browse/YARN-771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-771: Attachment: YARN-771-v1.0.patch Upload the first patch. AMRMClient support for resource

[jira] [Commented] (YARN-771) AMRMClient support for resource blacklisting

[ https://issues.apache.org/jira/browse/YARN-771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13750919#comment-13750919 ] Junping Du commented on YARN-771: - Can someone give it a review? Thx!

[jira] [Updated] (YARN-771) AMRMClient support for resource blacklisting

[ https://issues.apache.org/jira/browse/YARN-771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-771: Attachment: YARN-771-v3.patch AMRMClient support for resource blacklisting

[jira] [Commented] (YARN-771) AMRMClient support for resource blacklisting

[ https://issues.apache.org/jira/browse/YARN-771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13752754#comment-13752754 ] Junping Du commented on YARN-771: - [~bikassaha], Thanks for review! I address all your

[jira] [Commented] (YARN-771) AMRMClient support for resource blacklisting

[ https://issues.apache.org/jira/browse/YARN-771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13753477#comment-13753477 ] Junping Du commented on YARN-771: - [~bikassaha] b.q. What if we add node to blacklist and

[jira] [Commented] (YARN-771) AMRMClient support for resource blacklisting

[ https://issues.apache.org/jira/browse/YARN-771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13754336#comment-13754336 ] Junping Du commented on YARN-771: - Hi [~bikassaha], Thanks for good comments above. I have

[jira] [Commented] (YARN-771) AMRMClient support for resource blacklisting

[ https://issues.apache.org/jira/browse/YARN-771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13754441#comment-13754441 ] Junping Du commented on YARN-771: - bq. an API should be clear by itself. That's a good

[jira] [Updated] (YARN-771) AMRMClient support for resource blacklisting

[ https://issues.apache.org/jira/browse/YARN-771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-771: Attachment: YARN-771-v4.patch AMRMClient support for resource blacklisting

[jira] [Updated] (YARN-879) Fix tests w.r.t o.a.h.y.server.resourcemanager.Application

[ https://issues.apache.org/jira/browse/YARN-879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-879: Attachment: YARN-879-v3.patch Sync up patch with latest trunk branch. Can someone take a review on this?

[jira] [Commented] (YARN-771) AMRMClient support for resource blacklisting

[ https://issues.apache.org/jira/browse/YARN-771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13755313#comment-13755313 ] Junping Du commented on YARN-771: - Thanks [~bikassaha] for review!

[jira] [Assigned] (YARN-1131) $ yarn logs should return a message log aggregation is during progress if YARN application is running

[ https://issues.apache.org/jira/browse/YARN-1131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned YARN-1131: Assignee: Junping Du $ yarn logs should return a message log aggregation is during progress if

[jira] [Commented] (YARN-1042) add ability to specify affinity/anti-affinity in container requests

[ https://issues.apache.org/jira/browse/YARN-1042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13756114#comment-13756114 ] Junping Du commented on YARN-1042: -- My initial proposal is: add affinity and anti-affinity

[jira] [Assigned] (YARN-1042) add ability to specify affinity/anti-affinity in container requests

[ https://issues.apache.org/jira/browse/YARN-1042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned YARN-1042: Assignee: Junping Du add ability to specify affinity/anti-affinity in container requests

[jira] [Updated] (YARN-311) Dynamic node resource configuration: core scheduler changes

[ https://issues.apache.org/jira/browse/YARN-311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-311: Attachment: YARN-311-v5.patch Dynamic node resource configuration: core scheduler changes

[jira] [Commented] (YARN-291) Dynamic resource configuration

[ https://issues.apache.org/jira/browse/YARN-291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13756576#comment-13756576 ] Junping Du commented on YARN-291: - Hi, I start working on sub JIRAs and will address your

[jira] [Commented] (YARN-311) Dynamic node resource configuration: core scheduler changes

[ https://issues.apache.org/jira/browse/YARN-311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13756634#comment-13756634 ] Junping Du commented on YARN-311: - Hi, [~tucu00] Thanks for comments! bq.

[jira] [Updated] (YARN-311) Dynamic node resource configuration: core scheduler changes

[ https://issues.apache.org/jira/browse/YARN-311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-311: Attachment: YARN-311-v6.patch Update in v6 patch according to Alejandro's feedback: - Fix write/read lock

[jira] [Commented] (YARN-311) Dynamic node resource configuration: core scheduler changes

[ https://issues.apache.org/jira/browse/YARN-311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757710#comment-13757710 ] Junping Du commented on YARN-311: - Thanks for review! [~tucu00] bq. If we make

[jira] [Updated] (YARN-311) Dynamic node resource configuration: core scheduler changes

[ https://issues.apache.org/jira/browse/YARN-311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-311: Attachment: YARN-311-v6.2.patch Address recent comments from Alejandro on replacing read/write lock with

[jira] [Updated] (YARN-311) Dynamic node resource configuration: core scheduler changes

[ https://issues.apache.org/jira/browse/YARN-311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-311: Description: As the first step, we go for resource change on RM side and expose admin APIs (admin protocol,

[jira] [Updated] (YARN-311) Dynamic node resource configuration: core scheduler changes

[ https://issues.apache.org/jira/browse/YARN-311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-311: Description: As the first step, we go for resource change on RM side and expose admin APIs (admin protocol,

  1   2   3   4   5   6   7   8   9   10   >