[jira] [Updated] (YARN-1680) availableResources sent to applicationMaster in heartbeat should exclude blacklistedNodes free memory.

2015-06-12 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-1680: -- Assignee: Chen He (was: Craig Welch) availableResources sent to applicationMaster in heartbeat should

[jira] [Updated] (YARN-3320) Support a Priority OrderingPolicy

2015-06-12 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3320: -- Assignee: Wangda Tan (was: Craig Welch) Support a Priority OrderingPolicy

[jira] [Commented] (YARN-1680) availableResources sent to applicationMaster in heartbeat should exclude blacklistedNodes free memory.

2015-06-12 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14584266#comment-14584266 ] Craig Welch commented on YARN-1680: --- [~airbots], unfortunately, I'm having no more luck

[jira] [Updated] (YARN-1198) Capacity Scheduler headroom calculation does not work as expected

2015-06-12 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-1198: -- Assignee: Wangda Tan (was: Craig Welch) Capacity Scheduler headroom calculation does not work as

[jira] [Commented] (YARN-1039) Add parameter for YARN resource requests to indicate long lived

2015-06-12 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14584271#comment-14584271 ] Craig Welch commented on YARN-1039: --- I'll go back to my earlier assertion that I think

[jira] [Updated] (YARN-3510) Create an extension of ProportionalCapacityPreemptionPolicy which preempts a number of containers from each application in a way which respects fairness

2015-06-12 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3510: -- Assignee: Wangda Tan (was: Craig Welch) Create an extension of ProportionalCapacityPreemptionPolicy

[jira] [Updated] (YARN-1039) Add parameter for YARN resource requests to indicate long lived

2015-06-12 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-1039: -- Assignee: Vinod Kumar Vavilapalli (was: Craig Welch) Add parameter for YARN resource requests to

[jira] [Commented] (YARN-3510) Create an extension of ProportionalCapacityPreemptionPolicy which preempts a number of containers from each application in a way which respects fairness

2015-06-03 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571405#comment-14571405 ] Craig Welch commented on YARN-3510: --- [~leftnoteasy], I think [~sunilg] was referring to

[jira] [Commented] (YARN-3510) Create an extension of ProportionalCapacityPreemptionPolicy which preempts a number of containers from each application in a way which respects fairness

2015-06-02 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570039#comment-14570039 ] Craig Welch commented on YARN-3510: --- [~leftnoteasy] and I had some offline discussion.

[jira] [Updated] (YARN-3510) Create an extension of ProportionalCapacityPreemptionPolicy which preempts a number of containers from each application in a way which respects fairness

2015-05-28 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3510: -- Attachment: YARN-3510.2.patch Create an extension of ProportionalCapacityPreemptionPolicy which

[jira] [Updated] (YARN-3510) Create an extension of ProportionalCapacityPreemptionPolicy which preempts a number of containers from each application in a way which respects fairness

2015-05-28 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3510: -- Attachment: YARN-3510.3.patch Remove some unnecessary changes to other preemption tests introduced while

[jira] [Updated] (YARN-3510) Create an extension of ProportionalCapacityPreemptionPolicy which preempts a number of containers from each application in a way which respects fairness

2015-05-28 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3510: -- Attachment: YARN-3510.5.patch Found a couple little missed things improved documentation of the new

[jira] [Commented] (YARN-3510) Create an extension of ProportionalCapacityPreemptionPolicy which preempts a number of containers from each application in a way which respects fairness

2015-05-28 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563983#comment-14563983 ] Craig Welch commented on YARN-3510: --- The attached patch supports an optional

[jira] [Updated] (YARN-3510) Create an extension of ProportionalCapacityPreemptionPolicy which preempts a number of containers from each application in a way which respects fairness

2015-05-28 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3510: -- Attachment: YARN-3510.6.patch Ran all of the tests listed as failing or timing out on my box with the

[jira] [Commented] (YARN-3626) On Windows localized resources are not moved to the front of the classpath when they should be

2015-05-26 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14560210#comment-14560210 ] Craig Welch commented on YARN-3626: --- The checkstyle is insignificant, the rest is all

[jira] [Updated] (YARN-3626) On Windows localized resources are not moved to the front of the classpath when they should be

2015-05-26 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3626: -- Attachment: YARN-3626.15.patch On Windows localized resources are not moved to the front of the

[jira] [Commented] (YARN-3626) On Windows localized resources are not moved to the front of the classpath when they should be

2015-05-26 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14559935#comment-14559935 ] Craig Welch commented on YARN-3626: --- [~vinodkv] indicated it's private Windows specific,

[jira] [Updated] (YARN-3626) On Windows localized resources are not moved to the front of the classpath when they should be

2015-05-26 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3626: -- Attachment: YARN-3626.16.patch Sure, annotated also On Windows localized resources are not moved to

[jira] [Commented] (YARN-3632) Ordering policy should be allowed to reorder an application when demand changes

2015-05-22 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556814#comment-14556814 ] Craig Welch commented on YARN-3632: --- bq. {code} if

[jira] [Commented] (YARN-3632) Ordering policy should be allowed to reorder an application when demand changes

2015-05-22 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556767#comment-14556767 ] Craig Welch commented on YARN-3632: --- bq. 1) ... done bq. 2) ... done bq. 3) ...

[jira] [Updated] (YARN-3632) Ordering policy should be allowed to reorder an application when demand changes

2015-05-22 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3632: -- Attachment: YARN-3632.7.patch Ordering policy should be allowed to reorder an application when demand

[jira] [Commented] (YARN-3632) Ordering policy should be allowed to reorder an application when demand changes

2015-05-22 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556922#comment-14556922 ] Craig Welch commented on YARN-3632: --- BTW, the whitespace and checkstyle look to be

[jira] [Commented] (YARN-3632) Ordering policy should be allowed to reorder an application when demand changes

2015-05-21 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555302#comment-14555302 ] Craig Welch commented on YARN-3632: --- Just uploaded a patch which addresses the comments.

[jira] [Updated] (YARN-3632) Ordering policy should be allowed to reorder an application when demand changes

2015-05-21 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3632: -- Attachment: YARN-3632.6.patch Ordering policy should be allowed to reorder an application when demand

[jira] [Commented] (YARN-3626) On Windows localized resources are not moved to the front of the classpath when they should be

2015-05-20 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14552686#comment-14552686 ] Craig Welch commented on YARN-3626: --- Checkstyle looks insignificant. [~cnauroth],

[jira] [Commented] (YARN-3681) yarn cmd says could not find main class 'queue' in windows

2015-05-20 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14552700#comment-14552700 ] Craig Welch commented on YARN-3681: --- [~varun_saxena] the patch you had doesn't apply

[jira] [Updated] (YARN-3681) yarn cmd says could not find main class 'queue' in windows

2015-05-20 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3681: -- Attachment: YARN-3681.0.patch yarn cmd says could not find main class 'queue' in windows

[jira] [Updated] (YARN-3681) yarn cmd says could not find main class 'queue' in windows

2015-05-20 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3681: -- Attachment: YARN-3681.branch-2.0.patch Here is one for branch-2 yarn cmd says could not find main

[jira] [Updated] (YARN-3681) yarn cmd says could not find main class 'queue' in windows

2015-05-20 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3681: -- Attachment: YARN-3681.1.patch Oh the irony, neither did my own. Updated to one which does. yarn cmd

[jira] [Updated] (YARN-3626) On Windows localized resources are not moved to the front of the classpath when they should be

2015-05-19 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3626: -- Attachment: YARN-3626.14.patch On Windows localized resources are not moved to the front of the

[jira] [Commented] (YARN-3681) yarn cmd says could not find main class 'queue' in windows

2015-05-19 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14551749#comment-14551749 ] Craig Welch commented on YARN-3681: --- Tested my own version of this patch yesterday which

[jira] [Commented] (YARN-3626) On Windows localized resources are not moved to the front of the classpath when they should be

2015-05-15 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14546374#comment-14546374 ] Craig Welch commented on YARN-3626: --- Right, going back to [~cnauroth], [~vinodkv], we

[jira] [Updated] (YARN-3632) Ordering policy should be allowed to reorder an application when demand changes

2015-05-15 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3632: -- Attachment: YARN-3632.5.patch Ordering policy should be allowed to reorder an application when demand

[jira] [Commented] (YARN-3632) Ordering policy should be allowed to reorder an application when demand changes

2015-05-15 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14546271#comment-14546271 ] Craig Welch commented on YARN-3632: --- One line change to address missing whitespace issue.

[jira] [Commented] (YARN-3626) On Windows localized resources are not moved to the front of the classpath when they should be

2015-05-15 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14546288#comment-14546288 ] Craig Welch commented on YARN-3626: --- [~cnauroth], [~vvasudev] - This patch goes back to

[jira] [Commented] (YARN-3626) On Windows localized resources are not moved to the front of the classpath when they should be

2015-05-15 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14546370#comment-14546370 ] Craig Welch commented on YARN-3626: --- bq. Can't we do the above? We definitely cannot

[jira] [Updated] (YARN-3626) On Windows localized resources are not moved to the front of the classpath when they should be

2015-05-15 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3626: -- Attachment: YARN-3626.9.patch In that case, here's a patch which goes back to the original approach used

[jira] [Commented] (YARN-3632) Ordering policy should be allowed to reorder an application when demand changes

2015-05-15 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14546403#comment-14546403 ] Craig Welch commented on YARN-3632: --- findbugs and javac appear to be irrelevant...

[jira] [Updated] (YARN-3626) On Windows localized resources are not moved to the front of the classpath when they should be

2015-05-15 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3626: -- Attachment: YARN-3626.11.patch Now using the environment to pass the configuration. On Windows

[jira] [Updated] (YARN-3632) Ordering policy should be allowed to reorder an application when demand changes

2015-05-15 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3632: -- Attachment: YARN-3632.4.patch Ordering policy should be allowed to reorder an application when demand

[jira] [Commented] (YARN-3632) Ordering policy should be allowed to reorder an application when demand changes

2015-05-15 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14546110#comment-14546110 ] Craig Welch commented on YARN-3632: --- Uploaded patch to address checkstyle and whitespace

[jira] [Updated] (YARN-3632) Ordering policy should be allowed to reorder an application when demand changes

2015-05-14 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3632: -- Attachment: YARN-3632.1.patch Ordering policy should be allowed to reorder an application when demand

[jira] [Updated] (YARN-3632) Ordering policy should be allowed to reorder an application when demand changes

2015-05-14 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3632: -- Attachment: YARN-3632.3.patch Ordering policy should be allowed to reorder an application when demand

[jira] [Commented] (YARN-3632) Ordering policy should be allowed to reorder an application when demand changes

2015-05-14 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14544851#comment-14544851 ] Craig Welch commented on YARN-3632: --- Now with testing Ordering policy should be allowed

[jira] [Updated] (YARN-3626) On Windows localized resources are not moved to the front of the classpath when they should be

2015-05-13 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3626: -- Attachment: YARN-3626.6.patch Fix broken unit tests On Windows localized resources are not moved to

[jira] [Commented] (YARN-3626) On Windows localized resources are not moved to the front of the classpath when they should be

2015-05-13 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14542559#comment-14542559 ] Craig Welch commented on YARN-3626: --- Checkstyle looks unimportant, everything else OK

[jira] [Commented] (YARN-3306) [Umbrella] Proposing per-queue Policy driven scheduling in YARN

2015-05-13 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14542746#comment-14542746 ] Craig Welch commented on YARN-3306: --- I don't think it's really necessary at this point,

[jira] [Commented] (YARN-3306) [Umbrella] Proposing per-queue Policy driven scheduling in YARN

2015-05-13 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14542829#comment-14542829 ] Craig Welch commented on YARN-3306: --- bq. Integration points being narrow is probably more

[jira] [Updated] (YARN-3626) On Windows localized resources are not moved to the front of the classpath when they should be

2015-05-13 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3626: -- Attachment: YARN-3626.4.patch With testing On Windows localized resources are not moved to the front

[jira] [Updated] (YARN-3632) Ordering policy should be allowed to reorder an application when demand changes

2015-05-12 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3632: -- Attachment: YARN-3632.0.patch Ordering policy should be allowed to reorder an application when demand

[jira] [Created] (YARN-3632) Ordering policy should be allowed to reorder an application when demand changes

2015-05-12 Thread Craig Welch (JIRA)
Craig Welch created YARN-3632: - Summary: Ordering policy should be allowed to reorder an application when demand changes Key: YARN-3632 URL: https://issues.apache.org/jira/browse/YARN-3632 Project:

[jira] [Commented] (YARN-3626) On Windows localized resources are not moved to the front of the classpath when they should be

2015-05-11 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14538849#comment-14538849 ] Craig Welch commented on YARN-3626: --- To resolve this, the situation should be detected

[jira] [Created] (YARN-3626) On Windows localized resources are not moved to the front of the classpath when they should be

2015-05-11 Thread Craig Welch (JIRA)
Craig Welch created YARN-3626: - Summary: On Windows localized resources are not moved to the front of the classpath when they should be Key: YARN-3626 URL: https://issues.apache.org/jira/browse/YARN-3626

[jira] [Updated] (YARN-3626) On Windows localized resources are not moved to the front of the classpath when they should be

2015-05-11 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3626: -- Attachment: YARN-3626.0.patch The attached patch propagates the conditional as a yarn configuration

[jira] [Commented] (YARN-1680) availableResources sent to applicationMaster in heartbeat should exclude blacklistedNodes free memory.

2015-05-07 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14533684#comment-14533684 ] Craig Welch commented on YARN-1680: --- bq. This requires when a node doing heartbeat with

[jira] [Commented] (YARN-1680) availableResources sent to applicationMaster in heartbeat should exclude blacklistedNodes free memory.

2015-05-06 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14531635#comment-14531635 ] Craig Welch commented on YARN-1680: --- [~leftnoteasy] bq. Actually I think this statement

[jira] [Commented] (YARN-1680) availableResources sent to applicationMaster in heartbeat should exclude blacklistedNodes free memory.

2015-05-05 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529644#comment-14529644 ] Craig Welch commented on YARN-1680: --- bq. Please leave out the head-room concerns w.r.t

[jira] [Commented] (YARN-2421) CapacityScheduler still allocates containers to an app in the FINISHING state

2015-05-05 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529488#comment-14529488 ] Craig Welch commented on YARN-2421: --- Hi [~lichangleo], thanks for working on this fix.

[jira] [Commented] (YARN-1680) availableResources sent to applicationMaster in heartbeat should exclude blacklistedNodes free memory.

2015-05-05 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529738#comment-14529738 ] Craig Welch commented on YARN-1680: --- bq. I think we should stop adding such

[jira] [Commented] (YARN-1680) availableResources sent to applicationMaster in heartbeat should exclude blacklistedNodes free memory.

2015-05-05 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529224#comment-14529224 ] Craig Welch commented on YARN-1680: --- I've been looking over [~airbots] prior patches, the

[jira] [Commented] (YARN-3165) Possible inconsistent queue state when queue reinitialization failed

2015-05-01 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14523807#comment-14523807 ] Craig Welch commented on YARN-3165: --- So, given that the old queue actually takes on the

[jira] [Commented] (YARN-3211) Do not use zero as the beginning number for commands for LinuxContainerExecutor

2015-05-01 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14523884#comment-14523884 ] Craig Welch commented on YARN-3211: --- Can you add comments in code explaining why the enum

[jira] [Commented] (YARN-3126) FairScheduler: queue's usedResource is always more than the maxResource limit

2015-05-01 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14523764#comment-14523764 ] Craig Welch commented on YARN-3126: --- Hi [~Xia Hu], thanks for putting together a patch

[jira] [Commented] (YARN-3188) yarn application --list should list all the applications ( Not only submitted,accepted and running)

2015-05-01 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14523814#comment-14523814 ] Craig Welch commented on YARN-3188: --- I think that this consensus is that this is working

[jira] [Commented] (YARN-3193) When visit standby RM webui, it will redirect to the active RM webui slowly.

2015-05-01 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14523824#comment-14523824 ] Craig Welch commented on YARN-3193: --- I believe the redirect intentionally takes a moment

[jira] [Resolved] (YARN-3193) When visit standby RM webui, it will redirect to the active RM webui slowly.

2015-05-01 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch resolved YARN-3193. --- Resolution: Won't Fix When visit standby RM webui, it will redirect to the active RM webui slowly.

[jira] [Commented] (YARN-3553) TreeSet is not a nice container for organizing schedulableEntities.

2015-05-01 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14523757#comment-14523757 ] Craig Welch commented on YARN-3553: --- [~xinxianyin], this pattern is important for these

[jira] [Commented] (YARN-3153) Capacity Scheduler max AM resource limit for queues is defined as percentage but used as ratio

2015-05-01 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14523794#comment-14523794 ] Craig Welch commented on YARN-3153: --- I think {code}

[jira] [Resolved] (YARN-3188) yarn application --list should list all the applications ( Not only submitted,accepted and running)

2015-05-01 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch resolved YARN-3188. --- Resolution: Won't Fix [~anushri] I'm going to go ahead and resolve this as the consensus appears to

[jira] [Commented] (YARN-3121) FairScheduler preemption metrics

2015-05-01 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14523720#comment-14523720 ] Craig Welch commented on YARN-3121: --- Hi [~adhoot], does it make sense to share some

[jira] [Resolved] (YARN-2848) (FICA) Applications should maintain an application specific 'cluster' resource to calculate headroom and userlimit

2015-05-01 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch resolved YARN-2848. --- Resolution: Fixed (FICA) Applications should maintain an application specific 'cluster' resource to

[jira] [Commented] (YARN-2848) (FICA) Applications should maintain an application specific 'cluster' resource to calculate headroom and userlimit

2015-05-01 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14523629#comment-14523629 ] Craig Welch commented on YARN-2848: --- The ResourceUsage functionality added in [YARN-3356]

[jira] [Commented] (YARN-3257) FairScheduler: MaxAm may be set too low preventing apps from starting

2015-05-01 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14523935#comment-14523935 ] Craig Welch commented on YARN-3257: --- The implementation looks correct to me functionally,

[jira] [Commented] (YARN-1680) availableResources sent to applicationMaster in heartbeat should exclude blacklistedNodes free memory.

2015-04-30 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522133#comment-14522133 ] Craig Welch commented on YARN-1680: --- Hi [~airbots], any luck on this? Do you mind if I

[jira] [Commented] (YARN-3319) Implement a FairOrderingPolicy

2015-04-23 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509641#comment-14509641 ] Craig Welch commented on YARN-3319: --- Yes, it's configured in the capacity scheduler

[jira] [Commented] (YARN-3319) Implement a FairOrderingPolicy

2015-04-22 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14507701#comment-14507701 ] Craig Welch commented on YARN-3319: --- bq. Some minor comments about configuration part by

[jira] [Updated] (YARN-3319) Implement a FairOrderingPolicy

2015-04-22 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3319: -- Attachment: YARN-3319.74.patch Implement a FairOrderingPolicy --

[jira] [Commented] (YARN-3319) Implement a FairOrderingPolicy

2015-04-22 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14507917#comment-14507917 ] Craig Welch commented on YARN-3319: --- The failed tests pass on my box with the patch,

[jira] [Updated] (YARN-3319) Implement a FairOrderingPolicy

2015-04-22 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3319: -- Attachment: YARN-3319.75.patch trying something wrt checkstyle Implement a FairOrderingPolicy

[jira] [Updated] (YARN-3319) Implement a FairOrderingPolicy

2015-04-21 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3319: -- Attachment: YARN-3319.73.patch another findbugs Implement a FairOrderingPolicy

[jira] [Updated] (YARN-3319) Implement a FairOrderingPolicy

2015-04-20 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3319: -- Attachment: YARN-3319.72.patch Fix a findbugs Implement a FairOrderingPolicy

[jira] [Updated] (YARN-3319) Implement a FairOrderingPolicy

2015-04-20 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3319: -- Attachment: YARN-3319.70.patch Up to date with same patch index on [YARN-3463], still one todo, which is

[jira] [Updated] (YARN-3319) Implement a FairOrderingPolicy

2015-04-20 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3319: -- Attachment: YARN-3319.71.patch with fair config support, sizeBasedWeight config support Implement a

[jira] [Updated] (YARN-3463) Integrate OrderingPolicy Framework with CapacityScheduler

2015-04-20 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3463: -- Attachment: YARN-3463.70.patch Ok, getInfo it is, attached Integrate OrderingPolicy Framework with

[jira] [Created] (YARN-3510) Create an extension of ProportionalCapacityPreemptionPolicy which preempts a number of containers from each application in a way which respects fairness

2015-04-20 Thread Craig Welch (JIRA)
Craig Welch created YARN-3510: - Summary: Create an extension of ProportionalCapacityPreemptionPolicy which preempts a number of containers from each application in a way which respects fairness Key: YARN-3510 URL:

[jira] [Commented] (YARN-3463) Integrate OrderingPolicy Framework with CapacityScheduler

2015-04-19 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14502207#comment-14502207 ] Craig Welch commented on YARN-3463: --- bq. ... I think we can just initialize

[jira] [Updated] (YARN-3463) Integrate OrderingPolicy Framework with CapacityScheduler

2015-04-19 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3463: -- Attachment: YARN-3463.69.patch Integrate OrderingPolicy Framework with CapacityScheduler

[jira] [Commented] (YARN-3463) Integrate OrderingPolicy Framework with CapacityScheduler

2015-04-17 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499204#comment-14499204 ] Craig Welch commented on YARN-3463: --- bq. how about change it to MapString, String to

[jira] [Updated] (YARN-3463) Integrate OrderingPolicy Framework with CapacityScheduler

2015-04-17 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3463: -- Attachment: YARN-3463.68.patch Integrate OrderingPolicy Framework with CapacityScheduler

[jira] [Commented] (YARN-3463) Integrate OrderingPolicy Framework with CapacityScheduler

2015-04-17 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499205#comment-14499205 ] Craig Welch commented on YARN-3463: --- btw, the tests pass on my box with the change,

[jira] [Updated] (YARN-3463) Integrate OrderingPolicy Framework with CapacityScheduler

2015-04-16 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3463: -- Attachment: YARN-3463.67.patch rm unneeded capached change Integrate OrderingPolicy Framework with

[jira] [Commented] (YARN-3463) Integrate OrderingPolicy Framework with CapacityScheduler

2015-04-16 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498492#comment-14498492 ] Craig Welch commented on YARN-3463: --- bq. should we make pendingApplications to use

[jira] [Updated] (YARN-3463) Integrate OrderingPolicy Framework with CapacityScheduler

2015-04-15 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3463: -- Attachment: YARN-3463.64.patch rebased to current trunk Integrate OrderingPolicy Framework with

[jira] [Updated] (YARN-3463) Integrate OrderingPolicy Framework with CapacityScheduler

2015-04-15 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3463: -- Attachment: YARN-3463.65.patch Suppress orderingpolicy from appearing in web service responses, is still

[jira] [Updated] (YARN-3463) Integrate OrderingPolicy Framework with CapacityScheduler

2015-04-15 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3463: -- Attachment: YARN-3463.66.patch Fix build warnings, the tests all pass on my box. Integrate

[jira] [Commented] (YARN-3463) Integrate OrderingPolicy Framework with CapacityScheduler

2015-04-14 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494924#comment-14494924 ] Craig Welch commented on YARN-3463: --- I did, but it has the right stuff in it :-) I'll

[jira] [Updated] (YARN-3463) Integrate OrderingPolicy Framework with CapacityScheduler

2015-04-14 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3463: -- Attachment: YARN-3643.61.patch Get the patch name right. Integrate OrderingPolicy Framework with

[jira] [Updated] (YARN-3463) Integrate OrderingPolicy Framework with CapacityScheduler

2015-04-14 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3463: -- Attachment: (was: YARN-3319.61.patch) Integrate OrderingPolicy Framework with CapacityScheduler

[jira] [Updated] (YARN-3463) Integrate OrderingPolicy Framework with CapacityScheduler

2015-04-14 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3463: -- Attachment: (was: YARN-3643.58.patch) Integrate OrderingPolicy Framework with CapacityScheduler

[jira] [Updated] (YARN-3463) Integrate OrderingPolicy Framework with CapacityScheduler

2015-04-14 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3463: -- Attachment: YARN-3463.61.patch Again with the patch name Integrate OrderingPolicy Framework with

  1   2   3   4   5   >