[jira] [Updated] (YARN-4931) Preempted resources go back to the same application

2016-04-07 Thread Miles Crawford (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miles Crawford updated YARN-4931: - Description: Sometimes a queue that needs resources causes preemption - but the preempted

[jira] [Updated] (YARN-4931) Preempted resources go back to the same application

2016-04-07 Thread Miles Crawford (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miles Crawford updated YARN-4931: - Description: Sometimes a queue that needs resources causes preemption - but the preempted

[jira] [Created] (YARN-4931) Preempted resources go back to

2016-04-07 Thread Miles Crawford (JIRA)
Miles Crawford created YARN-4931: Summary: Preempted resources go back to Key: YARN-4931 URL: https://issues.apache.org/jira/browse/YARN-4931 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-4931) Preempted resources go back to the same application

2016-04-11 Thread Miles Crawford (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15235591#comment-15235591 ] Miles Crawford commented on YARN-4931: -- If it is helpful, it looks like these applications have a huge

[jira] [Commented] (YARN-4781) Support intra-queue preemption for fairness ordering policy.

2016-03-21 Thread Miles Crawford (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15204957#comment-15204957 ] Miles Crawford commented on YARN-4781: -- This is important for our organization. Currently, if a job

[jira] [Updated] (YARN-5039) Applications ACCEPTED but not starting

2016-05-10 Thread Miles Crawford (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miles Crawford updated YARN-5039: - Attachment: capacity-scheduler-at-debug.log.gz Attached capacity-scheduler-at-debug.log.gz, which

[jira] [Commented] (YARN-5039) Applications ACCEPTED but not starting

2016-05-11 Thread Miles Crawford (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15280357#comment-15280357 ] Miles Crawford commented on YARN-5039: -- Okay, wow that is wonderful to know. We have a highly variable

[jira] [Resolved] (YARN-5039) Applications ACCEPTED but not starting

2016-05-11 Thread Miles Crawford (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miles Crawford resolved YARN-5039. -- Resolution: Not A Bug > Applications ACCEPTED but not starting >

[jira] [Updated] (YARN-5039) Applications ACCEPTED but not starting

2016-05-10 Thread Miles Crawford (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miles Crawford updated YARN-5039: - Attachment: whole-scheduler-at-debug.log.gz Okey dokey, here's another log - last 2 or three

[jira] [Updated] (YARN-5039) Applications ACCEPTED but not starting

2016-05-05 Thread Miles Crawford (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miles Crawford updated YARN-5039: - Attachment: queue-config.log Attached the queue config section of RM logs from startup, looks like

[jira] [Commented] (YARN-5039) Applications ACCEPTED but not starting

2016-05-05 Thread Miles Crawford (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273098#comment-15273098 ] Miles Crawford commented on YARN-5039: -- Nope, I set reservations-continue-look-all-nodes to false, and

[jira] [Commented] (YARN-5039) Applications ACCEPTED but not starting

2016-05-05 Thread Miles Crawford (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273361#comment-15273361 ] Miles Crawford commented on YARN-5039: -- So we could be shooting ourselves in the foot by scaling our

[jira] [Commented] (YARN-5039) Applications ACCEPTED but not starting

2016-05-04 Thread Miles Crawford (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271567#comment-15271567 ] Miles Crawford commented on YARN-5039: -- Okay, I can try that. Looking over the linked issue, it should

[jira] [Commented] (YARN-5039) Applications ACCEPTED but not starting

2016-05-10 Thread Miles Crawford (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278488#comment-15278488 ] Miles Crawford commented on YARN-5039: -- Will do, happens pretty regularly, so should be in the next

[jira] [Created] (YARN-5039) Applications ACCEPTED but not starting

2016-05-04 Thread Miles Crawford (JIRA)
Miles Crawford created YARN-5039: Summary: Applications ACCEPTED but not starting Key: YARN-5039 URL: https://issues.apache.org/jira/browse/YARN-5039 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-5039) Applications ACCEPTED but not starting

2016-05-04 Thread Miles Crawford (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miles Crawford updated YARN-5039: - Description: Often when we submit applications to an incompletely utilized cluster, they sit,

[jira] [Updated] (YARN-5039) Applications ACCEPTED but not starting

2016-05-04 Thread Miles Crawford (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miles Crawford updated YARN-5039: - Description: Often when we submit applications to an incompletely utilized cluster, they sit,

[jira] [Updated] (YARN-5039) Applications ACCEPTED but not starting

2016-05-04 Thread Miles Crawford (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miles Crawford updated YARN-5039: - Attachment: Screen Shot 2016-05-04 at 2.41.22 PM.png Attaching a screenshot of the scheduler

[jira] [Commented] (YARN-5039) Applications ACCEPTED but not starting

2016-05-04 Thread Miles Crawford (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271489#comment-15271489 ] Miles Crawford commented on YARN-5039: -- 2 shedulable apps and zero non-schedulable apps are shown. I

[jira] [Updated] (YARN-5039) Applications ACCEPTED but not starting

2016-05-04 Thread Miles Crawford (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miles Crawford updated YARN-5039: - Attachment: resource-manager-application-starts.log.gz Application 25 finally started after around

[jira] [Updated] (YARN-5039) Applications ACCEPTED but not starting

2016-05-04 Thread Miles Crawford (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miles Crawford updated YARN-5039: - Attachment: yarn-yarn-resourcemanager-ip-10-12-47-144.log.gz Here's the resourcemanager log file -

[jira] [Updated] (YARN-5039) Applications ACCEPTED but not starting

2016-05-04 Thread Miles Crawford (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miles Crawford updated YARN-5039: - Attachment: Screen Shot 2016-05-04 at 1.57.19 PM.png Screenshot of the nodes page showing

[jira] [Commented] (YARN-5039) Applications ACCEPTED but not starting

2016-05-04 Thread Miles Crawford (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271422#comment-15271422 ] Miles Crawford commented on YARN-5039: -- Just attached a screenshot showing that there are multiple

[jira] [Commented] (YARN-5039) Applications ACCEPTED but not starting

2016-05-04 Thread Miles Crawford (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271431#comment-15271431 ] Miles Crawford commented on YARN-5039: -- Also, the "Tools -> Configuration" screen for this running

[jira] [Commented] (YARN-5039) Applications ACCEPTED but not starting

2016-05-04 Thread Miles Crawford (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271459#comment-15271459 ] Miles Crawford commented on YARN-5039: -- I am talking about the pending app. It never leaves pending,

[jira] [Commented] (YARN-4931) Preempted resources go back to the same application

2016-12-01 Thread Miles Crawford (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712538#comment-15712538 ] Miles Crawford commented on YARN-4931: -- ``` drf 5 20 0.8 fair ``` We use

[jira] [Comment Edited] (YARN-4931) Preempted resources go back to the same application

2016-12-01 Thread Miles Crawford (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712538#comment-15712538 ] Miles Crawford edited comment on YARN-4931 at 12/1/16 5:24 PM: --- {code}