[jira] [Updated] (YARN-8059) Resource type is ignored when FS decide to preempt

2018-11-03 Thread Szilard Nemeth (JIRA) 


 [ 
https://issues.apache.org/jira/browse/YARN-8059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Szilard Nemeth updated YARN-8059:
-
Attachment: YARN-8059.006.patch

> Resource type is ignored when FS decide to preempt
> --
>
> Key: YARN-8059
> URL: https://issues.apache.org/jira/browse/YARN-8059
> Project: Hadoop YARN
>  Issue Type: Bug
>  Components: fairscheduler
>Affects Versions: 3.0.0
>Reporter: Yufei Gu
>Assignee: Szilard Nemeth
>Priority: Major
> Attachments: YARN-8059.001.patch, YARN-8059.002.patch, 
> YARN-8059.003.patch, YARN-8059.004.patch, YARN-8059.005.patch, 
> YARN-8059.006.patch
>
>
> Method Fairscheduler#shouldAttemptPreemption doesn't consider resources other 
> than vcore and memory. We may need to rethink it in the resource type 
> scenario. cc [~miklos.szeg...@cloudera.com], [~wilfreds] and [~snemeth].
> {code}
> if (context.isPreemptionEnabled()) {
>   return (context.getPreemptionUtilizationThreshold() < Math.max(
>   (float) rootMetrics.getAllocatedMB() /
>   getClusterResource().getMemorySize(),
>   (float) rootMetrics.getAllocatedVirtualCores() /
>   getClusterResource().getVirtualCores()));
> }
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

[jira] [Updated] (YARN-8059) Resource type is ignored when FS decide to preempt

2018-10-19 Thread Szilard Nemeth (JIRA) 


 [ 
https://issues.apache.org/jira/browse/YARN-8059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Szilard Nemeth updated YARN-8059:
-
Attachment: YARN-8059.005.patch

> Resource type is ignored when FS decide to preempt
> --
>
> Key: YARN-8059
> URL: https://issues.apache.org/jira/browse/YARN-8059
> Project: Hadoop YARN
>  Issue Type: Bug
>  Components: fairscheduler
>Affects Versions: 3.0.0
>Reporter: Yufei Gu
>Assignee: Szilard Nemeth
>Priority: Major
> Attachments: YARN-8059.001.patch, YARN-8059.002.patch, 
> YARN-8059.003.patch, YARN-8059.004.patch, YARN-8059.005.patch
>
>
> Method Fairscheduler#shouldAttemptPreemption doesn't consider resources other 
> than vcore and memory. We may need to rethink it in the resource type 
> scenario. cc [~miklos.szeg...@cloudera.com], [~wilfreds] and [~snemeth].
> {code}
> if (context.isPreemptionEnabled()) {
>   return (context.getPreemptionUtilizationThreshold() < Math.max(
>   (float) rootMetrics.getAllocatedMB() /
>   getClusterResource().getMemorySize(),
>   (float) rootMetrics.getAllocatedVirtualCores() /
>   getClusterResource().getVirtualCores()));
> }
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

[jira] [Updated] (YARN-8059) Resource type is ignored when FS decide to preempt

2018-10-18 Thread Szilard Nemeth (JIRA) 


 [ 
https://issues.apache.org/jira/browse/YARN-8059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Szilard Nemeth updated YARN-8059:
-
Attachment: YARN-8059.004.patch

> Resource type is ignored when FS decide to preempt
> --
>
> Key: YARN-8059
> URL: https://issues.apache.org/jira/browse/YARN-8059
> Project: Hadoop YARN
>  Issue Type: Bug
>  Components: fairscheduler
>Affects Versions: 3.0.0
>Reporter: Yufei Gu
>Assignee: Szilard Nemeth
>Priority: Major
> Attachments: YARN-8059.001.patch, YARN-8059.002.patch, 
> YARN-8059.003.patch, YARN-8059.004.patch
>
>
> Method Fairscheduler#shouldAttemptPreemption doesn't consider resources other 
> than vcore and memory. We may need to rethink it in the resource type 
> scenario. cc [~miklos.szeg...@cloudera.com], [~wilfreds] and [~snemeth].
> {code}
> if (context.isPreemptionEnabled()) {
>   return (context.getPreemptionUtilizationThreshold() < Math.max(
>   (float) rootMetrics.getAllocatedMB() /
>   getClusterResource().getMemorySize(),
>   (float) rootMetrics.getAllocatedVirtualCores() /
>   getClusterResource().getVirtualCores()));
> }
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

[jira] [Updated] (YARN-8059) Resource type is ignored when FS decide to preempt

2018-10-17 Thread Szilard Nemeth (JIRA) 


 [ 
https://issues.apache.org/jira/browse/YARN-8059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Szilard Nemeth updated YARN-8059:
-
Attachment: YARN-8059.003.patch

> Resource type is ignored when FS decide to preempt
> --
>
> Key: YARN-8059
> URL: https://issues.apache.org/jira/browse/YARN-8059
> Project: Hadoop YARN
>  Issue Type: Bug
>  Components: fairscheduler
>Affects Versions: 3.0.0
>Reporter: Yufei Gu
>Assignee: Szilard Nemeth
>Priority: Major
> Attachments: YARN-8059.001.patch, YARN-8059.002.patch, 
> YARN-8059.003.patch
>
>
> Method Fairscheduler#shouldAttemptPreemption doesn't consider resources other 
> than vcore and memory. We may need to rethink it in the resource type 
> scenario. cc [~miklos.szeg...@cloudera.com], [~wilfreds] and [~snemeth].
> {code}
> if (context.isPreemptionEnabled()) {
>   return (context.getPreemptionUtilizationThreshold() < Math.max(
>   (float) rootMetrics.getAllocatedMB() /
>   getClusterResource().getMemorySize(),
>   (float) rootMetrics.getAllocatedVirtualCores() /
>   getClusterResource().getVirtualCores()));
> }
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

[jira] [Updated] (YARN-8059) Resource type is ignored when FS decide to preempt

2018-10-02 Thread Szilard Nemeth (JIRA) 


 [ 
https://issues.apache.org/jira/browse/YARN-8059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Szilard Nemeth updated YARN-8059:
-
Attachment: YARN-8059.002.patch

> Resource type is ignored when FS decide to preempt
> --
>
> Key: YARN-8059
> URL: https://issues.apache.org/jira/browse/YARN-8059
> Project: Hadoop YARN
>  Issue Type: Bug
>  Components: fairscheduler
>Affects Versions: 3.0.0
>Reporter: Yufei Gu
>Assignee: Szilard Nemeth
>Priority: Major
> Attachments: YARN-8059.001.patch, YARN-8059.002.patch
>
>
> Method Fairscheduler#shouldAttemptPreemption doesn't consider resources other 
> than vcore and memory. We may need to rethink it in the resource type 
> scenario. cc [~miklos.szeg...@cloudera.com], [~wilfreds] and [~snemeth].
> {code}
> if (context.isPreemptionEnabled()) {
>   return (context.getPreemptionUtilizationThreshold() < Math.max(
>   (float) rootMetrics.getAllocatedMB() /
>   getClusterResource().getMemorySize(),
>   (float) rootMetrics.getAllocatedVirtualCores() /
>   getClusterResource().getVirtualCores()));
> }
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

[jira] [Updated] (YARN-8059) Resource type is ignored when FS decide to preempt

2018-09-16 Thread Szilard Nemeth (JIRA) 


 [ 
https://issues.apache.org/jira/browse/YARN-8059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Szilard Nemeth updated YARN-8059:
-
Attachment: YARN-8059.001.patch

> Resource type is ignored when FS decide to preempt
> --
>
> Key: YARN-8059
> URL: https://issues.apache.org/jira/browse/YARN-8059
> Project: Hadoop YARN
>  Issue Type: Bug
>  Components: fairscheduler
>Affects Versions: 3.0.0
>Reporter: Yufei Gu
>Assignee: Szilard Nemeth
>Priority: Major
> Attachments: YARN-8059.001.patch
>
>
> Method Fairscheduler#shouldAttemptPreemption doesn't consider resources other 
> than vcore and memory. We may need to rethink it in the resource type 
> scenario. cc [~miklos.szeg...@cloudera.com], [~wilfreds] and [~snemeth].
> {code}
> if (context.isPreemptionEnabled()) {
>   return (context.getPreemptionUtilizationThreshold() < Math.max(
>   (float) rootMetrics.getAllocatedMB() /
>   getClusterResource().getMemorySize(),
>   (float) rootMetrics.getAllocatedVirtualCores() /
>   getClusterResource().getVirtualCores()));
> }
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

[jira] [Updated] (YARN-8059) Resource type is ignored when FS decide to preempt

2018-03-21 Thread Yufei Gu (JIRA) 

 [ 
https://issues.apache.org/jira/browse/YARN-8059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yufei Gu updated YARN-8059:
---
Description: 
Method Fairscheduler#shouldAttemptPreemption doesn't consider resources other 
than vcore and memory. We may need to rethink it in the resource type scenario. 
cc [~miklos.szeg...@cloudera.com], [~wilfreds] and [~snemeth].
{code}
if (context.isPreemptionEnabled()) {
  return (context.getPreemptionUtilizationThreshold() < Math.max(
  (float) rootMetrics.getAllocatedMB() /
  getClusterResource().getMemorySize(),
  (float) rootMetrics.getAllocatedVirtualCores() /
  getClusterResource().getVirtualCores()));
}
{code}


  was:
Method Fairscheduler#shouldAttemptPreemption doesn't consider resources other 
than vcore and memory. We may need to rethink it in the resource type scenario. 
cc [~miklos.szeg...@cloudera.com] and [~wilfreds].
{code}
if (context.isPreemptionEnabled()) {
  return (context.getPreemptionUtilizationThreshold() < Math.max(
  (float) rootMetrics.getAllocatedMB() /
  getClusterResource().getMemorySize(),
  (float) rootMetrics.getAllocatedVirtualCores() /
  getClusterResource().getVirtualCores()));
}
{code}



> Resource type is ignored when FS decide to preempt
> --
>
> Key: YARN-8059
> URL: https://issues.apache.org/jira/browse/YARN-8059
> Project: Hadoop YARN
>  Issue Type: Bug
>  Components: fairscheduler
>Affects Versions: 3.0.0
>Reporter: Yufei Gu
>Priority: Major
>
> Method Fairscheduler#shouldAttemptPreemption doesn't consider resources other 
> than vcore and memory. We may need to rethink it in the resource type 
> scenario. cc [~miklos.szeg...@cloudera.com], [~wilfreds] and [~snemeth].
> {code}
> if (context.isPreemptionEnabled()) {
>   return (context.getPreemptionUtilizationThreshold() < Math.max(
>   (float) rootMetrics.getAllocatedMB() /
>   getClusterResource().getMemorySize(),
>   (float) rootMetrics.getAllocatedVirtualCores() /
>   getClusterResource().getVirtualCores()));
> }
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

[jira] [Updated] (YARN-8059) Resource type is ignored when FS decide to preempt

2018-03-21 Thread Yufei Gu (JIRA) 

 [ 
https://issues.apache.org/jira/browse/YARN-8059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yufei Gu updated YARN-8059:
---
Description: 
Method Fairscheduler#shouldAttemptPreemption doesn't consider resources other 
than vcore and memory. We may need to rethink it in the resource type scenario. 
cc [~miklos.szeg...@cloudera.com] and [~wilfreds].
{code}
if (context.isPreemptionEnabled()) {
  return (context.getPreemptionUtilizationThreshold() < Math.max(
  (float) rootMetrics.getAllocatedMB() /
  getClusterResource().getMemorySize(),
  (float) rootMetrics.getAllocatedVirtualCores() /
  getClusterResource().getVirtualCores()));
}
{code}


  was:
Method Fairscheduler#shouldAttemptPreemption doesn't consider resources other 
than vcore and memory. We may need to rethink it in the resource type scenario.
{code}
if (context.isPreemptionEnabled()) {
  return (context.getPreemptionUtilizationThreshold() < Math.max(
  (float) rootMetrics.getAllocatedMB() /
  getClusterResource().getMemorySize(),
  (float) rootMetrics.getAllocatedVirtualCores() /
  getClusterResource().getVirtualCores()));
}
{code}



> Resource type is ignored when FS decide to preempt
> --
>
> Key: YARN-8059
> URL: https://issues.apache.org/jira/browse/YARN-8059
> Project: Hadoop YARN
>  Issue Type: Bug
>  Components: fairscheduler
>Affects Versions: 3.0.0
>Reporter: Yufei Gu
>Priority: Major
>
> Method Fairscheduler#shouldAttemptPreemption doesn't consider resources other 
> than vcore and memory. We may need to rethink it in the resource type 
> scenario. cc [~miklos.szeg...@cloudera.com] and [~wilfreds].
> {code}
> if (context.isPreemptionEnabled()) {
>   return (context.getPreemptionUtilizationThreshold() < Math.max(
>   (float) rootMetrics.getAllocatedMB() /
>   getClusterResource().getMemorySize(),
>   (float) rootMetrics.getAllocatedVirtualCores() /
>   getClusterResource().getVirtualCores()));
> }
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

[jira] [Updated] (YARN-8059) Resource type is ignored when FS decide to preempt

2018-03-21 Thread Yufei Gu (JIRA) 

 [ 
https://issues.apache.org/jira/browse/YARN-8059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yufei Gu updated YARN-8059:
---
Description: 
Method Fairscheduler#shouldAttemptPreemption doesn't consider resources other 
than vcore and memory. We may need to rethink it in the resource type scenario.
{code}
if (context.isPreemptionEnabled()) {
  return (context.getPreemptionUtilizationThreshold() < Math.max(
  (float) rootMetrics.getAllocatedMB() /
  getClusterResource().getMemorySize(),
  (float) rootMetrics.getAllocatedVirtualCores() /
  getClusterResource().getVirtualCores()));
}
{code}


  was:
Method Fairscheduler#shouldAttemptPreemption doesn't consider resources other 
than vcore and memory. We may need to rethink it.
{code}
if (context.isPreemptionEnabled()) {
  return (context.getPreemptionUtilizationThreshold() < Math.max(
  (float) rootMetrics.getAllocatedMB() /
  getClusterResource().getMemorySize(),
  (float) rootMetrics.getAllocatedVirtualCores() /
  getClusterResource().getVirtualCores()));
}
{code}



> Resource type is ignored when FS decide to preempt
> --
>
> Key: YARN-8059
> URL: https://issues.apache.org/jira/browse/YARN-8059
> Project: Hadoop YARN
>  Issue Type: Bug
>  Components: fairscheduler
>Affects Versions: 3.0.0
>Reporter: Yufei Gu
>Priority: Major
>
> Method Fairscheduler#shouldAttemptPreemption doesn't consider resources other 
> than vcore and memory. We may need to rethink it in the resource type 
> scenario.
> {code}
> if (context.isPreemptionEnabled()) {
>   return (context.getPreemptionUtilizationThreshold() < Math.max(
>   (float) rootMetrics.getAllocatedMB() /
>   getClusterResource().getMemorySize(),
>   (float) rootMetrics.getAllocatedVirtualCores() /
>   getClusterResource().getVirtualCores()));
> }
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org