[jira] [Updated] (YARN-9096) Some GpuResourcePlugin and ResourcePluginManager methods are synchronized unnecessarily

2019-08-09 Thread Szilard Nemeth (JIRA) 


 [ 
https://issues.apache.org/jira/browse/YARN-9096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Szilard Nemeth updated YARN-9096:
-
Fix Version/s: 3.1.3
   3.2.1
   3.3.0

> Some GpuResourcePlugin and ResourcePluginManager methods are synchronized 
> unnecessarily
> ---
>
> Key: YARN-9096
> URL: https://issues.apache.org/jira/browse/YARN-9096
> Project: Hadoop YARN
>  Issue Type: Improvement
>Reporter: Szilard Nemeth
>Assignee: Gergely Pollak
>Priority: Major
> Fix For: 3.3.0, 3.2.1, 3.1.3
>
> Attachments: YARN-9096.001.patch, YARN-9096.002.patch, 
> YARN-9096.002.patch
>
>
> These methods are not used concurrently, they are part of the initialization 
> code of NM that happens from one thread.
> This is the list of the call hierarchies: 
> 1. GpuResourcePlugin.initialize + ResourcePluginManager.initialize
>  
> {code:java}
> GpuResourcePlugin.initialize(Context) 
> (org.apache.hadoop.yarn.server.nodemanager.containermanager.resourceplugin.gpu)
>  ResourcePluginManager.initialize(Context) 
> (org.apache.hadoop.yarn.server.nodemanager.containermanager.resourceplugin) 
> NodeManager.serviceInit(Configuration) 
> (org.apache.hadoop.yarn.server.nodemanager){code}
>  
>  
> 2. GpuResourcePlugin.createResourceHandler: 
>  
> {code:java}
> GpuResourcePlugin.createResourceHandler(Context, CGroupsHandler, 
> PrivilegedOperationExecutor) 
> (org.apache.hadoop.yarn.server.nodemanager.containermanager.resourceplugin.gpu)
>  ResourceHandlerModule.addHandlersFromConfiguredResourcePlugins(List, 
> Configuration, Context) 
> (org.apache.hadoop.yarn.server.nodemanager.containermanager.linux.resources) 
> ResourceHandlerModule.initializeConfiguredResourceHandlerChain(Configuration, 
> Context) 
> (org.apache.hadoop.yarn.server.nodemanager.containermanager.linux.resources) 
> ResourceHandlerModule.getConfiguredResourceHandlerChain(Configuration, 
> Context) 
> (org.apache.hadoop.yarn.server.nodemanager.containermanager.linux.resources) 
> ContainerScheduler.serviceInit(Configuration) 
> (org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler) 
> LinuxContainerExecutor.init(Context) 
> (org.apache.hadoop.yarn.server.nodemanager)
> {code}
>  
> 3. GpuResourcePlugin.getNodeResourceHandlerInstance: 
>  
> {code:java}
> GpuResourcePlugin.getNodeResourceHandlerInstance() 
> (org.apache.hadoop.yarn.server.nodemanager.containermanager.resourceplugin.gpu)
> NodeStatusUpdaterImpl.updateConfiguredResourcesViaPlugins(Resource)(2 usages) 
> (org.apache.hadoop.yarn.server.nodemanager)
> NodeStatusUpdaterImpl.serviceInit(Configuration) 
> (org.apache.hadoop.yarn.server.nodemanager)
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

[jira] [Updated] (YARN-9096) Some GpuResourcePlugin and ResourcePluginManager methods are synchronized unnecessarily

2019-08-05 Thread Adam Antal (JIRA) 


 [ 
https://issues.apache.org/jira/browse/YARN-9096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Antal updated YARN-9096:
-
Attachment: YARN-9096.002.patch

> Some GpuResourcePlugin and ResourcePluginManager methods are synchronized 
> unnecessarily
> ---
>
> Key: YARN-9096
> URL: https://issues.apache.org/jira/browse/YARN-9096
> Project: Hadoop YARN
>  Issue Type: Improvement
>Reporter: Szilard Nemeth
>Assignee: Gergely Pollak
>Priority: Major
> Attachments: YARN-9096.001.patch, YARN-9096.002.patch, 
> YARN-9096.002.patch
>
>
> These methods are not used concurrently, they are part of the initialization 
> code of NM that happens from one thread.
> This is the list of the call hierarchies: 
> 1. GpuResourcePlugin.initialize + ResourcePluginManager.initialize
>  
> {code:java}
> GpuResourcePlugin.initialize(Context) 
> (org.apache.hadoop.yarn.server.nodemanager.containermanager.resourceplugin.gpu)
>  ResourcePluginManager.initialize(Context) 
> (org.apache.hadoop.yarn.server.nodemanager.containermanager.resourceplugin) 
> NodeManager.serviceInit(Configuration) 
> (org.apache.hadoop.yarn.server.nodemanager){code}
>  
>  
> 2. GpuResourcePlugin.createResourceHandler: 
>  
> {code:java}
> GpuResourcePlugin.createResourceHandler(Context, CGroupsHandler, 
> PrivilegedOperationExecutor) 
> (org.apache.hadoop.yarn.server.nodemanager.containermanager.resourceplugin.gpu)
>  ResourceHandlerModule.addHandlersFromConfiguredResourcePlugins(List, 
> Configuration, Context) 
> (org.apache.hadoop.yarn.server.nodemanager.containermanager.linux.resources) 
> ResourceHandlerModule.initializeConfiguredResourceHandlerChain(Configuration, 
> Context) 
> (org.apache.hadoop.yarn.server.nodemanager.containermanager.linux.resources) 
> ResourceHandlerModule.getConfiguredResourceHandlerChain(Configuration, 
> Context) 
> (org.apache.hadoop.yarn.server.nodemanager.containermanager.linux.resources) 
> ContainerScheduler.serviceInit(Configuration) 
> (org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler) 
> LinuxContainerExecutor.init(Context) 
> (org.apache.hadoop.yarn.server.nodemanager)
> {code}
>  
> 3. GpuResourcePlugin.getNodeResourceHandlerInstance: 
>  
> {code:java}
> GpuResourcePlugin.getNodeResourceHandlerInstance() 
> (org.apache.hadoop.yarn.server.nodemanager.containermanager.resourceplugin.gpu)
> NodeStatusUpdaterImpl.updateConfiguredResourcesViaPlugins(Resource)(2 usages) 
> (org.apache.hadoop.yarn.server.nodemanager)
> NodeStatusUpdaterImpl.serviceInit(Configuration) 
> (org.apache.hadoop.yarn.server.nodemanager)
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

[jira] [Updated] (YARN-9096) Some GpuResourcePlugin and ResourcePluginManager methods are synchronized unnecessarily

2019-04-05 Thread Szilard Nemeth (JIRA) 


 [ 
https://issues.apache.org/jira/browse/YARN-9096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Szilard Nemeth updated YARN-9096:
-
Attachment: YARN-9096.002.patch

> Some GpuResourcePlugin and ResourcePluginManager methods are synchronized 
> unnecessarily
> ---
>
> Key: YARN-9096
> URL: https://issues.apache.org/jira/browse/YARN-9096
> Project: Hadoop YARN
>  Issue Type: Improvement
>Reporter: Szilard Nemeth
>Assignee: Szilard Nemeth
>Priority: Major
> Attachments: YARN-9096.001.patch, YARN-9096.002.patch
>
>
> These methods are not used concurrently, they are part of the initialization 
> code of NM that happens from one thread.
> This is the list of the call hierarchies: 
> 1. GpuResourcePlugin.initialize + ResourcePluginManager.initialize
>  
> {code:java}
> GpuResourcePlugin.initialize(Context) 
> (org.apache.hadoop.yarn.server.nodemanager.containermanager.resourceplugin.gpu)
>  ResourcePluginManager.initialize(Context) 
> (org.apache.hadoop.yarn.server.nodemanager.containermanager.resourceplugin) 
> NodeManager.serviceInit(Configuration) 
> (org.apache.hadoop.yarn.server.nodemanager){code}
>  
>  
> 2. GpuResourcePlugin.createResourceHandler: 
>  
> {code:java}
> GpuResourcePlugin.createResourceHandler(Context, CGroupsHandler, 
> PrivilegedOperationExecutor) 
> (org.apache.hadoop.yarn.server.nodemanager.containermanager.resourceplugin.gpu)
>  ResourceHandlerModule.addHandlersFromConfiguredResourcePlugins(List, 
> Configuration, Context) 
> (org.apache.hadoop.yarn.server.nodemanager.containermanager.linux.resources) 
> ResourceHandlerModule.initializeConfiguredResourceHandlerChain(Configuration, 
> Context) 
> (org.apache.hadoop.yarn.server.nodemanager.containermanager.linux.resources) 
> ResourceHandlerModule.getConfiguredResourceHandlerChain(Configuration, 
> Context) 
> (org.apache.hadoop.yarn.server.nodemanager.containermanager.linux.resources) 
> ContainerScheduler.serviceInit(Configuration) 
> (org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler) 
> LinuxContainerExecutor.init(Context) 
> (org.apache.hadoop.yarn.server.nodemanager)
> {code}
>  
> 3. GpuResourcePlugin.getNodeResourceHandlerInstance: 
>  
> {code:java}
> GpuResourcePlugin.getNodeResourceHandlerInstance() 
> (org.apache.hadoop.yarn.server.nodemanager.containermanager.resourceplugin.gpu)
> NodeStatusUpdaterImpl.updateConfiguredResourcesViaPlugins(Resource)(2 usages) 
> (org.apache.hadoop.yarn.server.nodemanager)
> NodeStatusUpdaterImpl.serviceInit(Configuration) 
> (org.apache.hadoop.yarn.server.nodemanager)
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

[jira] [Updated] (YARN-9096) Some GpuResourcePlugin and ResourcePluginManager methods are synchronized unnecessarily

2018-12-08 Thread Szilard Nemeth (JIRA) 


 [ 
https://issues.apache.org/jira/browse/YARN-9096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Szilard Nemeth updated YARN-9096:
-
Attachment: YARN-9096.001.patch

> Some GpuResourcePlugin and ResourcePluginManager methods are synchronized 
> unnecessarily
> ---
>
> Key: YARN-9096
> URL: https://issues.apache.org/jira/browse/YARN-9096
> Project: Hadoop YARN
>  Issue Type: Improvement
>Reporter: Szilard Nemeth
>Assignee: Szilard Nemeth
>Priority: Major
> Attachments: YARN-9096.001.patch
>
>
> These methods are not used concurrently, they are part of the initialization 
> code of NM that happens from one thread.
> This is the list of the call hierarchies: 
> 1. GpuResourcePlugin.initialize + ResourcePluginManager.initialize
>  
> {code:java}
> GpuResourcePlugin.initialize(Context) 
> (org.apache.hadoop.yarn.server.nodemanager.containermanager.resourceplugin.gpu)
>  ResourcePluginManager.initialize(Context) 
> (org.apache.hadoop.yarn.server.nodemanager.containermanager.resourceplugin) 
> NodeManager.serviceInit(Configuration) 
> (org.apache.hadoop.yarn.server.nodemanager){code}
>  
>  
> 2. GpuResourcePlugin.createResourceHandler: 
>  
> {code:java}
> GpuResourcePlugin.createResourceHandler(Context, CGroupsHandler, 
> PrivilegedOperationExecutor) 
> (org.apache.hadoop.yarn.server.nodemanager.containermanager.resourceplugin.gpu)
>  ResourceHandlerModule.addHandlersFromConfiguredResourcePlugins(List, 
> Configuration, Context) 
> (org.apache.hadoop.yarn.server.nodemanager.containermanager.linux.resources) 
> ResourceHandlerModule.initializeConfiguredResourceHandlerChain(Configuration, 
> Context) 
> (org.apache.hadoop.yarn.server.nodemanager.containermanager.linux.resources) 
> ResourceHandlerModule.getConfiguredResourceHandlerChain(Configuration, 
> Context) 
> (org.apache.hadoop.yarn.server.nodemanager.containermanager.linux.resources) 
> ContainerScheduler.serviceInit(Configuration) 
> (org.apache.hadoop.yarn.server.nodemanager.containermanager.scheduler) 
> LinuxContainerExecutor.init(Context) 
> (org.apache.hadoop.yarn.server.nodemanager)
> {code}
>  
> 3. GpuResourcePlugin.getNodeResourceHandlerInstance: 
>  
> {code:java}
> GpuResourcePlugin.getNodeResourceHandlerInstance() 
> (org.apache.hadoop.yarn.server.nodemanager.containermanager.resourceplugin.gpu)
> NodeStatusUpdaterImpl.updateConfiguredResourcesViaPlugins(Resource)(2 usages) 
> (org.apache.hadoop.yarn.server.nodemanager)
> NodeStatusUpdaterImpl.serviceInit(Configuration) 
> (org.apache.hadoop.yarn.server.nodemanager)
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org