Daniel Darabos created SPARK-2095:
-------------------------------------
Summary: sc.getExecutorCPUCounts()
Key: SPARK-2095
URL: https://issues.apache.org/jira/browse/SPARK-2095
Project: Spark
Issue Type: New Feature
Components: Spark Core
Reporter: Daniel Darabos
Priority: Minor
We can get the amount of total and free memory (via getExecutorMemoryStatus)
and blocks stored (via getExecutorStorageStatus) on the executors. I would also
like to be able to query the available CPU per executor. This would be useful
in dynamically deciding the number of partitions at the start of an operation.
What do you think?
--
This message was sent by Atlassian JIRA
(v6.2#6252)
