quanfuwang created SPARK-17984:

             Summary: Add support for numa aware
                 Key: SPARK-17984
                 URL: https://issues.apache.org/jira/browse/SPARK-17984
             Project: Spark
          Issue Type: Task
          Components: Deploy, Mesos, YARN
    Affects Versions: 2.0.1
         Environment: Cluster Topo: 1 Master + 4 Slaves
CPU: Intel(R) Xeon(R) CPU E5-2699 v3 @ 2.30GHz(72 Cores)
Memory: 128GB(2 NUMA Nodes)
SW Version: Hadoop-5.7.0 + Spark-2.0.0
            Reporter: quanfuwang
             Fix For: 2.0.1

This Jira is target to add support numa aware feature which make can help 
improve performance by making core access local memory rather the remote one. 

 A patch is being developed, see https://github.com/apache/spark/pull/15524.
And the whole task includes 3 subtask and will be developed iteratively:
Numa aware support for Yarn based deployment mode
Numa aware support for Mesos based deployment mode
Numa aware support for Standalone based deployment mode

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to