StanZhai created SPARK-9010:
-------------------------------

             Summary: Improve the Spark Configuration document about 
`spark.kryoserializer.buffer`
                 Key: SPARK-9010
                 URL: https://issues.apache.org/jira/browse/SPARK-9010
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 1.4.0
            Reporter: StanZhai
            Priority: Minor


The meaning of spark.kryoserializer.buffer should be "Initial size of Kryo's 
serialization buffer. Note that there will be one buffer per core on each 
worker. This buffer will grow up to spark.kryoserializer.buffer.max if needed.".

The spark.kryoserializer.buffer.max.mb is out-of-date in spark 1.4.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to