[
https://issues.apache.org/jira/browse/MAHOUT-1785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14994610#comment-14994610
]
ASF GitHub Bot commented on MAHOUT-1785:
----------------------------------------
Github user pferrel commented on a diff in the pull request:
https://github.com/apache/mahout/pull/175#discussion_r44196191
--- Diff:
spark/src/main/scala/org/apache/mahout/drivers/MahoutSparkDriver.scala ---
@@ -76,6 +76,10 @@ abstract class MahoutSparkDriver extends MahoutDriver {
if (!_useExistingContext) {
sparkConf.set("spark.kryo.referenceTracking", "false")
.set("spark.kryoserializer.buffer.mb", "200")// this is default
for Mahout optimizer, change it with -D option
+ // the previous has been marked deprecated as of Spark 1.4 by the
below line,
+ // remove the above line when Spark finally retires above for below
+ .set("spark.kryoserializer.buffer", "200")
+
--- End diff --
I think you have to put the units in the string
.set("spark.kryoserializer.buffer", "200m")
would be the equivalen iirc
> Replace 'spark.kryoserializer.buffer.mb' from Spark config
> ----------------------------------------------------------
>
> Key: MAHOUT-1785
> URL: https://issues.apache.org/jira/browse/MAHOUT-1785
> Project: Mahout
> Issue Type: Improvement
> Components: Mahout spark shell
> Affects Versions: 0.11.0
> Reporter: Suneel Marthi
> Assignee: Suneel Marthi
> Priority: Trivial
> Fix For: 0.12.0
>
>
> 'spark.kryoserializer.buffer.mb' has been deprecated as of spark 1.4 and
> should be replaced by 'spark.kryoserializer.buffer'
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
