[
https://issues.apache.org/jira/browse/SPARK-8525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14597798#comment-14597798
]
Oleksiy Dyagilev commented on SPARK-8525:
-----------------------------------------
Makes sense, https://github.com/apache/spark/pull/6954
> Bug in Streaming k-means documentation
> --------------------------------------
>
> Key: SPARK-8525
> URL: https://issues.apache.org/jira/browse/SPARK-8525
> Project: Spark
> Issue Type: Bug
> Components: Documentation, MLlib
> Affects Versions: 1.4.0
> Reporter: Oleksiy Dyagilev
> Priority: Minor
>
> The expected input format is wrong in Streaming K-means documentation.
> https://spark.apache.org/docs/latest/mllib-clustering.html#streaming-k-means
> It might be a bug in implementation though, not sure.
> There shouldn't be any spaces in test data points. I.e. instead of
> (y, [x1, x2, x3]) it should be
> (y,[x1,x2,x3])
> The exception thrown
> org.apache.spark.SparkException: Cannot parse a double from:
> at
> org.apache.spark.mllib.util.NumericParser$.parseDouble(NumericParser.scala:118)
> at
> org.apache.spark.mllib.util.NumericParser$.parseTuple(NumericParser.scala:103)
> at
> org.apache.spark.mllib.util.NumericParser$.parse(NumericParser.scala:41)
> at
> org.apache.spark.mllib.regression.LabeledPoint$.parse(LabeledPoint.scala:49)
> Also I would improve documentation saying explicitly that expected data types
> for both 'x' and 'y' is Double. At the moment it's not obvious especially for
> 'y'.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
