Oleksiy Dyagilev created SPARK-8525:
---------------------------------------

             Summary: Bug in Streaming k-means documentation
                 Key: SPARK-8525
                 URL: https://issues.apache.org/jira/browse/SPARK-8525
             Project: Spark
          Issue Type: Bug
          Components: Documentation, MLlib
    Affects Versions: 1.4.0
            Reporter: Oleksiy Dyagilev
            Priority: Critical


The expected input format is wrong in Streaming K-means documentation.
https://spark.apache.org/docs/latest/mllib-clustering.html#streaming-k-means

There shouldn't be any spaces in test data points. I.e. instead of 
(y, [x1, x2, x3]) it should be
(y,[x1,x2,x3])

The exception thrown 
org.apache.spark.SparkException: Cannot parse a double from:  
        at 
org.apache.spark.mllib.util.NumericParser$.parseDouble(NumericParser.scala:118)
        at 
org.apache.spark.mllib.util.NumericParser$.parseTuple(NumericParser.scala:103)
        at 
org.apache.spark.mllib.util.NumericParser$.parse(NumericParser.scala:41)
        at 
org.apache.spark.mllib.regression.LabeledPoint$.parse(LabeledPoint.scala:49)



Also I would improve documentation saying explicitly that expected data types 
for both 'x' and 'y' is Double. At the moment it's not obvious especially for 
'y'. 





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to