Github user mgaido91 commented on a diff in the pull request:
https://github.com/apache/spark/pull/21563#discussion_r195389157
--- Diff:
mllib/src/main/scala/org/apache/spark/ml/evaluation/ClusteringEvaluator.scala
---
@@ -107,15 +106,18 @@ class ClusteringEvaluator @Since("2.3.0")
(@Since("2.3.0") override val uid: Str
@Since("2.3.0")
override def evaluate(dataset: Dataset[_]): Double = {
- SchemaUtils.checkColumnType(dataset.schema, $(featuresCol), new
VectorUDT)
+ SchemaUtils.validateVectorCompatibleColumn(dataset.schema,
$(featuresCol))
SchemaUtils.checkNumericType(dataset.schema, $(predictionCol))
+ val vectorCol = DatasetUtils.columnToVector(dataset, $(featuresCol))
+ val df = dataset.select(col($(predictionCol)),
--- End diff --
not sure this is the right way. Probably we can face the same issue
everywhere we are using `DatasetUtils.columnToVector`. Probably it is better to
fix the problem there.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
