Re: Convert SparseVector column to Densevector column

2016-11-14 Thread janardhan shetty
This worked thanks Maropu. On Sun, Nov 13, 2016 at 9:34 PM, Takeshi Yamamuro wrote: > Hi, > > How about this? > > import org.apache.spark.ml.linalg._ > val toSV = udf((v: Vector) => v.toDense) > val df = Seq((0.1, Vectors.sparse(16, Array(0, 3), Array(0.1, 0.3))), > (0.2,

Re: Convert SparseVector column to Densevector column

2016-11-13 Thread Takeshi Yamamuro
Hi, How about this? import org.apache.spark.ml.linalg._ val toSV = udf((v: Vector) => v.toDense) val df = Seq((0.1, Vectors.sparse(16, Array(0, 3), Array(0.1, 0.3))), (0.2, Vectors.sparse(16, Array(0, 3), Array(0.1, 0.3.toDF("a", "b") df.select(toSV($"b")) // maropu On Mon, Nov 14, 2016

Convert SparseVector column to Densevector column

2016-11-13 Thread janardhan shetty
Hi, Is there any easy way of converting a dataframe column from SparseVector to DenseVector using import org.apache.spark.ml.linalg.DenseVector API ? Spark ML 2.0