Re: Spark SQL UDF - passing map as a UDF parameter

Thanks. I tried following versions. They both compiles: val colmap = map(idxMap.flatMap(en => Iterator(lit(en._1), lit(en._2))).toSeq: _*) val colmap = map(idxMap.flatMap(x => x._1 :: x._2 :: Nil).toSeq.map(lit _): _*) However they fail on dataframe action like `show` with org.apache.spark.Spark

Re: Spark SQL UDF - passing map as a UDF parameter

Hi, Literal cannot handle Tuple2. Anyway, how about this? val rdd = sc.makeRDD(1 to 3).map(i => (i, 0)) map(rdd.collect.flatMap(x => x._1 :: x._2 :: Nil).map(lit _): _*) // maropu On Tue, Nov 15, 2016 at 9:33 AM, Nirav Patel wrote: > I am trying to use following API from Functions to convert

Spark SQL UDF - passing map as a UDF parameter

I am trying to use following API from Functions to convert a map into column so I can pass it to UDF. map(cols: Column *): Column "Crea