[ 
https://issues.apache.org/jira/browse/TOREE-376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jakob Odersky resolved TOREE-376.
---------------------------------
    Resolution: Fixed

Merged, thanks!

> Scala interpreter should make Spark SQL implicits available
> -----------------------------------------------------------
>
>                 Key: TOREE-376
>                 URL: https://issues.apache.org/jira/browse/TOREE-376
>             Project: TOREE
>          Issue Type: Improvement
>            Reporter: Ryan Blue
>
> The scala interpreter doesn't define Spark SQL functions or implicits that 
> are commonly used and available by default in Spark's shell.
> Relevant test cases:
> {code}
> scala> val c = $"test"
> c: org.apache.spark.sql.ColumnName = test
> scala> val df = Seq((1, "a"), (2, "b")).toDF("id", "data")
> df: org.apache.spark.sql.DataFrame = [id: int, data: string]
> scala> df.withColumn("m", map(lit("id"), $"id")).printSchema
> root
>  |-- id: integer (nullable = false)
>  |-- data: string (nullable = true)
>  |-- m: map (nullable = false)
>  |    |-- key: string
>  |    |-- value: integer (valueContainsNull = false)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Reply via email to