Ryan Blue created TOREE-376:
-------------------------------
Summary: Scala interpreter should make Spark SQL implicits
available
Key: TOREE-376
URL: https://issues.apache.org/jira/browse/TOREE-376
Project: TOREE
Issue Type: Improvement
Reporter: Ryan Blue
The scala interpreter doesn't define Spark SQL functions or implicits that are
commonly used and available by default in Spark's shell.
Relevant test cases:
{code}
scala> val c = $"test"
c: org.apache.spark.sql.ColumnName = test
scala> val df = Seq((1, "a"), (2, "b")).toDF("id", "data")
df: org.apache.spark.sql.DataFrame = [id: int, data: string]
scala> df.withColumn("m", map(lit("id"), $"id")).printSchema
root
|-- id: integer (nullable = false)
|-- data: string (nullable = true)
|-- m: map (nullable = false)
| |-- key: string
| |-- value: integer (valueContainsNull = false)
{code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
