[
https://issues.apache.org/jira/browse/SPARK-13485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin updated SPARK-13485:
--------------------------------
Description:
As part of Spark 2.0, we want to create a stable API foundation for Dataset to
become the main user-facing API in Spark. This ticket tracks various tasks
related to that.
The main high level changes are:
1. Merge Dataset/DataFrame
2. Create a more natural entry point for Dataset (SQLContext/HiveContext are
not ideal because of the name "SQL"/"Hive", and "SparkContext" is not ideal
because of its heavy dependency on RDDs)
3. First class support for sessions
4. First class support for some system catalog
See the design doc for more details.
was:
As part of Spark 2.0, we want to create a stable API foundation for Dataset to
become the main user-facing API in Spark. This ticket tracks various tasks
related to that.
The main high level changes are:
1. Merge Dataset/DataFrame
2. Create a more natural entry point for Dataset (SQLContext is not ideal
because of the name "SQL")
3. First class support for sessions
4. First class support for some system catalog
See the design doc for more details.
> (Dataset-oriented) API evolution in Spark 2.0
> ---------------------------------------------
>
> Key: SPARK-13485
> URL: https://issues.apache.org/jira/browse/SPARK-13485
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Reporter: Reynold Xin
> Assignee: Reynold Xin
> Attachments: API Evolution in Spark 2.0.pdf
>
>
> As part of Spark 2.0, we want to create a stable API foundation for Dataset
> to become the main user-facing API in Spark. This ticket tracks various tasks
> related to that.
> The main high level changes are:
> 1. Merge Dataset/DataFrame
> 2. Create a more natural entry point for Dataset (SQLContext/HiveContext are
> not ideal because of the name "SQL"/"Hive", and "SparkContext" is not ideal
> because of its heavy dependency on RDDs)
> 3. First class support for sessions
> 4. First class support for some system catalog
> See the design doc for more details.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
