Cheng Lian created SPARK-13457:
----------------------------------
Summary: Remove DataFrame RDD operations
Key: SPARK-13457
URL: https://issues.apache.org/jira/browse/SPARK-13457
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 2.0.0
Reporter: Cheng Lian
Assignee: Cheng Lian
We'd like to remove DataFrame RDD operations like {{map}}, {{filter}}, and
{{foreach}} because:
# After making DataFrame a subclass of {{Dataset\[Row\]}}, these methods
conflicts with methods in Dataset.
# By returning RDDs, they are semantically improper.
It's trivial to remove them since they simply delegates to methods of
{{DataFrame.rdd}}.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]