Reynold Xin created SPARK-5193:
----------------------------------
Summary: Make Spark SQL API usable in Java and remove the
Java-specific API
Key: SPARK-5193
URL: https://issues.apache.org/jira/browse/SPARK-5193
Project: Spark
Issue Type: Sub-task
Components: SQL
Reporter: Reynold Xin
Assignee: Reynold Xin
Java version of the SchemaRDD API causes high maintenance burden for Spark SQL
itself and downstream libraries (e.g. MLlib pipeline API needs to support both
JavaSchemaRDD and SchemaRDD). We can audit the Scala API and make it usable for
Java, and then we can remove the Java specific version.
Things to remove include (Java version of):
- data type
- Row
- SQLContext
- HiveContext
Things to consider:
- Scala and Java have a different collection library.
- Scala and Java (8) have different closure interface.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
