Muthu Jayakumar created SPARK-12787:
---------------------------------------
Summary: Dataset to support custom encoder
Key: SPARK-12787
URL: https://issues.apache.org/jira/browse/SPARK-12787
Project: Spark
Issue Type: New Feature
Affects Versions: 1.6.0
Reporter: Muthu Jayakumar
The current Dataset API allows to be loaded using a case-class that requires
the the attribute name and types to be match up precisely.
It would be nicer, if a Partial function can be provided as a parameter to
transform the Dataframe like schema into Dataset.
Something like...
test_dataframe.as[TestCaseClass](partial_function)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
