Github user marmbrus commented on the pull request:
https://github.com/apache/spark/pull/5713#issuecomment-153310325
Hey, I'm really sorry for letting this sit so long. I got wrapped up
trying to get ready for Spark 1.6. It would be great if you can look at
[SPARK-9999](https://issues.apache.org/jira/browse/SPARK-9999), which adds a
new method `.as[Type]` to a `DataFrame`, which converts it to typed `Dataset`.
The design doc attached to the JIRA explains more, but I think it accomplishes
a lot of what you are both trying to do. As an added bonus, it also supports
typed tuples and uses codegen under the covers for performance. Would love to
get some more people looking at the API and testing it out.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
