[
https://issues.apache.org/jira/browse/PIG-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16021051#comment-16021051
]
Nandor Kollar commented on PIG-5157:
------------------------------------
[~kellyzly] what you think, should we try Spark's DataFrames or DataSets API? I
read a couple of blog posts, and the optimizations offered (project Tungsten
and Catalyst optimizer) looks promising, however it seems that it is build
around Java beans, not sure if this fits well into our generic Tuple-based data
model.
> Upgrade to Spark 2.0
> --------------------
>
> Key: PIG-5157
> URL: https://issues.apache.org/jira/browse/PIG-5157
> Project: Pig
> Issue Type: Improvement
> Components: spark
> Reporter: Nandor Kollar
> Assignee: Nandor Kollar
> Fix For: 0.18.0
>
>
> Upgrade to Spark 2.0 (or latest)
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
