[
https://issues.apache.org/jira/browse/PIG-5080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16091225#comment-16091225
]
Jeff Zhang commented on PIG-5080:
---------------------------------
[~kellyzly] I linked ZEPPELIN-2232 with this ticket. The purpose and benefit is
to allow user combine the advantage of both pig-latin and sql. Pig-latin is
suitable for data processing while sql is suitable for ad-hoc query. E.g. user
may write a long pig script to convert a raw data to clean data, and then store
it in spark table. After that he can use sql to query the data and then
visualize the result.
> Support store alias as spark table
> ----------------------------------
>
> Key: PIG-5080
> URL: https://issues.apache.org/jira/browse/PIG-5080
> Project: Pig
> Issue Type: New Feature
> Components: spark
> Affects Versions: 0.16.0
> Reporter: Jeff Zhang
> Assignee: Jeff Zhang
> Fix For: 0.17.1
>
> Attachments: PIG-5080-1.patch, PIG-5080-2.patch
>
>
> The purpose is that I'd like to take advantage of both pig and hive.
> Pig-latin has powerful data flow expression ability which is useful for ETL
> while hive is good at query.
> The scenario is that I'd like to store pig alias as spark temporary table
> (cache can be optional). And I have an another spark engine which share the
> same SparkContext (in the same JVM) to query the table.
> Please close this ticket if it is already supported. I didn't go through all
> the features of pig-spark.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
