[
https://issues.apache.org/jira/browse/HIVE-1107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13291157#comment-13291157
]
Jonathan Coveney commented on HIVE-1107:
----------------------------------------
Pig committers coming out of the woodwork :)
Keren: I really like this idea in the abstract, and have talked with many
people about it. It's on everyone's mind.
That said, I agree completely with dmitriy. Proving that you can pipe one
random unified operator through Pig and Hive isn't going to prove very much.
The hard part is going to be creating a system generic enough to handle the
diverse object models, extension API's (UDF's, load funcs, etc), as well as the
act of decoupling highly pig or hive specific code from their respective
logical plans. Obviously if you just do a "load + foreach," it's going to be
much easier than building a system that can handle the extensibility people
count on.
Godspeed. I'll definitely read anything you guys propose. CC the pig listserv :)
> Generic parallel execution framework for Hive (and Pig, and ...)
> ----------------------------------------------------------------
>
> Key: HIVE-1107
> URL: https://issues.apache.org/jira/browse/HIVE-1107
> Project: Hive
> Issue Type: New Feature
> Components: Query Processor
> Reporter: Carl Steinbach
>
> Pig and Hive each have their own libraries for handling plan execution. As we
> prepare to invest more time improving Hive's plan execution mechanism we
> should also start to consider ways of building a generic plan execution
> mechanism that is capable of supporting the needs of Hive and Pig, as well as
> other Hadoop data flow programming environments.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
