[
https://issues.apache.org/jira/browse/PIG-928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12841033#action_12841033
]
Ashutosh Chauhan commented on PIG-928:
--------------------------------------
@Prasen
bq. can we not implement it along the lines of DEFINE commands.
Ya, this functionality could be partially simulated using DEFINE / Streaming
combination. But that may not be most efficient way to achieve it. First of
all, streaming script would be run in a separate process (as oppose to same
JVM in approaches discussed above) so there will be CPU cost involved in
getting data in and out of from java process to stream script process. Then,
there is a cost of serialization and deserialization of parameters. You loose
all the type information of the parameters. Once you are in same runtime you
can start doing interesting things. Also, having scripts in define statements
will get kludgy soon as one you start to do complicated things there.
bq. no need to include scripting-specific jars (jython etc.)
Do you mean Include in pig distribution or in pig's classpath at runtime ? In
either case that may not necessarily a problem. For first part, we can use ivy
to pull the jars for us instead of including in distribution and for second
part we can ship all the jars required by Pig to compute nodes.
> UDFs in scripting languages
> ---------------------------
>
> Key: PIG-928
> URL: https://issues.apache.org/jira/browse/PIG-928
> Project: Pig
> Issue Type: New Feature
> Reporter: Alan Gates
> Attachments: package.zip, scripting.tgz, scripting.tgz
>
>
> It should be possible to write UDFs in scripting languages such as python,
> ruby, etc. This frees users from needing to compile Java, generate a jar,
> etc. It also opens Pig to programmers who prefer scripting languages over
> Java.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
