[
https://issues.apache.org/jira/browse/HIVE-13586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15256664#comment-15256664
]
Ashutosh Chauhan commented on HIVE-13586:
-----------------------------------------
I wonder instead of adding new flag whether can we try to solve issues you
outlined above. For udf:
* We can check for values of getRequiredFiles() & getRequiredJars() to
determine whether they may need those.
* For configure, we can manufacture MapRedContext for local task to solve that.
For UDTF also its a matter of fixing lifecycle of close() Also, without fixing
that we can't enable local fetch task conversion for UDTF even when proposed
flag says so.
> Allow UDFs/UDTFs to indicate whether they can run with fetch task conversion
> ----------------------------------------------------------------------------
>
> Key: HIVE-13586
> URL: https://issues.apache.org/jira/browse/HIVE-13586
> Project: Hive
> Issue Type: Improvement
> Components: UDF
> Reporter: Jason Dere
> Assignee: Jason Dere
> Attachments: HIVE-13586.1.patch
>
>
> Some UDFs/UDTFs cannot run properly with fetch task conversion.
> For UDFs:
> - The UDF may be depending on files/archives added to the distributed cache,
> which may not be available in the local fetch task.
> - The UDF may be depending on GenericUDF.configure() to be called - this is
> not called for locally run UDFs.
> For UDTFs, one issue is HIVE-11892.
> A bit of a workaround, but for such UDFs/UDTFs we can have a flag to indicate
> whether the UDF should be allowed to run in a local fetch task.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
