[
https://issues.apache.org/jira/browse/HIVE-1781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Namit Jain updated HIVE-1781:
-----------------------------
Status: Patch Available (was: Open)
> outputs not populated for dynamic partitions at compile time
> ------------------------------------------------------------
>
> Key: HIVE-1781
> URL: https://issues.apache.org/jira/browse/HIVE-1781
> Project: Hive
> Issue Type: Bug
> Reporter: Namit Jain
> Assignee: Namit Jain
> Attachments: hive.1781.1.patch
>
>
> OSTHOOK: query: create table tstsrcpart like srcpart
> POSTHOOK: type: CREATETABLE
> POSTHOOK: Output: defa...@tstsrcpart
> PREHOOK: query: from srcpart
> insert overwrite table tstsrcpart partition (ds, hr) select key, value, ds,
> hr where ds <= '2008-04-08'
> PREHOOK: type: QUERY
> PREHOOK: Input: defa...@srcpart@ds=2008-04-08/hr=11
> PREHOOK: Input: defa...@srcpart@ds=2008-04-08/hr=12
> POSTHOOK: query: from srcpart
> As is evident from above, the outputs are not populated at all at compile
> time.
> This may create a problem for many components that depend on outputs:
> locking, authorization etc.
> However, the exact set of outputs may be needed for some other components
> (for example. the
> internal deployment in Facebook has a replication hook which is used for
> replication which needs the
> exact set of outputs). It may be a good idea to extend WriteEntity to
> include a flag which indicates
> whether the output is complete or not, and then the hook can look at that
> flag if needed
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
