[ 
https://issues.apache.org/jira/browse/PIG-3222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13619401#comment-13619401
 ] 

Daniel Dai commented on PIG-3222:
---------------------------------

I dive a little deeper, here is what I find:
1. We did set signature twice, this is due to double parse of the script. The 
behavior is not changed for a while. Actually Pig will not use the first 
signature to invoke other methods of StoreFunc (other than 
setStoreFuncUDFContextSignature)
2. Pig did connect to metastore 3 times. But I didn't see an easy way to get 
around. Pig do need to connect to metastore and load/store some metadata in 3 
different contexts. HiveMetaStoreClient does cache metastore connection, but it 
is within one JVM, which does not help in such case.

[~pengfeng], can you agree that?
                
> New UDFContextSignature assignments in Pig 0.11 breaks HCatalog.HCatStorer 
> ---------------------------------------------------------------------------
>
>                 Key: PIG-3222
>                 URL: https://issues.apache.org/jira/browse/PIG-3222
>             Project: Pig
>          Issue Type: Bug
>          Components: impl
>    Affects Versions: 0.11
>            Reporter: Feng Peng
>              Labels: hcatalog
>         Attachments: PigStorerDemo.java
>
>
> Pig 0.11 assigns different UDFContextSignature for different invocations of 
> the same load/store statement. This change breaks the HCatStorer which 
> assumes all front-end and back-end invocations of the same store statement 
> has the same UDFContextSignature so that it can read the previously stored 
> information correctly.
> The related HCatalog code is in 
> https://svn.apache.org/repos/asf/incubator/hcatalog/branches/branch-0.5/hcatalog-pig-adapter/src/main/java/org/apache/hcatalog/pig/HCatStorer.java
>  (the setStoreLocation() function).

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to