[ 
https://issues.apache.org/jira/browse/HCATALOG-367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13250332#comment-13250332
 ] 

David Capwell commented on HCATALOG-367:
----------------------------------------

Here is the pig script ran:
a = load 'default.search_austria' using org.apache.hcatalog.pig.HCatLoader();
b = filter a BY (
           datestamp == '20091103'
       and srcid     == '19174'
       and action    == 'click'
       and testid    == 'NOTESTID'
    );
-- prune  out partition cols since HCatStorer will not allow them in the 
partition schema/data
b = foreach b generate 
bcookie,src_spaceid,srcpvid,ts,browser,bckt,type,ip,yuid,referrer,pg_spaceid,dstid,dstpvid,dst_spaceid,page_params,clickinfo,viewinfo;
store b into 'default.tmp_pig2pig_stored_search_austria_1333996524'
        using org.apache.hcatalog.pig.HCatStorer
       ('datestamp=20091103,srcid=19174,action=click,testid=NOTESTID');

Here is the file it wrote:
hadoop fs -ls 
/tmp/tmp_pig2pig_stored_search_austria_1333996524/action=click/datestamp=20091103/srcid=19174/testid=NOTESTID
Found 1 items
-rw-------   3 hadoopqa hdfs   13990632 2012-04-09 19:28 
/tmp/tmp_pig2pig_stored_search_austria_1333996524/action=click/datestamp=20091103/srcid=19174/testid=NOTESTID/part-m-00000


Here is the list of partitions:
$ hive -e "show partitions tmp_pig2pig_stored_search_austria_1333996524"
OK
Time taken: 1.75 seconds

                
> Pig writes data but partition information isn't getting updated
> ---------------------------------------------------------------
>
>                 Key: HCATALOG-367
>                 URL: https://issues.apache.org/jira/browse/HCATALOG-367
>             Project: HCatalog
>          Issue Type: Bug
>          Components: pig
>    Affects Versions: 0.4, 0.5, 0.4.1
>            Reporter: David Capwell
>
> I see that when ever pig runs into HCATALOG-236 that the data on HDFS is 
> written but the hive partitions are not getting updated.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to