[ 
https://issues.apache.org/jira/browse/HCATALOG-2?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Julien Le Dem updated HCATALOG-2:
---------------------------------

    Attachment: HCAT-2.patch

I'm attaching a patch (HCAT-2.patch)  to support arbitrarily nested structures, 
at least for structs and arrays. Maps are still string => string.
I refactored the schema validation and object conversion to recursively convert 
nested structure. There is a new unit test writing from Pig to HCat and reading 
back and verifying that the data is the same.
                
> Support nested schema conversion between Hive an Pig
> ----------------------------------------------------
>
>                 Key: HCATALOG-2
>                 URL: https://issues.apache.org/jira/browse/HCATALOG-2
>             Project: HCatalog
>          Issue Type: Improvement
>    Affects Versions: 0.1
>            Reporter: Julien Le Dem
>            Assignee: Jakob Homan
>         Attachments: HCAT-2.patch
>
>
> Hive supports STRUCT and ARRAY
> Pig supports Tuple and Bag
> In both cases the types can be arbitrarily nested.
> example:
> STRUCT< foo : ARRAY<STRUCT < bar1: STRING, bar2: STRING > > mystruct
> mytuple: ( foo: { t: ( bar1:chararray, bar2:chararray ) } )
> HCatalog should support nested schema conversion.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to