[
https://issues.apache.org/jira/browse/PIG-3584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheolsoo Park reassigned PIG-3584:
----------------------------------
Assignee: Joseph Adler
> AvroStorage does not correctly translate arrays of strings
> -----------------------------------------------------------
>
> Key: PIG-3584
> URL: https://issues.apache.org/jira/browse/PIG-3584
> Project: Pig
> Issue Type: Bug
> Reporter: Joseph Adler
> Assignee: Joseph Adler
> Attachments: PIG-3584.patch
>
>
> I found an issue this morning with AvroStorage and arrays of strings. Suppose
> that you have an Avro file with an array of strings like this:
> {"name" : "example",
> "namespace" : "org.apache.pig.avro",
> "type" : "record",
> "fields" : [
> {"name" : "arrayOfStrings",
> "type" : {{"type" : "array", "items" : "string"}}}}
> The current version of AvroStorage would translate this schema into a bag of
> tuples, each containing a single chararray field.
> The current version of AvroStorage will naively place each value in the array
> into a tuple inside a bag of values. Unfortunately, each value is a Utf8 item
> (not a Java String type). This can cause problems in later processing steps,
> because Pig does not know how to deal with Utf8 objects.
> I've written a patch for AvroStorage that will correctly translate objects in
> arrays into a form that Pig can process. (While I was at it, I made sure that
> we correctly translated other Avro types, including fixed, enums, and unions.)
--
This message was sent by Atlassian JIRA
(v6.1.4#6159)
