[ https://issues.apache.org/jira/browse/HIVE-9312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15067952#comment-15067952 ]
Gaurav Kumar commented on HIVE-9312: ------------------------------------ Anybody got a chance to work this out? > Literal string "\n" confuses Avro SerDe > --------------------------------------- > > Key: HIVE-9312 > URL: https://issues.apache.org/jira/browse/HIVE-9312 > Project: Hive > Issue Type: Bug > Components: Serializers/Deserializers > Affects Versions: 0.13.0 > Environment: Hortonworks Data Platform 2.1.2.1 on Centos 6.5 > Reporter: Tom Snee > > Avro files with string fields that contain a backslash followed by 'n' > confuse the Avro SerDe. > Steps to recreate: > 1. Put attached schema nested.avsc into HDFS under /user/someone. > 2. Convert attached JSON file example.json into Avro with avro-tools, like > so: "java -jar avro-tools-1.7.7.jar fromjson --schema-file nested.avsc > example.json > example.avro" > 3. Put example.avro into HDFS under /user/someone/avro-files. > 4. Create a Hive table with this statement: > CREATE EXTERNAL TABLE avro_table > ROW FORMAT SERDE > 'org.apache.hadoop.hive.serde2.avro.AvroSerDe' > STORED AS INPUTFORMAT > 'org.apache.hadoop.hive.ql.io.avro.AvroContainerInputFormat' > OUTPUTFORMAT > 'org.apache.hadoop.hive.ql.io.avro.AvroContainerOutputFormat' > LOCATION > '/user/someone/avro-files/' > TBLPROPERTIES ( > 'avro.schema.url'='hdfs:///user/someone/nested.avsc' > ); > 5. Observe that "select * from avro_table;" returns one row, as expected. > 6. Observe that "select * from avro_table where > mastersubjectnumber='A12B3CDE-FGH4-5I67-89J0-KLMN1OPQ23R4';" returns 13 > garbled rows. -- This message was sent by Atlassian JIRA (v6.3.4#6332)