[
https://issues.apache.org/jira/browse/PARQUET-364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14706766#comment-14706766
]
Cheng Lian commented on PARQUET-364:
------------------------------------
Although I haven't verified it yet, I suspect parquet-thrift suffers from a
similar issue, e.g. cannot decode Parquet records translated from Thrift
structure like {{list<list<i32>>}}.
> Parque-avro cannot decode Avro array of primitive array (e.g.
> array<array<int>>)
> --------------------------------------------------------------------------------
>
> Key: PARQUET-364
> URL: https://issues.apache.org/jira/browse/PARQUET-364
> Project: Parquet
> Issue Type: Bug
> Components: parquet-mr
> Affects Versions: 1.5.0, 1.6.0, 1.7.0, 1.8.0
> Reporter: Cheng Lian
>
> The following Avro schema
> {noformat}
> record AvroNonNullableArrays {
> array<array<int>> int_arrays_column;
> }
> {noformat}
> is translated into the following Parquet schema by parquet-avro 1.7.0:
> {noformat}
> message root {
> required group int_arrays_column (LIST) {
> repeated group array (LIST) {
> repeated int32 array;
> }
> }
> }
> {noformat}
> {{AvroIndexedRecordConverter}} cannot decode such records correctly. The
> reason is that the 2nd level repeated group {{array}} doesn't pass
> {{AvroIndexedRecordConverter.isElementType()}} check. We probably should
> check for field name "array" in {{isElementType()}} to fix this issue.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
