[
https://issues.apache.org/jira/browse/NIFI-8154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17360058#comment-17360058
]
Lehel Boér commented on NIFI-8154:
----------------------------------
I checked this issue. With parquet-avro version 1.10.0 the provided
nested-struct test case fails. With more recent versions 1.11.0 and 1.12.0
(currently used one) the test succeeds.
> AvroParquetHDFSRecordReader fails to read parquet file containing nested
> structs
> --------------------------------------------------------------------------------
>
> Key: NIFI-8154
> URL: https://issues.apache.org/jira/browse/NIFI-8154
> Project: Apache NiFi
> Issue Type: Bug
> Components: Extensions
> Affects Versions: 1.11.3, 1.12.1
> Reporter: Glenn Jones
> Priority: Minor
> Attachments:
> 0001-NIFI-8154-upversion-parquet-avro-to-1.11.1-and-add-u.patch
>
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> FetchParquet can't be used to process files containing nested structs. When
> trying to create a RecordSchema it runs into
> https://issues.apache.org/jira/browse/PARQUET-1441, which causes it to fail.
> We've patched this locally by building the nifi-parquet-processors with
> parquet-avro 1.11.0, but it would be great if this made it into the next
> release.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
