[ 
https://issues.apache.org/jira/browse/NIFI-8154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17360172#comment-17360172
 ] 

Glenn Jones commented on NIFI-8154:
-----------------------------------

Hi [~Lehel44].  Thanks for looking into this.  According to 
[https://github.com/apache/nifi/blob/rel/nifi-1.13.2/nifi-nar-bundles/nifi-parquet-bundle/nifi-parquet-processors/pom.xml]
 , the nifi-praquet-processor is using parquet-avro 1.10.0, so this is still a 
problem for us.  Please can you explain what you mean when you say 1.12.0 is 
the "currently used one"?

> AvroParquetHDFSRecordReader fails to read parquet file containing nested 
> structs
> --------------------------------------------------------------------------------
>
>                 Key: NIFI-8154
>                 URL: https://issues.apache.org/jira/browse/NIFI-8154
>             Project: Apache NiFi
>          Issue Type: Bug
>          Components: Extensions
>    Affects Versions: 1.11.3, 1.12.1
>            Reporter: Glenn Jones
>            Assignee: Lehel Boér
>            Priority: Minor
>         Attachments: 
> 0001-NIFI-8154-upversion-parquet-avro-to-1.11.1-and-add-u.patch
>
>          Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> FetchParquet can't be used to process files containing nested structs.  When 
> trying to create a RecordSchema it runs into 
> https://issues.apache.org/jira/browse/PARQUET-1441, which causes it to fail.  
> We've patched this locally by building the nifi-parquet-processors with 
> parquet-avro 1.11.0, but it would be great if this made it into the next 
> release.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to