[
https://issues.apache.org/jira/browse/NIFI-5316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16522375#comment-16522375
]
Bryan Bende commented on NIFI-5316:
-----------------------------------
[~rbruno] since the issue here is not specific to how the Parquet data is
written, just how it is being read and converted back into Avro and then into
NiFi's record model, the fix in the PR should work for existing Parquet.
[~virtualluke] reading through PARQUET-1122 they both seem to have something to
do with list handling in Parquet, but I don't know enough about Parquet's
internals to know if this is all related.
> Potential bug with Fetch Parquet
> --------------------------------
>
> Key: NIFI-5316
> URL: https://issues.apache.org/jira/browse/NIFI-5316
> Project: Apache NiFi
> Issue Type: Bug
> Affects Versions: 1.6.0
> Reporter: Robert Bruno
> Assignee: Bryan Bende
> Priority: Major
>
> I have used PutParquet to create Parquet files from Nifi Records. In trying
> to convert the parquet back to json by using FetchParquet, I keep getting
> errors on what seems like any array field. I have had successes on data that
> contained no arrays.
> The error in the log is cannont convert a value [xxx, yyy] where xxx and yyy
> are random strings of type class java.util.ArrayList because no compatible
> type exist in the UNION of field z.
> I am also see the same error when the value is [] (empty array) as well.
> I have been successful gong from json to avro and avro to json with the same
> schema registry values.
> I am defining array fields as follows:
> "type" : [
> "null",
> {
> "type" : "array",
> "items" : "string"
> }
> ],
> "default": null
> }
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
