[
https://issues.apache.org/jira/browse/NIFI-5316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16519582#comment-16519582
]
Robert Bruno commented on NIFI-5316:
------------------------------------
{
"name": "fuids",
"type": [
"null",
{
"type": "array",
"items": ["string","null"]
}
],
"default": null
}
2018-06-20 15:22:09,330 ERROR [Timer-Driven Process Thread-790]
o.a.nifi.processors.parquet.FetchParquet
FetchParquet[id=b1303c42-b1ea-1538-0000-000030cb5ed8] Failed to retrieve
content from /opt/nifi/flowfile_repository/parquet/59925327569236 for
StandardFlowFileRecord[uuid=ba0b579f-f04e-4d0e-95a2-504cc08d9b95,claim=StandardContentClaim
[resourceClaim=StandardResourceClaim[id=1529083374034-24810,
container=default, section=234], offset=41810,
length=1277046],offset=0,name=59925327569236,size=1277046] due to
org.apache.nifi.serialization.record.util.IllegalTypeConversionException:
Cannot convert value [Fg08WL3AzKIeQ42YUd, Fq6lj6hukAj6LnP0h] of type class
java.util.ArrayList because no compatible types exist in the UNION for field
fuids; routing to failure:
org.apache.nifi.serialization.record.util.IllegalTypeConversionException:
Cannot convert value [Fg08WL3AzKIeQ42YUd, Fq6lj6hukAj6LnP0h] of type class
java.util.ArrayList because no compatible types exist in the UNION for field
fuids
org.apache.nifi.serialization.record.util.IllegalTypeConversionException:
Cannot convert value [Fg08WL3AzKIeQ42YUd, Fq6lj6hukAj6LnP0h] of type class
java.util.ArrayList because no compatible types exist in the UNION for fuids
at
org.apache.nifi.avro.AvroTypeUtil.convertUnionFieldValue(AvroTypeUtil.java:759)
at org.apache.nifi.avro.AvroTypeUtil.normalizeValue(AvroTypeUtil.java:844)
at
org.apache.nifi.avro.AvroTypeUtil.convertAvroRecordToMap(AvroTypeUtil.java:710)
at
org.apache.nifi.processors.parquet.record.AvroParquetHDFSRecordReader.nextRecord(AvroParquetHDFSRecordReader.java:62)
at
org.apache.nifi.processors.hadoop.AbstractFetchHDFSRecord.lambda$null$0(AbstractFetchHDFSRecord.java:207)
at
org.apache.nifi.controller.repository.StandardProcessSession.write(StandardProcessSession.java:2621)
at
org.apache.nifi.processors.hadoop.AbstractFetchHDFSRecord.lambda$onTrigger$1(AbstractFetchHDFSRecord.java:193)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:360)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1678)
at
org.apache.nifi.processors.hadoop.AbstractFetchHDFSRecord.onTrigger(AbstractFetchHDFSRecord.java:177)
at
org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)
at
org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1147)
at
org.apache.nifi.controller.tasks.ConnectableTask.invoke(ConnectableTask.java:175)
at
org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:117)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
> Potential bug with Fetch Parquet
> --------------------------------
>
> Key: NIFI-5316
> URL: https://issues.apache.org/jira/browse/NIFI-5316
> Project: Apache NiFi
> Issue Type: Bug
> Affects Versions: 1.6.0
> Reporter: Robert Bruno
> Priority: Major
>
> I have used PutParquet to create Parquet files from Nifi Records. In trying
> to convert the parquet back to json by using FetchParquet, I keep getting
> errors on what seems like any array field. I have had successes on data that
> contained no arrays.
> The error in the log is cannont convert a value [xxx, yyy] where xxx and yyy
> are random strings of type class java.util.ArrayList because no compatible
> type exist in the UNION of field z.
> I am also see the same error when the value is [] (empty array) as well.
> I have been successful gong from json to avro and avro to json with the same
> schema registry values.
> I am defining array fields as follows:
> "type" : [
> "null",
> {
> "type" : "array",
> "items" : "string"
> }
> ],
> "default": null
> }
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
