[
https://issues.apache.org/jira/browse/NIFI-1403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15101968#comment-15101968
]
Joseph Witt commented on NIFI-1403:
-----------------------------------
thanks for reporting and with such good detail to enable a nice unit
test/replication.
> Avro schema with nested records seems to be not correctly managed by
> ConvertCSV2AVRO
> ------------------------------------------------------------------------------------
>
> Key: NIFI-1403
> URL: https://issues.apache.org/jira/browse/NIFI-1403
> Project: Apache NiFi
> Issue Type: Bug
> Components: Core Framework
> Affects Versions: 0.4.0
> Reporter: Massimiliano Nigrelli
> Priority: Blocker
> Fix For: 0.5.0
>
>
> I have set up a flow where a .csv file (fakeCSV.csv) is read from file system
> and is then "passed" to a ConvertCSV2AVRO processor, which will forward the
> flow file to a ConvertAVRO2JSON processor (which finally writes on a Kafka
> queue via a PutKafka processor)
> The .CSV file is:
> pressure;1452685093;0.87;node01;3543.33
> The AVRO Schema is:
> {
> "name": "observation",
> "type": "record",
> "fields": [
> {"name": "metric", "type": "string"},
> {"name": "timestamp", "type": "long"},
> {"name": "value", "type": "string"},
> {"name": "tags", "type": {
> "name": "tagRecord",
> "type": "record",
> "fields": [
> {"name": "sensor", "type": "string"},
> {"name": "depth", "type": "string"}
> ]
> }
> }
> ]
> }
> I expect the following JSON "out" on the Kafka queue:
> {
> "metric": "pressure",
> "timestamp": 1452685093,
> "value": 0.87,
> "tags": {
> "sensor": "node01",
> "depth": "3543.33"
> }
> }
> When the flow is actvated, the processor seems to be stuck, returning the
> following error:
> ERROR [Timer-Driven Process Thread-4] o.a.n.processors.kite.ConvertCSVToAvro
> ConvertCSVToAvro[id=5526e2a4-72ae-46f5-8249-8694fa4d06f3] Failed to process
> session due to org.apache.nifi.processor.exception.FlowFileHandlingException:
> StandardFlowFileRecord[uuid=fbbbab6c-e2b0-43c1-9fe4-335eb5e6ad85,claim=StandardContentClaim
> [resourceClaim=StandardResourceClaim[id=1452867190110-331,
> container=default, section=331], offset=755419,
> length=41],offset=0,name=fakeCSV.csv,size=41] transfer relationship not
> specified: org.apache.nifi.processor.exception.FlowFileHandlingException:
> StandardFlowFileRecord[uuid=fbbbab6c-e2b0-43c1-9fe4-335eb5e6ad85,claim=StandardContentClaim
> [resourceClaim=StandardResourceClaim[id=1452867190110-331,
> container=default, section=331], offset=755419,
> length=41],offset=0,name=fakeCSV.csv,size=41] transfer relationship not
> specified
> Just to give you more details, if I do not add "nested" records in the AVRO
> schema, it perfectly works!!!
> Hope you will sort the issue out.
> Regards,
> MaxNigrelli72
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
