[jira] [Created] (NIFI-4008) ConsumeKafkaRecord_0_10 assumes there is always one Record in a message

[Koji Kawamura (JIRA)]

Koji Kawamura created NIFI-4008:
-----------------------------------

             Summary: ConsumeKafkaRecord_0_10 assumes there is always one 
Record in a message
                 Key: NIFI-4008
                 URL: https://issues.apache.org/jira/browse/NIFI-4008
             Project: Apache NiFi
          Issue Type: Bug
          Components: Extensions
    Affects Versions: 1.2.0
            Reporter: Koji Kawamura


ConsumeKafkaRecord_0_10 uses ConsumerLease underneath, and it [assumes there is 
one Record available in a consumed 
message|https://github.com/apache/nifi/blob/master/nifi-nar-bundles/nifi-kafka-bundle/nifi-kafka-0-10-processors/src/main/java/org/apache/nifi/processors/kafka/pubsub/ConsumerLease.java#L434]
 retrieved from a Kafka topic.

But in fact, a message can contain 0 or more records in it. For example, with a 
record schema shown below:

{code}
{
  "type": "record",
  "name": "temp",
  "fields" : [
    {"name": "value", "type": "string"}
  ]
}
{code}

Multiple records can be sent within a single message, e.g. using JSON:

{code}
[{"value": "a"}, {"value": "b"}, {"value": "c"}]
{code}

But ConsumeKafkaRecord only outputs the first record '[{"value": "a"}]'.

Also, if a message doesn't contain any record in it, the processor fails with 
NullPointerException.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)