Andy LoPresto created NIFI-4078:
-----------------------------------

             Summary: Provide capability for record conversion inspection
                 Key: NIFI-4078
                 URL: https://issues.apache.org/jira/browse/NIFI-4078
             Project: Apache NiFi
          Issue Type: New Feature
          Components: Extensions
    Affects Versions: 1.3.0
            Reporter: Andy LoPresto


The {{ConvertRecord}} and related processors are a great new feature. I do 
think a useful feature would be inter-step debug for record conversion. In the 
same way you can start a processor and not the follow-on and inspect the 
flowfiles in the queue for correctness, we should be able to do that during 
record conversion. So if I have input format {{X}} and output format {{Y}}, I 
want to see what the ephemeral value is after {{X}} has been parsed but before 
{{Y}} has been generated. This will allow for better resolution of situations 
where the output is not as expected. This could be because the input is not 
being read/parsed correctly, or because the output is not being generated 
correctly. Being able to bisect that issue will greatly help with solving the 
problem. 

I anticipate a context menu option to inspect flowfiles being processed by the 
component when it is enabled and running. While there is no internal queue for 
the processor, logically, it is the same as {{List Flowfile}} being executed on 
a queue. Depending on the processing volume, this time slice window may be able 
to hold flowfiles for some time following processing (a few flowfiles in a few 
seconds) or it may need to rapidly refresh the "queue" but maintain the 
flowfile that was under examination to avoid confusing the user. 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to