Andy LoPresto created NIFI-4078:
-----------------------------------
Summary: Provide capability for record conversion inspection
Key: NIFI-4078
URL: https://issues.apache.org/jira/browse/NIFI-4078
Project: Apache NiFi
Issue Type: New Feature
Components: Extensions
Affects Versions: 1.3.0
Reporter: Andy LoPresto
The {{ConvertRecord}} and related processors are a great new feature. I do
think a useful feature would be inter-step debug for record conversion. In the
same way you can start a processor and not the follow-on and inspect the
flowfiles in the queue for correctness, we should be able to do that during
record conversion. So if I have input format {{X}} and output format {{Y}}, I
want to see what the ephemeral value is after {{X}} has been parsed but before
{{Y}} has been generated. This will allow for better resolution of situations
where the output is not as expected. This could be because the input is not
being read/parsed correctly, or because the output is not being generated
correctly. Being able to bisect that issue will greatly help with solving the
problem.
I anticipate a context menu option to inspect flowfiles being processed by the
component when it is enabled and running. While there is no internal queue for
the processor, logically, it is the same as {{List Flowfile}} being executed on
a queue. Depending on the processing volume, this time slice window may be able
to hold flowfiles for some time following processing (a few flowfiles in a few
seconds) or it may need to rapidly refresh the "queue" but maintain the
flowfile that was under examination to avoid confusing the user.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)