Paul Bormans created NIFI-1706:
----------------------------------
Summary: Extend QueryDatabaseTable to support arbitrary queries
Key: NIFI-1706
URL: https://issues.apache.org/jira/browse/NIFI-1706
Project: Apache NiFi
Issue Type: Improvement
Components: Core Framework
Affects Versions: 0.6.0
Reporter: Paul Bormans
The QueryDatabaseTable is able to observe a configured database table for new
rows and yield these into the flowfile. The model of an rdbms however is often
(if not always) normalized so you would need to join various tables in order to
"flatten" the data into useful events for a processing pipeline as can be build
with nifi or various tools within the hadoop ecosystem.
The request is to extend the processor to specify an arbitrary sql query
instead of specifying the table name + columns.
In addition (this may be another issue?) it is desired to limit the number of
rows returned per run. Not just because of bandwidth issue's from the nifi
pipeline onwards but mainly because huge databases may not be able to return so
many records within a reasonable time.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
