[ https://issues.apache.org/jira/browse/NIFI-1706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16436951#comment-16436951 ]
ASF subversion and git services commented on NIFI-1706: ------------------------------------------------------- Commit 82ac815536d53c00f848f2eae79474035a9eb126 in nifi's branch refs/heads/master from [~patricker] [ https://git-wip-us.apache.org/repos/asf?p=nifi.git;h=82ac815 ] NIFI-1706: Extend QueryDatabaseTable to support arbitrary queries - Only include Maximum Value columns in the type map. - Squashed commits in the previous PR - Rebased against the latest master - Added stop method to GenerateTableFetch so that it refreshes the column type map when it gets restarted - Fixed whitespacing around if/for statement - Updated expressionLanguageSupported value since it is not auto-merged correctly This closes #2618. Signed-off-by: Koji Kawamura <ijokaruma...@apache.org> > Extend QueryDatabaseTable to support arbitrary queries > ------------------------------------------------------ > > Key: NIFI-1706 > URL: https://issues.apache.org/jira/browse/NIFI-1706 > Project: Apache NiFi > Issue Type: Improvement > Components: Core Framework > Affects Versions: 1.4.0 > Reporter: Paul Bormans > Assignee: Peter Wicks > Priority: Major > Labels: features > > The QueryDatabaseTable is able to observe a configured database table for new > rows and yield these into the flowfile. The model of an rdbms however is > often (if not always) normalized so you would need to join various tables in > order to "flatten" the data into useful events for a processing pipeline as > can be build with nifi or various tools within the hadoop ecosystem. > The request is to extend the processor to specify an arbitrary sql query > instead of specifying the table name + columns. > In addition (this may be another issue?) it is desired to limit the number of > rows returned per run. Not just because of bandwidth issue's from the nifi > pipeline onwards but mainly because huge databases may not be able to return > so many records within a reasonable time. -- This message was sent by Atlassian JIRA (v7.6.3#76005)