[ 
https://issues.apache.org/jira/browse/NIFI-5812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16683925#comment-16683925
 ] 

ASF GitHub Bot commented on NIFI-5812:
--------------------------------------

Github user mattyb149 commented on a diff in the pull request:

    https://github.com/apache/nifi/pull/3167#discussion_r232697514
  
    --- Diff: 
nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/src/main/java/org/apache/nifi/processors/standard/GenerateTableFetch.java
 ---
    @@ -114,6 +114,7 @@
             + "max value for max value columns. Properties should be added in 
the format `initial.maxvalue.<max_value_column>`. This value is only used the 
first time "
             + "the table is accessed (when a Maximum Value Column is 
specified). In the case of incoming connections, the value is only used the 
first time for each table "
             + "specified in the flow files.")
    +@PrimaryNodeOnly
    --- End diff --
    
    Since GenerateTableFetch can accept incoming flow files, I don't think we 
should restrict this to run only on the primary node. For example, you could do 
a ListDatabaseTables, then distribute the flow files among the cluster, where 
each node's downstream GTF could do the fetch in parallel. In fact that's the 
main reason we have GTF rather than just QueryDatabaseTable.


> Make database processors as 'PrimaryNodeOnly'
> ---------------------------------------------
>
>                 Key: NIFI-5812
>                 URL: https://issues.apache.org/jira/browse/NIFI-5812
>             Project: Apache NiFi
>          Issue Type: Improvement
>          Components: Core Framework, Extensions
>    Affects Versions: 1.7.0, 1.8.0, 1.7.1
>            Reporter: Sivaprasanna Sethuraman
>            Assignee: Sivaprasanna Sethuraman
>            Priority: Major
>
> With NIFI-543, we have introduced an behavior annotation to mark a particular 
> processor to run only on the Primary Node. It is recommended to mark the 
> following database related processors as 'PrimaryNodeOnly':
>  * QueryDatabaseTable
>  * GenerateTableFetch



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to