[jira] [Commented] (NIFI-1202) Allow user to configure Batch Size for site-to-site

[ASF GitHub Bot (JIRA)]

    [ 
https://issues.apache.org/jira/browse/NIFI-1202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15727870#comment-15727870
 ] 

ASF GitHub Bot commented on NIFI-1202:
--------------------------------------

Github user ijokarumawak commented on the issue:

    https://github.com/apache/nifi/pull/1306
  
    Confirmed that the batch configuration works as expected by following tests.
    
    ### Test detail
    
    - 3 node cluster
    - Generate 100 flow files using GenerateFlowFile on primary node
    - Send and receive 100 flow files using HTTP/RAW transport protocols with 
different batch settings
    - Confirmed flow files are distributed evenly based on batch configuration
    
    
![image](https://cloud.githubusercontent.com/assets/1107620/20956950/5e37bdd6-bc90-11e6-9768-c0e5763dac7b.png)
    
    
    ### HTTP
    - Push to remote input port
      - [x] default setting: single remote peer gets all 100 files
      - [x] limit with 10 files: each remote peer gets even flow files
    - Pull from remote output port
      - [x] default setting: single client node gets all 100 files
      - [x] limit with 10 files: each client node gets even flow files
    
    ### RAW
    - Push to remote input port
      - [x] default setting: single remote peer gets all 100 files
      - [x] limit with 10 files: each remote peer gets even flow files
    - Pull from remote output port
      - [x] default setting: single client node gets all 100 files
      - [x] limit with 10 files: each client node gets even flow files
    
    ### Flow File Distribution result
    
    Confirmed 100 flow files are evenly distributed among nodes if batch 
setting is configured as following image. Confirmed the same behavior with 
pulling from an output port.
    
    
![image](https://cloud.githubusercontent.com/assets/1107620/20957064/f4b6fcae-bc90-11e6-879a-f52155cc99ac.png)



> Allow user to configure Batch Size for site-to-site
> ---------------------------------------------------
>
>                 Key: NIFI-1202
>                 URL: https://issues.apache.org/jira/browse/NIFI-1202
>             Project: Apache NiFi
>          Issue Type: Improvement
>          Components: Core Framework, Core UI, Documentation & Website
>            Reporter: Mark Payne
>            Assignee: Mark Payne
>         Attachments: WIP-added-batch-settings-ui.png, 
> configure-remote-port-window.png
>
>
> Currently, there is no way for a user to specify the batch size that 
> Site-to-Site will use. The framework decides this for you. However, if we 
> want to use the List/Fetch Pattern, it will be helpful to specify a small 
> batch size so that a small number of things that are listed are still well 
> distributed across the cluster.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)