ASF GitHub Bot commented on NIFI-4866:

Github user ijokarumawak commented on the issue:

    Confirmed that transit URI is created correctly:
    - 1.5 
    - 1.6 
    Confirmed performance issue has been addressed:
    - Used a simple GenerateFlowFile and PutHBaseCell flow, template is 
    - Putting only 1 cell with 4bytes data, batched size is 25
    - 1.5 saturated about at the rate of 14k FlowFIles/5min
    - 1.6 saturated about at the rate of 500k FlowFiles/5min
    NiFi 1.5.0
    NiFi 1.6.0-SNAPSHOT with this fix

> HBase_1_1_2_ClientService performance dropped due to accessing HBase admin 
> upon every FlowFile transfer
> -------------------------------------------------------------------------------------------------------
>                 Key: NIFI-4866
>                 URL: https://issues.apache.org/jira/browse/NIFI-4866
>             Project: Apache NiFi
>          Issue Type: Bug
>          Components: Extensions
>            Reporter: Koji Kawamura
>            Assignee: Koji Kawamura
>            Priority: Critical
> NIFI-4543 added 
> "connection.getAdmin().getClusterStatus().getMaster().getHostAndPort()” call 
> from HBase_1_1_2_ClientService.toTransitUri method in order to get HBase 
> master address, which is called upon every FlowFile transfer and essentially 
> doubles the traffic through the HBase connector.
> The performance of our PutHBaseJSON processor dropped to 1/3 after deploying 
> NiFi 1.5.0.
> Those lines of code should be moved from toTransitUri to createConnection.

This message was sent by Atlassian JIRA

Reply via email to