Will Berkeley created KUDU-2078:
-----------------------------------

             Summary: Flume sink fails to write if the size in bytes of the 
batch exceeds the client session's manual flush buffer size
                 Key: KUDU-2078
                 URL: https://issues.apache.org/jira/browse/KUDU-2078
             Project: Kudu
          Issue Type: Bug
          Components: flume-sink
    Affects Versions: 1.4.0
            Reporter: Will Berkeley
            Assignee: Will Berkeley


The Flume sink uses MANUAL_FLUSH mode. If a set of operations is too large for 
the flush buffer, it will fail-- potentially over and over, if the channel 
supports retrying the transaction.

We should be able to fix this by using AUTO_FLUSH_BACKGROUND, adjusting the 
buffer size, or returning a more useful error so that users can reconfigure 
their sink's batch size (though that size is in # of ops, not bytes).



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to