Anton Alfred created STORM-2824:
-----------------------------------

             Summary: Ability to configure topologies for exactly once 
processing
                 Key: STORM-2824
                 URL: https://issues.apache.org/jira/browse/STORM-2824
             Project: Apache Storm
          Issue Type: Improvement
          Components: storm-core
    Affects Versions: 1.0.1
         Environment: CentOS 7, Docker
            Reporter: Anton Alfred
            Priority: Minor


The default implementation of a spout  (Kafka) is to wait for acknowledgement, 
if an acknowledgement is not provided the tuple is replayed leading to an at 
least once processing model.

Can an option be provided to always acknowledge even in the event of error in 
any spout or bolt and the user decide which mode the topology should be 
configured.

There are cases like multiple bolts (B) inserting to persistent stores (PS) 
like B1 - PS1, B2-PS2, B3-PS3, the fact that B2-PS2 bolt fail doesn't mean that 
the tuple needs to be replayed leading to complexity on the logic of bolts, it 
would be easier if this was configurable and the user of the topology decides 
which style to choose.




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to