bezmax opened a new issue #6161: Cloning subscriptions
URL: https://github.com/apache/pulsar/issues/6161
 
 
   **Is your feature request related to a problem? Please describe.**
   We are designing a stateful stream processing system with periodic snapshots 
of the state. Only after the state is snapshotted - we acknowledge all the 
pending messages in pulsar's subscription, allowing us to process the stream in 
a fault-tolerant way. If the processing fails - we can always redeliver 
unacknowledged messages and start from previous state snapshot.
   
   However, currently, we are constrained to being able to only restore the 
last snapshot. There's no way to go to the state before that, as the 
subscription has already advanced. The easiest solution to this would be a way 
to clone a subscription at the time of the snapshot, therefore retaining a 
previous version of it for the previous snapshot. Then if we need to recover 2 
versions back - we would just use the subscription correlated to the snapshot 
we took.
   
   **Describe the solution you'd like**
   Pulsar Admin command that copies a subscription with a new name. For example 
`topics copy-subscription -s existingsub -c newsub persistent://..../topicname`
   
   **Describe alternatives you've considered**
   Probably the only alternative would be to abandon subscription model and 
track watermark manually using a Reader.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to