Hey, Manasa, Sorry to chime in late. A few questions: a) how are states for the virtual tasks managed during split/merge? b) what's perf impact when we have 2 virtual tasks on the same SSP in the same container, while one virtual task is much faster than the other? c) what's the reason that a virtual task can not filter older messages from a previous offset, in case the container restarts from a smaller offset from another virtual task consuming the same SSP? d) how do we compare this w/ an alternative idea that implements a KeyedOrderedExecutor w/ multiple parallel threads within the single task's main event loop to increase the parallelism?
Best, -Yi On Thu, Jan 19, 2023 at 3:26 PM Lakshmi Manasa <lakshmimanas...@gmail.com> wrote: > hi all, > > if there are no concerns or questions about this SEP, I shall start the > vote email thread tomorrow. > > thanks, > Manasa > > On Fri, Jan 6, 2023 at 8:08 AM Lakshmi Manasa <lakshmimanas...@gmail.com> > wrote: > > > Hi all, > > We created SEP-32: Elasticity for Samza. > > > > Please find SEP here ( > > > https://cwiki.apache.org/confluence/display/SAMZA/SEP-32%3A+Elasticity+for+Samza > > ) > > Please take a look and provide feedback. thanks, Manasa > > >