[DISCUSS] SEP-28: Samza State Backend Interface and Checkpointing Improvements

2021-06-15 Thread Daniel Chen
Hi folks,

To accomodate for the new Blob store state backend system for SEP-29 we
have made significant changes to the state commit and restore lifecycle
along with changes to the checkpoint message format.

Here is the SEP wiki, please take a look:
https://cwiki.apache.org/confluence/display/SAMZA/SEP-28%3A+Samza+State+Backend+Interface+and+Checkpointing+Improvements

Please take a look, I will greatly appreciate the feedback.
Along with SEP-29 If there are no blockers, we are seeking to open the vote
on Monday, June 21st.

Thanks,
Daniel


[DISCUSS] SEP-29: Blob Store Based State Backup And Restore

2021-06-15 Thread Prateek Maheshwari
[Sending on behalf of Shekhar due to email delivery issues]

Hi folks,

We've been working on adding support for a blob store based state backend
for backing up and restoring local state. In our experiments this has led
to significantly faster state restore times compared to Kafka changelogs,
simplifying management of applications with large local state.

Please take a look at the SEP for more details:
https://cwiki.apache.org/confluence/display/SAMZA/SEP-29%3A+Blob+Store+Based+State+Backup+And+Restore

Looking forward to your review and feedback. If there are no blockers, we
will open the vote on Monday, June 21st.

Thanks,
Prateek and Shekhar


Reminder: LinkedIn Stream Processing Meetup on Jun 24

2021-06-15 Thread Yi Pan
The meet up is coming in less than 10 days! Please remember to sign up and
join us!
https://www.meetup.com/Stream-Processing-Meetup-LinkedIn/events/278266182/

Short abstracts for the contents:
https://www.linkedin.com/posts/celiakkung_stream-processing-with-apache-kafka-apache-activity-6802706543746920448-Rori

Looking forward to seeing you virtually!

-Yi