[CONF] Apache Samza > SEP-8: Add in-memory system consumer & producer

[kartik paramasivam (Confluence)]

Title: Message Title

kartik paramasivam commented on a page

Re: SEP-8: Add in-memory system consumer & producer Thanks for pulling this together. can you please flush out the Test Plan section as well ?  you mention config for memory pool.. can you provide details ?  I am not sure if it is required as part of min-bar for this feature.. Frankly I think it will get complicated.. I would suggest you skip it unless we explicitly hear from customers that this is needed. is this designed to only work for fluent api ?  I assume it also works for StreamTask..  can you please provide a sample for that as well.  what happens when apps do manual checkpointing ?   Hopefully it doesn't throw an exception ..  Basically just coz we don't support checkpointing shouldn't mean that inmemory system consumer is not applicable for such apps.  (need test case for this as well) since the goal is that this works with 99% of the apps, rocksDB based apps clearly have to work.  Which would imply that in memory producer should work for change log.  We need samples (and test cases for those).  will broadcast stream work ?  I assume yes ? It would be good to mention, if there are any samza applications that cannot be tested with this feature. what is the 1%. Reply • Like

Stop watching space • Manage notifications This message was sent by Atlassian Confluence 5.8.17