I may be missing something - but doesn't that sounds exactly as broadcast stream? You can make all the tasks read from all the partitions. ( https://samza.apache.org/learn/documentation/0.10/container/samza-container.html, search for broadcast)
On Tue, May 3, 2016 at 12:46 PM, Jacob Maes <jacob.m...@gmail.com> wrote: > This sounds like SAMZA-402 ( > https://issues.apache.org/jira/browse/SAMZA-402) > which, unfortunately, hasn't been implemented yet. > > > > On Tue, May 3, 2016 at 7:48 AM, Bae, Jae Hyeon <metac...@gmail.com> wrote: > > > Can we make a kafka topic as KV store globally to all tasks, not > > partitioned? For example, we have a kafka topic "cache" and it has a 4 > > partitions. If we launch a container with 4 tasks, each task will have > one > > partition of "cache" kafka topic and create a KV store instance. I want > to > > make all 4 partitions in "cache" topic available in all tasks. > > > > On Mon, May 2, 2016 at 11:26 PM, Jagadish Venkatraman < > > jagadish1...@gmail.com> wrote: > > > > > Hi, > > > > > > What do you mean by broadcasted KV storage? Currently a KV store > instance > > > is specific to a task. Are you referring to broadcast streams? > > > > > > > > > > > > On Mon, May 2, 2016 at 7:58 PM, Bae, Jae Hyeon <metac...@gmail.com> > > wrote: > > > > > > > Hi Samza devs and users > > > > > > > > Is it possible to implement broadcasted KeyValueStorage with 0.9? I > > know > > > > 0.10 supports broadcast but we're not yet to 0.10. > > > > > > > > Thank you > > > > Best, Jae > > > > > > > > > > > > > > > > -- > > > Jagadish V, > > > Graduate Student, > > > Department of Computer Science, > > > Stanford University > > > > > >