I may be missing something - but doesn't that sounds exactly as broadcast
stream? You can make all the tasks read from all the partitions.
(
https://samza.apache.org/learn/documentation/0.10/container/samza-container.html,
search for broadcast)

On Tue, May 3, 2016 at 12:46 PM, Jacob Maes <jacob.m...@gmail.com> wrote:

> This sounds like SAMZA-402 (
> https://issues.apache.org/jira/browse/SAMZA-402)
> which, unfortunately, hasn't been implemented yet.
>
>
>
> On Tue, May 3, 2016 at 7:48 AM, Bae, Jae Hyeon <metac...@gmail.com> wrote:
>
> > Can we make a kafka topic as KV store globally to all tasks, not
> > partitioned? For example, we have a kafka topic "cache" and it has a 4
> > partitions. If we launch a container with 4 tasks, each task will have
> one
> > partition of "cache" kafka topic and create a KV store instance. I want
> to
> > make all 4 partitions in "cache" topic available in all tasks.
> >
> > On Mon, May 2, 2016 at 11:26 PM, Jagadish Venkatraman <
> > jagadish1...@gmail.com> wrote:
> >
> > > Hi,
> > >
> > > What do you mean by broadcasted KV storage? Currently a KV store
> instance
> > > is specific to a task. Are you referring to broadcast streams?
> > >
> > >
> > >
> > > On Mon, May 2, 2016 at 7:58 PM, Bae, Jae Hyeon <metac...@gmail.com>
> > wrote:
> > >
> > > > Hi Samza devs and users
> > > >
> > > > Is it possible to implement broadcasted KeyValueStorage with 0.9? I
> > know
> > > > 0.10 supports broadcast but we're not yet to 0.10.
> > > >
> > > > Thank you
> > > > Best, Jae
> > > >
> > >
> > >
> > >
> > > --
> > > Jagadish V,
> > > Graduate Student,
> > > Department of Computer Science,
> > > Stanford University
> > >
> >
>

Reply via email to