On Mon, Sep 21, 2015 at 8:53 AM, bhasker datta <[email protected]> wrote:
> Hello, > I am working on a storm topology where I need to build multiple topologies > for different client locations. > > I have a Kafka server producing data that needs to reach remote client > machine(after some transformation in the bolts). There are about 1000 of > those clients. > when there is new data produced in the Kafka, the clients need to get that > data in few minutes. > There is some transformation that needs to happen (which can be handled by > the bolts) and the data is sent to the remote client via websocket. > > e.g: Kafka server -> Kafka spout -> Bolt1 -> bolt2 -> bolt3 -> websocket > (on a client machine) > I have 1000 client machines. > > I am hoping that this topology can be dynamically created per client. When > the client is ready, can they initiate this topology and start reading the > data? > or can these topologies (1000 of them) be created on the storm and ready > to send the data? > > Is this architecture possible with Storm? > How efficient is this? > Is the Strom setup manageable? > > thanks for your response. > Bhasker > >
