Thanks Boris. Are you using Alpakka for kafka -Akka integration? On Wed, Jul 11, 2018 at 9:56 AM, Boris Lublinsky < boris.lublin...@lightbend.com> wrote:
> This works fine, we (Lightbend) are using this approach all over the place > > Boris Lublinsky > FDP Architect > boris.lublin...@lightbend.com > https://www.lightbend.com/ > > > On Jul 11, 2018, at 8:53 AM, Pulkit Manchanda <pulkit....@gmail.com> > wrote: > > > > Hi All, > > > > I want to build a datapipeline with the following design. Can please > anyone > > advice me that is it feasible to do? Or there are better options. > > > > > > HTTP Streams --> (HTTP stream consumer)(using AKKA HTTP Streaming) --> > (kafka > > Stream Producer)(using Kafka Streaming) --> (Kafka Stream > Consumer)(using Spark > > structured streaming) > > > > > > DPContext --> (Kafka Stream Producer)(using Spark structured > > streaming) --> (Kafka > > Stream Consumer)(using AKKA Streaming) -->(HTTP stream Producer)(using > AKKA > > HTTP Streaming) --> HTTP Streams > > > > Thanks > > Pulkit > >
