Re: Real time streaming as a microservice

2018-07-15 Thread Mich Talebzadeh
gt;>> > I have a gateway node that is connected to the host running the >>>>> container. >>>>> > From within the container I can ssh to the gateway host *as both the >>>>> > gateway host and host running the container are on the sam

Re: Real time streaming as a microservice

2018-07-15 Thread Deepak Sharma
>>>> > eth0: flags=4163 mtu 1500 >>>> > *inet 172.17.0.2 netmask 255.255.0.0 broadcast 172.17.255.255* >>>> > ether 02:42:ac:11:00:02 txqueuelen 0 (Ethernet) >>>> > RX packets 173015 bytes 3263068025 (3.2 GB) >>>> > RX errors 0 dropped 0 overruns 0 frame 0 >>>> > TX pa

Re: Real time streaming as a microservice

2018-07-15 Thread Mich Talebzadeh
KB) >>> > RX errors 0 dropped 0 overruns 0 frame 0 >>> > TX packets 8450 bytes 534805 (534.8 KB) >>> > TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0 >>> > >>> > >>> > >>> > The interesting thing is that in order t

Re: Real time streaming as a microservice

2018-07-15 Thread Mich Talebzadeh
rhes564:9092,rhes75:9093,rhes564:9093,rhes75:9094,rhes564:9094 >> > needs to be replaced by :9092! >> > >> > >> > So at this juncture I am wondering what type of network needs to be >> created >> > as the container is running within another host.

Re: Real time streaming as a microservice

2018-07-10 Thread Mich Talebzadeh
tainer is > here > > > > > > > > > > > > http://planet.jboss.org/post/zookeeper_for_microservice_registration_and_discovery > > > > > > > > ZooKeeper for Microservice Registration and Discovery ...< &g

Re: Real time streaming as a microservice

2018-07-10 Thread Rahul Singh
y arise > from relying on this email's technical content is explicitly disclaimed. > The author will in no case be liable for any monetary damages arising from > such loss, damage or destruction. > > > > > On Sun, 8 Jul 2018 at 20:00, Martin Gainty wrote: > > > >

Re: Real time streaming as a microservice

2018-07-08 Thread Martin Gainty
From: Mich Talebzadeh Sent: Sunday, July 8, 2018 1:01 PM To: users@kafka.apache.org Subject: Re: Real time streaming as a microservice Thanks Martin. >From an implementation point of view do we need to introduce docker for each microservice? In other wo

Re: Real time streaming as a microservice

2018-07-08 Thread Mich Talebzadeh
> > > let me know if i can help out > Martin > > > ____ > From: Jörn Franke > Sent: Sunday, July 8, 2018 6:18 AM > To: users@kafka.apache.org > Cc: u...@flink.apache.org > Subject: Re: Real time streaming as a microservice > > Yes or Ka

Re: Real time streaming as a microservice

2018-07-08 Thread Martin Gainty
he concerns around it. let me know if i can help out Martin From: Jörn Franke Sent: Sunday, July 8, 2018 6:18 AM To: users@kafka.apache.org Cc: u...@flink.apache.org Subject: Re: Real time streaming as a microservice Yes or Kafka will need it ... As soon as your orc

Re: Real time streaming as a microservice

2018-07-08 Thread Jörn Franke
Yes or Kafka will need it ... As soon as your orchestrate different microservices this will happen. > On 8. Jul 2018, at 11:33, Mich Talebzadeh wrote: > > Thanks Jorn. > > So I gather as you correctly suggested, microservices do provide value in > terms of modularisation. However, there will

Re: Real time streaming as a microservice

2018-07-08 Thread Jörn Franke
That they are loosely coupled does not mean they are independent. For instance, you would not be able to replace Kafka with zeromq in your scenario. Unfortunately also Kafka sometimes needs to introduce breaking changes and the dependent application needs to upgrade. You will not be able to

Real time streaming as a microservice

2018-07-08 Thread Mich Talebzadeh
Hi, I have created the Kafka messaging architecture as a microservice that feeds both Spark streaming and Flink. Spark streaming uses micro-batches meaning "collect and process data" and flink as an event driven architecture (a stateful application that reacts to incoming events by triggering