Re: Flink Application Jar file on Docker container

2017-09-27 Thread Eron Wright
There was also a talk about containerization at Flink Forward that touches on some of your questions. https://www.youtube.com/watch?v=w721NI-mtAA=2s=PLDX4T_cnKjD0JeULl1X6iTn7VIkDeYX_X=33 Eron On Wed, Sep 27, 2017 at 9:12 AM, Stefan Richter wrote: > Hi, > > from

Re: Flink Application Jar file on Docker container

2017-09-27 Thread Stefan Richter
Hi, from the top of my head, I cannot see why this should not be possible, task managers just need to be able to connect to their job manager. Unfortunately, I cannot give a real guarantee here because I am not that deeply involved in this aspect of Flink. Best, Stefan > Am 27.09.2017 um

Re: Flink Application Jar file on Docker container

2017-09-27 Thread Rahul Raj
Hi Stefan, I have a question in my mid out of curiosity Is it possible to run flink application within docker container by using flink cluster set up on host? Rahul Raj On 26 September 2017 at 17:29, Stefan Richter wrote: > Hi, > > if I correctly understood

Re: Flink Application Jar file on Docker container

2017-09-26 Thread Rahul Raj
Hi Stefan, Thanks a lot for your answer and sharing the link https://github.com/mesoshq/flink. I went through this and saw its spawning Jobmanager and taskmanager. Now I think, this should be happening. First JobManager will be started on flink cluster on one node, then task manager will be

Re: Flink Application Jar file on Docker container

2017-09-26 Thread Stefan Richter
Hi, as in my answer to your previous mail, I suggest to take a look at https://github.com/mesoshq/flink . Unfortunately, there is not yet a lot documentation about the internals of how this works, so I am also looping in Till who might know more about

Flink Application Jar file on Docker container

2017-09-26 Thread Rahul Raj
Currently I have a Flink Application Jar file running on Mesos cluster. The flink application simply reads data from Kafka and put it to HDFS. Now we are planning to create a docker image to run this application jar file inside docker containers on Mesos cluster via Marathon. Below are the