Running job in detached mode via ClusterClient.

2018-10-02 Thread Piotr Szczepanek
Hey, I've a question regarding submission job in detached mode. We're trying to submit job via YarnClusterClient in detached mode and the first one goes correctly, but when we submit second job we get exception: Multiple environments cannot be created in detached mode at

Flink 1.5.2 process keeps reference to deleted blob files.

2018-09-19 Thread Piotr Szczepanek
Hello, we are using YarnClusterClient for job submission. After successful/failed job execution it looks like blob file for that job is deleted, but there is still some handle from Flink process to that file. As a result the file is not removed from machine and we faced no space felt on device

Re: Flink 1.7.1 job is stuck in running state

2019-01-18 Thread Piotr Szczepanek
Hi Piotr, > > What was the version you were using before 1.7.1? > How do you deploy your cluster, e.g., YARN, standalone? > Can you attach full TM and JM logs? > > Best, > Gary > > On Fri, Jan 18, 2019 at 3:05 PM Piotr Szczepanek < > piotr.szczepa...@gmail.com>

Flink 1.7.1 job is stuck in running state

2019-01-18 Thread Piotr Szczepanek
Hello, we have scenario with running Data Processing jobs that generates export files on demand. Our first approach was using ClusterClient, but recently we switched to REST API for job submittion. In the meantime we switched to flink 1.7.1 and that started to cause a problems. Some of our jobs