Re: Task manager errors with Flink ZooKeeper High Availability

2022-02-23 Thread Sigalit Eliazov
> > Thanks > > Noa > > > > *From: *Chesnay Schepler > *Date: *Thursday, 17 February 2022 at 15:00 > *To: *Koffman, Noa (Nokia - IL/Kfar Sava) > , Yun Gao > , user > > *Subject: *Re: Task manager errors with Flink ZooKeeper High Availability > > Eve

Re: Task manager errors with Flink ZooKeeper High Availability

2022-02-17 Thread Chesnay Schepler
Schepler *Date: *Thursday, 17 February 2022 at 15:00 *To: *Koffman, Noa (Nokia - IL/Kfar Sava) , Yun Gao , user *Subject: *Re: Task manager errors with Flink ZooKeeper High Availability Everything is fine. The TM tries to retrieve the jar (aka, the blob), and there is a fast path to access it

Re: Task manager errors with Flink ZooKeeper High Availability

2022-02-17 Thread Koffman, Noa (Nokia - IL/Kfar Sava)
? Is there any way to achieve this? Thanks Noa From: Chesnay Schepler Date: Thursday, 17 February 2022 at 15:00 To: Koffman, Noa (Nokia - IL/Kfar Sava) , Yun Gao , user Subject: Re: Task manager errors with Flink ZooKeeper High Availability Everything is fine. The TM tries to retrieve the jar

Re: Task manager errors with Flink ZooKeeper High Availability

2022-02-17 Thread Chesnay Schepler
-edge.svc.cluster.local/10.1.10.213:6124/ // Thanks Noa *From: *Yun Gao *Date: *Thursday, 17 February 2022 at 14:04 *To: *Koffman, Noa (Nokia - IL/Kfar Sava) , user *Subject: *Re: Task manager errors with Flink ZooKeeper High Availability Hi Koffman, From TM side the only possible usage

Re: Task manager errors with Flink ZooKeeper High Availability

2022-02-17 Thread Koffman, Noa (Nokia - IL/Kfar Sava)
, 17 February 2022 at 14:04 To: Koffman, Noa (Nokia - IL/Kfar Sava) , user Subject: Re: Task manager errors with Flink ZooKeeper High Availability Hi Koffman, >From TM side the only possible usage come to me is that or components like >BlobCache, which is used to transfer jars or larg

Re: Task manager errors with Flink ZooKeeper High Availability

2022-02-17 Thread Yun Gao
Hi Koffman, From TM side the only possible usage come to me is that or components like BlobCache, which is used to transfer jars or large task informations between JM and TM. But specially for BlobService, if it failed to find the file it would turn to JM via http connection. If convenient could

Task manager errors with Flink ZooKeeper High Availability

2022-02-16 Thread Koffman, Noa (Nokia - IL/Kfar Sava)
Hi, We are currently running flink in session deployment on k8s cluster, with 1 job-manager and 3 task-managers To support recovery from job-manager failure, following a different mail thread, We have enabled zookeeper high availability using a k8s Persistent Volume To achieve this, we’ve added