Re: Uploading job jar via web UI in flink HA mode

2020-12-02 Thread sidhant gupta
11:31 AM sidhant gupta wrote: > >> Hi All, >> >> I have 2 job managers in flink HA mode cluster setup. I have a load >> balancer forwarding request to both (leader and stand by) the job managers >> in default round-robin fashion. While uploading the job jar the Web

Re: Uploading job jar via web UI in flink HA mode

2020-12-02 Thread Till Rohrmann
ation-for-aws Cheers, Till On Wed, Dec 2, 2020 at 11:31 AM sidhant gupta wrote: > Hi All, > > I have 2 job managers in flink HA mode cluster setup. I have a load > balancer forwarding request to both (leader and stand by) the job managers > in default round-robin fashion. While uploa

Uploading job jar via web UI in flink HA mode

2020-12-02 Thread sidhant gupta
Hi All, I have 2 job managers in flink HA mode cluster setup. I have a load balancer forwarding request to both (leader and stand by) the job managers in default round-robin fashion. While uploading the job jar the Web UI is fluctuating between the leader and standby page. Its difficult to upload

Zookeeper DR backup needed for Flink HA mode?

2018-05-15 Thread David Corley
We're looking at DR scenarios for our Flink cluster. We already use Zookeeper for JM HA. We use a HDFS cluster that's replicated off-site, and our high-availability.zookeeper.storageDir property is configure to use HDFS. However, in the event of a site-failure, is it also essential that we have a

Re: Flink HA mode

2015-09-10 Thread Ufuk Celebi
done yet. > > Best, Fabian > On Sep 10, 2015 01:29, "Emmanuel" wrote: > >> is this a 0.10 snapshot feature only? I'm using 0.9.1 right now >> >> >> -- >> From: ele...@msn.com >> To: user@flink.apache.org >&g

RE: Flink HA mode

2015-09-09 Thread Fabian Hueske
ng 0.9.1 right now > > > -- > From: ele...@msn.com > To: user@flink.apache.org > Subject: RE: Flink HA mode > Date: Wed, 9 Sep 2015 16:11:38 -0700 > > Been playing with the HA... > I find the UIs confusing here: > in the dashboard on one side I see 0 slots 0 taskmanag

RE: Flink HA mode

2015-09-09 Thread Emmanuel
is this a 0.10 snapshot feature only? I'm using 0.9.1 right now From: ele...@msn.com To: user@flink.apache.org Subject: RE: Flink HA mode Date: Wed, 9 Sep 2015 16:11:38 -0700 Been playing with the HA...I find the UIs confusing here: in the dashboard on one side I see 0 slots 0 taskman

RE: Flink HA mode

2015-09-09 Thread Emmanuel
e multiple JMs IPs in the jobmanager.rpc.address? Thanks Date: Wed, 9 Sep 2015 10:19:36 +0200 Subject: Re: Flink HA mode From: trohrm...@apache.org To: user@flink.apache.org The only necessary information for the JobManager and TaskManager is to know where to find the ZooKeeper quorum to do leader election

Re: Flink HA mode

2015-09-09 Thread Till Rohrmann
The only necessary information for the JobManager and TaskManager is to know where to find the ZooKeeper quorum to do leader election and retrieve the leader address from. This will be configured via the config parameter `ha.zookeeper.quorum`. On Wed, Sep 9, 2015 at 10:15 AM, Stephan Ewen wrote:

Re: Flink HA mode

2015-09-09 Thread Stephan Ewen
TL;DR is that you are right, it is only the initial list. If a JobManager comes back with a new IP address, it will be available. On Wed, Sep 9, 2015 at 8:35 AM, Ufuk Celebi wrote: > > > On 09 Sep 2015, at 04:48, Emmanuel wrote: > > > > my questions is: how critical is the bootstrap ip list in

Re: Flink HA mode

2015-09-08 Thread Ufuk Celebi
> On 09 Sep 2015, at 04:48, Emmanuel wrote: > > my questions is: how critical is the bootstrap ip list in masters? Hey Emmanuel, good questions. I read over the docs for this again [1] and you are right that we should make this clearer. The “masters" file is only relevant for the start/stop

RE: Flink HA mode

2015-09-08 Thread Emmanuel
my questions is: how critical is the bootstrap ip list in masters? does this get updated or does it have to be updated by some other service? From: zhangruc...@huawei.com To: user@flink.apache.org Subject: re: Flink HA mode Date: Wed, 9 Sep 2015 00:48:42 + In order to discover new

re: Flink HA mode

2015-09-08 Thread Zhangrucong
[mailto:ele...@msn.com] 发送时间: 2015年9月9日 7:59 收件人: user@flink.apache.org 主题: Flink HA mode Looking at Flink HA mode. Why do you need to have the list of masters in the config if zookeeper is used to keep track of them? In an environment like Google Cloud or Container Engine, the JM may come back up

Flink HA mode

2015-09-08 Thread Emmanuel
Looking at Flink HA mode. Why do you need to have the list of masters in the config if zookeeper is used to keep track of them? In an environment like Google Cloud or Container Engine, the JM may come back up but will likely have another IP address. Is the masters config file only for