Re: Is there a lifecycle listener that gets notified when a topology starts/stops on a task manager

2019-09-24 Thread Stephen Connolly
I have created https://issues.apache.org/jira/browse/FLINK-14184 as a proposal to improve Flink in this specific area. On Tue, 24 Sep 2019 at 03:23, Zhu Zhu wrote: > Hi Stephen, > > I think disposing static components in the closing stage of a task is > required. > This is because your

Re: Is there a lifecycle listener that gets notified when a topology starts/stops on a task manager

2019-09-23 Thread Zhu Zhu
Hi Stephen, I think disposing static components in the closing stage of a task is required. This is because your code(operators/UDFs) is part of the task, namely that it can only be executed when the task is not disposed. Thanks, Zhu Zhu Stephen Connolly 于2019年9月24日周二 上午2:13写道: > Currently

Re: Is there a lifecycle listener that gets notified when a topology starts/stops on a task manager

2019-09-23 Thread Dian Fu
AFAIK, RichFunction is the only way you could take for this purpose. It's designed for life cycle management of functions. Regards, Dian > 在 2019年9月24日,上午2:13,Stephen Connolly 写道: > > Currently the best I can see is to make *everything* a Rich... and hook into > the open and close methods...

Re: Is there a lifecycle listener that gets notified when a topology starts/stops on a task manager

2019-09-23 Thread Stephen Connolly
Currently the best I can see is to make *everything* a Rich... and hook into the open and close methods... but feels very ugly. On Mon 23 Sep 2019 at 15:45, Stephen Connolly < stephen.alan.conno...@gmail.com> wrote: > We are using a 3rd party library that allocates some resources in one of >

Is there a lifecycle listener that gets notified when a topology starts/stops on a task manager

2019-09-23 Thread Stephen Connolly
We are using a 3rd party library that allocates some resources in one of our topologies. Is there a listener or something that gets notified when the topology starts / stops running in the Task Manager's JVM? The 3rd party library uses a singleton, so I need to initialize the singleton when the