Re: SplitEnumeratorContext callAsync() cleanup

Hi Fabian, Unfortunately, I don't have the log since I was just testing it out on my local setup. I can try to reproduce it later in the week. Best, Mason On Mon, Oct 25, 2021 at 8:09 AM Fabian Paul wrote: > Hi Mason, > > Thanks for opening the ticket. Can you also share the log with us when t

Re: SplitEnumeratorContext callAsync() cleanup

Hi Mason, Thanks for opening the ticket. Can you also share the log with us when the KafkaEnumerator closed before the async call finished? Best, Fabian

Re: SplitEnumeratorContext callAsync() cleanup

Hi Fabian, Here we are: https://issues.apache.org/jira/browse/FLINK-24622 Feel free to modify the description as I lazily copied and pasted our discussion here. Best, Mason > On Oct 22, 2021, at 3:31 AM, Fabian Paul wrote: > > Hi Mason, >

Re: SplitEnumeratorContext callAsync() cleanup

Hi Mason, This seems to be a bug with the current KafkaSource and also the unified Sources in general. Can you open a bug ticket in jira? I think the enumerator should take of first joining all the async threads before closing the enumerator. Best, Fabian

SplitEnumeratorContext callAsync() cleanup

Hi all, I was wondering how to cancel a task that is enqueued by the callAsync() method, the one that takes in a time interval. For example, the KafkaSource uses this for topic partition discovery. It would be straightforward if the API returned the underlying future so that a process can cancel i