Shangshu Qian created FLINK-38368: ------------------------------------- Summary: Potential Feedback Loop Involving a Heavy User Defined Aggregation Task Key: FLINK-38368 URL: https://issues.apache.org/jira/browse/FLINK-38368 Project: Flink Issue Type: Bug Affects Versions: 1.20.0 Reporter: Shangshu Qian
The delay begins at the reduction of a “User-defined function”, which can be heavy by itself. -> The intermediate task got delayed and cannot transition to the RELEASED state. -> The barrier task fails because one of the intermediate task does not finish, throwing runtime exceptions. -> Such a task can be retried, causing further increment in the aggregation task. -- This message was sent by Atlassian Jira (v8.20.10#820010)