Seth Wiesman created FLINK-24464: ------------------------------------ Summary: Metrics sometimes report negative backlog Key: FLINK-24464 URL: https://issues.apache.org/jira/browse/FLINK-24464 Project: Flink Issue Type: Improvement Components: Stateful Functions Reporter: Seth Wiesman
As report [here| [https://stackoverflow.com/questions/69441309/negative-backlog-in-apache-flink-stateful-functions]] the backlog metric sometimes reports a negative value. This is because the current count is stored in an in-memory variable, while the value used to decrement the count as the backlog clears is stored in Flink state. In the case of a job restart, the in-memory variable is reset to zero (it is a new instance) while the numbers in state are retained. A negative backlog is non-sensical, confusing, and should be prevented. -- This message was sent by Atlassian Jira (v8.3.4#803005)