Re: Exception in Flink 1.18 (Time should be non negative)

[Lasse Nedergaard]

Hi.  I also see it on my own machine too where I only run with one task manger.  Med venlig hilsen / Best regards Lasse Nedergaard Den 8. maj 2024 kl. 00.24 skrev Talat Uyarer <tal...@google.com>:  Hi Lasse, If there's a significant difference in the system time between Flink TaskManagers, it can lead to negative time calculations when comparing timestamps from different sources. On Mon, May 6, 2024 at 5:40 AM Lasse Nedergaard <lassenedergaardfl...@gmail.com> wrote: Hi.  In Flink jobs running 1.18 I see the error below sometimes. I Can see the same problem has been reported and fixed I 1.14  Anyone have an idea how to debug and/or work around this problem? java.lang.IllegalArgumentException: Time should be non negative                 at org.apache.flink.util.Preconditions.checkArgument(Preconditions.java:138) ~[flink-dist-1.18.0.jar:1.18.0]                 at org.apache.flink.runtime.throughput.ThroughputCalculator.calculateThroughput(ThroughputCalculator.java:80) ~[flink-dist-1.18.0.jar:1.18.0]                 at org.apache.flink.runtime.throughput.ThroughputCalculator.calculateThroughput(ThroughputCalculator.java:71) ~[flink-dist-1.18.0.jar:1.18.0]                 at org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate.triggerDebloating(SingleInputGate.java:450) ~[flink-dist-1.18.0.jar:1.18.0]                 at org.apache.flink.runtime.taskmanager.InputGateWithMetrics.triggerDebloating(InputGateWithMetrics.java:90) ~[flink-dist-1.18.0.jar:1.18.0]                 at org.apache.flink.streaming.runtime.tasks.StreamTask.debloat(StreamTask.java:843) ~[flink-dist-1.18.0.jar:1.18.0]                 at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$null$5(StreamTask.java:834) ~[flink-dist-1.18.0.jar:1.18.0]                 at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.runThrowing(StreamTaskActionExecutor.java:50) ~[flink-dist-1.18.0.jar:1.18.0]                 at org.apache.flink.streaming.runtime.tasks.mailbox.Mail.run(Mail.java:90) ~[flink-dist-1.18.0.jar:1.18.0]                 at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMail(MailboxProcessor.java:398) ~[flink-dist-1.18.0.jar:1.18.0]                 at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.processMailsWhenDefaultActionUnavailable(MailboxProcessor.java:367) ~[flink-dist-1.18.0.jar:1.18.0]                 at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.processMail(MailboxProcessor.java:352) ~[flink-dist-1.18.0.jar:1.18.0]                 at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:229) ~[flink-dist-1.18.0.jar:1.18.0]                 at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:858) ~[flink-dist-1.18.0.jar:1.18.0]                 at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:807) ~[flink-dist-1.18.0.jar:1.18.0]                 at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:953) ~[flink-dist-1.18.0.jar:1.18.0]                 at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:932) [flink-dist-1.18.0.jar:1.18.0]                 at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:746) [flink-dist-1.18.0.jar:1.18.0]                 at org.apache.flink.runtime.taskmanager.Task.run(Task.java:562) [flink-dist-1.18.0.jar:1.18.0]                 at java.lang.Thread.run(Unknown Source) [?:?] Med venlig hilsen / Best regards Lasse Nedergaard