Hi Dongjoon,
Raised the JIRA at https://issues.apache.org/jira/browse/SPARK-38824
Thanks,
Souvik
From: Dongjoon Hyun
Sent: Wednesday, March 30, 2022 4:44 AM
To: Paul, Souvik [Engineering]
Cc: dev@spark.apache.org
Subject: Re: Probable bug in async commit of Kafka offset
Hi Dev,
I added a few debug statements at the following lines and found few issues.
1. At line 254 of override def compute(validTime: Time): Option[KafkaRDD[K, V]]
in DirectKafkaInputDStream.scala:
System.out.print("Called commitAll at time " + validTime + " " +
