kaisun2000 opened a new issue, #14344:
URL: https://github.com/apache/druid/issues/14344
Kafka ingestion task has the following warning:
`
2023-05-25T20:47:11,184 WARN [task-runner-0-priority-0]
org.apache.druid.indexing.kafka.IncrementalPublishingKafkaIndexTaskRunner -
OffsetOutOfRangeException with message [Fetch position
FetchPosition{offset=4791341818, offsetEpoch=Optional.empty,
currentLeader=LeaderAndEpoch{leader=Optional[...
`
This seems to signify the Kafka client can't locate data in the Kafka server
side. The data is lost in the Kafka server either due to out of retention or
server operation issues. This error is not recoverable from the Kafka ingestion
task perspective.
We should instead fail the task or at least give some signal in the metrics?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
