jihoonson commented on issue #7926: Kafka Indexing breaks due to Mismatched DatSourceMetadata types during InternalReset call URL: https://github.com/apache/incubator-druid/issues/7926#issuecomment-503668558 @acdn-mpreston thank you for digging into this issue. `resetInternal` can be called in several situations and I think that's why this error occurs occasionally. I think the bug is, the `dataSourceMetadata` stored in metadata store is always the "end" metadata, but some places create "start" metadata for reset. Here is the list of where it creates start metadata. - https://github.com/apache/incubator-druid/blob/master/extensions-core/kafka-indexing-service/src/main/java/org/apache/druid/indexing/kafka/supervisor/KafkaSupervisor.java#L285 - https://github.com/apache/incubator-druid/blob/master/extensions-core/kinesis-indexing-service/src/main/java/org/apache/druid/indexing/kinesis/supervisor/KinesisSupervisor.java#L272 - https://github.com/apache/incubator-druid/blob/master/indexing-service/src/main/java/org/apache/druid/indexing/seekablestream/SeekableStreamIndexTaskRunner.java#L1286 I think changing these places to create end metadata instead would fix this issue.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
