ddcprg commented on issue #9045: URL: https://github.com/apache/pinot/issues/9045#issuecomment-1182009568
There is no other way but contact the schema registry during ingestion, the schema ID is in the value payload and only known during ingestion. Messages in the same topic may refer to different schemas each and if the schema is not already cached then it needs to be retrieved - worst case the decoder will have to download a schema per message. The current code uses a caching schema registry client: https://github.com/apache/pinot/blob/master/pinot-plugins/pinot-input-format/pinot-confluent-avro/src/main/java/org/apache/pinot/plugin/inputformat/avro/confluent/KafkaConfluentSchemaRegistryAvroMessageDecoder.java#L95 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
