xushiyan commented on issue #10217: URL: https://github.com/apache/hudi/issues/10217#issuecomment-3826056321
@zachtrong @lycanlee @stuartweir this is caused by having older version of confluent schema registry client not able to process unrecognized schema returned by newer version of confluent schema registry server. Neither Hudi release 0.14.x (confluent client 5.3.4 https://github.com/confluentinc/schema-registry/blob/v5.3.4/client/src/main/java/io/confluent/kafka/schemaregistry/client/rest/entities/SchemaString.java) nor master version (confluent client 5.5.0 https://github.com/confluentinc/schema-registry/blob/v5.5.0/client/src/main/java/io/confluent/kafka/schemaregistry/client/rest/entities/SchemaString.java) can process the schema (contains un-ignorable `metadata` field, etc), which is only supported with confluent client 7.4+ (https://github.com/confluentinc/schema-registry/blob/v7.4.0/client/src/main/java/io/confluent/kafka/schemaregistry/client/rest/entities/SchemaString.java) If you maintain your own Hudi fork, build Hudi utilities bundle with upgraded confluent client version should work. We can probably upgrade the confluent client version in Hudi 1.2 release, as long as it's verified to be backward-compatible. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
