voonhous commented on code in PR #17833:
URL: https://github.com/apache/hudi/pull/17833#discussion_r2945924556
##########
hudi-client/hudi-flink-client/src/main/java/org/apache/hudi/util/HoodieSchemaConverter.java:
##########
@@ -550,6 +552,26 @@ private static DataType convertUnion(HoodieSchema schema) {
return nullable ? rawDataType.nullable() : rawDataType;
}
+ /**
+ * Converts a Variant schema to Flink's ROW type.
+ * Variant is represented as ROW<`value` BYTES, `metadata` BYTES> in Flink.
+ * // TODO: We are only supporting unshredded for now, support shredded in
the future
+ *
+ * @param schema HoodieSchema to convert (must be a VARIANT type)
+ * @return DataType representing the Variant as a ROW with binary fields
+ */
+ private static DataType convertVariant(HoodieSchema schema) {
+ if (schema.getType() != HoodieSchemaType.VARIANT) {
+ throw new IllegalStateException("Expected HoodieSchema.Variant but got:
" + schema.getClass());
+ }
+
+ // Variant is stored as a struct with two binary fields: value and metadata
+ return DataTypes.ROW(
Review Comment:
It's already there, pelase check the entire class in
`ITTestVariantCrossEngineCompatibility`.
For example:
`org.apache.hudi.table.ITTestVariantCrossEngineCompatibility#testFlinkReadSparkVariantCOWTable`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
