Francisco Morillo created FLINK-39142:
-----------------------------------------
Summary: Support AWS Glue Schema Registry Protobuf for Table API
Key: FLINK-39142
URL: https://issues.apache.org/jira/browse/FLINK-39142
Project: Flink
Issue Type: Improvement
Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile)
Reporter: Francisco Morillo
Fix For: aws-connector-6.0.0
The flink-connector-aws project currently has no Protobuf support for AWS Glue
Schema Registry at the Table API / SQL level.
This adds a new flink-protobuf-glue-schema-registry module with a
GlueSchemaRegistryProtobufFormatFactory so users can use 'format' =
'protobuf-glue' in CREATE TABLE statements to read and write Protobuf data
through GSR.
This is the Protobuf counterpart to FLINK-24379 (Avro) and FLINK-39141 (JSON).
It reuses the shared config infrastructure (GlueFormatOptions,
GlueFormatConfigBuilder) introduced in FLINK-24379.
Includes:
- New module flink-protobuf-glue-schema-registry
- GlueSchemaRegistryProtobufFormatFactory (DeserializationFormatFactory +
SerializationFormatFactory)
- GsrProtobufRowDataSerializationSchema /
GsrProtobufRowDataDeserializationSchema
- ProtobufSchemaConverter, ProtobufToRowDataConverter (RowData <-> Protobuf
DynamicMessage conversion)
- SQL packaging module (flink-sql-protobuf-glue-schema-registry)
- Unit tests, property-based tests, integration tests with mock GSR facades
- E2E test scaffold
- Documentation (protobuf-glue.md)
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
