Re: Feature requests for Flink protobuf deserialization

2023-07-05 Thread Benchao Li
Thanks for starting the discussion, 1. I'm +1 for this. 2. We have already supported this in [1] 3. I'm not sure about this, could you give more examples except the cases 1&2? 4&5. I think we also have considered this with the option 'protobuf.read-default-values' [2], is this what you want? [1]

Feature requests for Flink protobuf deserialization

2023-06-27 Thread Adam Richardson
Hi there, My company is in the process of rebuilding some of our batch Spark-based ETL pipelines in Flink. We use protobuf to define our schemas. One major challenge is that Flink protobuf deserialization has some semantic differences with the ScalaPB encoders we use in our Spark systems. This