kennknowles opened a new issue, #18965:
URL: https://github.com/apache/beam/issues/18965
I came a cross avro-protobuf support which allows to write Protobuf messages
to avro file and then read them back as a) GenericRecords or b) as Protobuf
typed message
Quite nice feature I am looking for. I do not know much about what is
happening behind the scenes, if there are not some hidden problems and
limitations e.g. on schema compatibility when evolving proto messages etc.
So what I want to ask is:
- Was this feature ever considered, to enable existing AvroIO code to use
also ProtobufDatumReader and ProtobufDatumWriter? Any wisdom what I should be
aware of?
- Would it make sense to add it to AvroIO ?
P.S.: I wanted to add it on the side for my needs and testing it but I did
not find an easy way of doing it. Writer infrastructure is easy to extend by
implementing custom FileIO.Sink but read side seems to be hard nut to crack
without copy-pasting much code from AvroIO and AvroSource.
Imported from Jira
[BEAM-4758](https://issues.apache.org/jira/browse/BEAM-4758). Original Jira may
contain additional context.
Reported by: JozoVilcek.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
