[
https://issues.apache.org/jira/browse/BEAM-6394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16743013#comment-16743013
]
Lukasz Gajowy commented on BEAM-6394:
-------------------------------------
Generally, it would be best to avoid converting to avro but while we were
creating this IO we needed to use the AvroParquetWriter and AvroParquetReader
that required this conversion. +1 for the new feature if this is possible to
implement it in Beam (I haven't tried your approach). Feel free to submit PRs.
I'll gladly review and help (if you need any). Thanks!
> Support for writing protobuf data to parquet
> --------------------------------------------
>
> Key: BEAM-6394
> URL: https://issues.apache.org/jira/browse/BEAM-6394
> Project: Beam
> Issue Type: New Feature
> Components: io-java-parquet
> Reporter: Jozef Vilcek
> Assignee: Lukasz Gajowy
> Priority: Major
>
> Parquet infrastructure does support writing protobuf data to parquet. Beam's
> ParquetIO could give pipeline developers an option to write protobuf data
> instead of converting them to avro.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
