[
https://issues.apache.org/jira/browse/BEAM-12306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Beam JIRA Bot updated BEAM-12306:
---------------------------------
Labels: (was: stale-P2)
> Add a native ParquetIO.ReadRows transform
> -----------------------------------------
>
> Key: BEAM-12306
> URL: https://issues.apache.org/jira/browse/BEAM-12306
> Project: Beam
> Issue Type: Improvement
> Components: dsl-sql, io-java-parquet
> Reporter: Ismaël Mejía
> Priority: P3
>
> ParquetIO today uses Avro's GenericRecord to materialize reads from Parquet
> records, this implies an extra conversion from GenericRecord to Beam's Row.
> We can 'push' this conversion into the source read process by implementing a
> RecordMaterializer that builds Rows at read time xtending Parquet's
> [ReadSupport|https://github.com/apache/parquet-mr/blob/master/parquet-hadoop/src/main/java/org/apache/parquet/hadoop/api/ReadSupport.java].
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
