[ https://issues.apache.org/jira/browse/BEAM-7929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16903164#comment-16903164 ]
Neville Li commented on BEAM-7929: ---------------------------------- For column projection, {{BeamSqlTable}} already has potentially user defined schema and can leverage that when setting up reader logic in {{buildIOReader}}. There is no notion of filter predicate though, which could potentially be inferred from SQL {{WHERE}} clause. Is there a ticket to track that? It's probably big in scope and involving analyzing Calcite plan? > ParquetTable.buildIOReader should support column projection and filter > predicate > -------------------------------------------------------------------------------- > > Key: BEAM-7929 > URL: https://issues.apache.org/jira/browse/BEAM-7929 > Project: Beam > Issue Type: New Feature > Components: dsl-sql > Affects Versions: 2.14.0 > Reporter: Neville Li > Priority: Critical > > To leverage the performance improvements in Parquet. -- This message was sent by Atlassian JIRA (v7.6.14#76016)