[
https://issues.apache.org/jira/browse/IMPALA-13641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17910427#comment-17910427
]
ASF subversion and git services commented on IMPALA-13641:
----------------------------------------------------------
Commit 1907153ab5092b13ed0ab0cb52b66705cc7a903f in impala's branch
refs/heads/master from Riza Suminto
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=1907153ab ]
IMPALA-13641: Lazily init Parquet column read counters
ParquetUncompressedBytesReadPerColumn and
ParquetCompressedBytesReadPerColumn exist in runtime profile even when
no parquet file is read (all scan text files). This patch lazily init
those counters only if HdfsScanNodeBase::bytes_read_per_col_ is not
empty.
Testing:
- Run and pass TestParquet::test_bytes_read_per_column.
- Run TestTpcdsInsert and confirm no Parquet specific counters exist
when reading TEXTFILE table.
Change-Id: I8ba767b69b8c432f0eb954aa54f86876b329160c
Reviewed-on: http://gerrit.cloudera.org:8080/22297
Reviewed-by: Michael Smith <[email protected]>
Reviewed-by: Csaba Ringhofer <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
> Parquet specific counters should not exist if not reading any parquet file
> --------------------------------------------------------------------------
>
> Key: IMPALA-13641
> URL: https://issues.apache.org/jira/browse/IMPALA-13641
> Project: IMPALA
> Issue Type: Improvement
> Components: Backend
> Affects Versions: Impala 4.4.0
> Reporter: Riza Suminto
> Assignee: Riza Suminto
> Priority: Minor
>
> While working on IMPALA-13636, I notice that
> ParquetUncompressedBytesReadPerColumn and ParquetCompressedBytesReadPerColumn
> exist in runtime profile even when no parquet file is read (all scan text
> files). These counters should be lazily created only if
> HdfsScanNodeBase::bytes_read_per_col_ is not empty.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
