Parth Chandra created SPARK-47291:
-------------------------------------
Summary: Add Parquet file reader metrics to scan
Key: SPARK-47291
URL: https://issues.apache.org/jira/browse/SPARK-47291
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 4.0.0
Reporter: Parth Chandra
With the addition of external metrics support in Parquet
([PARQUET-2374|https://issues.apache.org/jira/browse/PARQUET-2374]), it is now
possible to gather file level scan metrics and have them displayed in a Parquet
Scan's metrics. This can be done for both DSV1 and DSV2 implementations by
providing a ParquetMetricsCallback implementation
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
