zhztheplayer opened a new pull request, #9547: URL: https://github.com/apache/incubator-gluten/pull/9547
Add more information to the test report when `--sql-metrics=execution-time` is specified. Before: ``` Top 10 plan nodes that took longest time to execute: | Query | Node ID | Node Name | Execution Time (ns) | |--------|---------|--------------------------------------------------------|-------------------------------------------| | q1.sql| 864| FlushableHashAggregateExecTransformer| [time of aggregation] 184268837| | q1.sql| 859| ProjectExecTransformer| [time of project] 141018941| | q1.sql| 794| ScanTransformer parquet spark_catalog.default.lineitem| [time of scan] 12198000| | q1.sql| 870| VeloxResizeBatches| [time to append / split batches] 10000000| | q1.sql| 871| ColumnarExchange| [shuffle wall time] 8930861| | q1.sql| 871| ColumnarExchange| [time to split] 8915168| | q1.sql| 1009| RegularHashAggregateExecTransformer| [time of aggregation] 897235| | q1.sql| 1012| ColumnarExchange| [shuffle wall time] 639323| | q1.sql| 1012| ColumnarExchange| [time to split] 637339| | q1.sql| 871| ColumnarExchange| [time to deserialize] 612300| Test report: Summary: 1 out of 1 queries passed. | Query ID | Was Passed | Row Count | Plan Time (Millis) | Query Time (Millis) | |----------|------------|-----------|--------------------|---------------------| | q1| true| 4| 300| 1025| | q1| true| 4| 300| 1025| No failed queries. ``` After: ``` Top 10 plan nodes that took longest time to execute: | Query | Node ID | Node Name | Node Time (ns) | |--------|---------|--------------------------------------------------------|----------------| | q1.sql| 755| FlushableHashAggregateExecTransformer| 185334095| | q1.sql| 750| ProjectExecTransformer| 142123707| | q1.sql| 762| ColumnarExchange| 20997903| | q1.sql| 685| ScanTransformer parquet spark_catalog.default.lineitem| 11391000| | q1.sql| 761| VeloxResizeBatches| 10000000| | q1.sql| 903| ColumnarExchange| 1557093| | q1.sql| 900| RegularHashAggregateExecTransformer| 1283039| | q1.sql| 902| VeloxResizeBatches| 1000000| | q1.sql| 981| SortExecTransformer| 354799| | q1.sql| 756| ProjectExecTransformer| 199577| Top 30 computation steps that took longest time to execute: | Query | Node ID | Node Name | Step Time (ns) | |--------|---------|--------------------------------------------------------|-------------------------------------------| | q1.sql| 755| FlushableHashAggregateExecTransformer| [time of aggregation] 185334095| | q1.sql| 750| ProjectExecTransformer| [time of project] 142123707| | q1.sql| 685| ScanTransformer parquet spark_catalog.default.lineitem| [time of scan] 11391000| | q1.sql| 762| ColumnarExchange| [shuffle wall time] 10162137| | q1.sql| 762| ColumnarExchange| [time to split] 10135455| | q1.sql| 761| VeloxResizeBatches| [time to append / split batches] 10000000| | q1.sql| 900| RegularHashAggregateExecTransformer| [time of aggregation] 1114532| | q1.sql| 902| VeloxResizeBatches| [time to append / split batches] 1000000| | q1.sql| 762| ColumnarExchange| [time to deserialize] 700311| | q1.sql| 903| ColumnarExchange| [shuffle wall time] 700139| | q1.sql| 903| ColumnarExchange| [time to split] 698126| | q1.sql| 981| SortExecTransformer| [time of sort] 354799| | q1.sql| 756| ProjectExecTransformer| [time of project] 199577| | q1.sql| 900| RegularHashAggregateExecTransformer| [time of rowConstruction] 168507| | q1.sql| 903| ColumnarExchange| [time to deserialize] 158828| | q1.sql| 983| VeloxColumnarToRow| [time to convert] 0| | q1.sql| 903| ColumnarExchange| [time to decompress] 0| | q1.sql| 903| ColumnarExchange| [fetch wait time] 0| | q1.sql| 762| ColumnarExchange| [time to decompress] 0| | q1.sql| 762| ColumnarExchange| [fetch wait time] 0| | q1.sql| 755| FlushableHashAggregateExecTransformer| [time of rowConstruction] 0| | q1.sql| 690| FilterExecTransformer| [time of filter] 0| | q1.sql| 685| ScanTransformer parquet spark_catalog.default.lineitem| [dynamic partition pruning time] 0| | q1.sql| 685| ScanTransformer parquet spark_catalog.default.lineitem| [remaining filter time] 0| Test report: Summary: 1 out of 1 queries passed. | Query ID | Was Passed | Row Count | Plan Time (Millis) | Query Time (Millis) | |----------|------------|-----------|--------------------|---------------------| | q1| true| 4| 332| 1114| | q1| true| 4| 332| 1114| No failed queries. ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
