yjshen commented on pull request #2132:
URL:
https://github.com/apache/arrow-datafusion/pull/2132#issuecomment-1085966913
On a newer Linux Desktop:
```
H/W path Device Class Description
====================================================================
system MS-7D53 (To be
filled by O.E.M.)
/0 bus MPG X570S EDGE MAX
WIFI (MS-7D53)
/0/0 memory 64KiB BIOS
/0/11 memory 32GiB System Memory
/0/11/0 memory 3600 MHz (0.3 ns)
[empty]
/0/11/1 memory 16GiB DIMM DDR4
Synchronous Unbuffered (Unregistered) 3600 MHz (0.3
/0/11/2 memory 3600 MHz (0.3 ns)
[empty]
/0/11/3 memory 16GiB DIMM DDR4
Synchronous Unbuffered (Unregistered) 3600 MHz (0.3
/0/14 memory 1MiB L1 cache
/0/15 memory 8MiB L2 cache
/0/16 memory 64MiB L3 cache
/0/17 processor AMD Ryzen 9 5950X
16-Core Processor
```
```
cargo run --release --features "mimalloc" --bin tpch -- benchmark datafusion
--iterations 3 --path ../../tpch-parquet/ --format parquet --query 1
--batch-size 4096
```
Without this PR:
```
Running benchmarks with the following options: DataFusionBenchmarkOpt {
query: 1, debug: false, iterations: 3, partitions: 2, batch_size: 4096, path:
"../../tpch-parquet/", file_format: "parquet", mem_table: false, output_path:
None }
Query 1 iteration 0 took 2851.7 ms and returned 6001214 rows
Query 1 iteration 1 took 2817.7 ms and returned 6001214 rows
Query 1 iteration 2 took 2735.9 ms and returned 6001214 rows
Query 1 avg time: 2801.75 ms
```
With this PR:
```
Running benchmarks with the following options: DataFusionBenchmarkOpt {
query: 1, debug: false, iterations: 3, partitions: 2, batch_size: 4096, path:
"../../tpch-parquet/", file_format: "parquet", mem_table: false, output_path:
None }
Query 1 iteration 0 took 2843.6 ms and returned 6001214 rows
Query 1 iteration 1 took 2824.4 ms and returned 6001214 rows
Query 1 iteration 2 took 2753.0 ms and returned 6001214 rows
Query 1 avg time: 2807.00 ms
```
Performances are similar.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
