vrongmeal commented on PR #4795:
URL: https://github.com/apache/arrow-rs/pull/4795#issuecomment-1711756840
Updated changes:
```
❯ cargo bench --bench csv_reader
Compiling arrow-csv v46.0.0 (/Users/vrongmeal/Projects/arrow-rs/arrow-csv)
Compiling arrow v46.0.0 (/Users/vrongmeal/Projects/arrow-rs/arrow)
Finished bench [optimized] target(s) in 4.89s
Running benches/csv_reader.rs
(target/release/deps/csv_reader-dadff296bc34e88b)
4096 u64(0) - 128 time: [228.45 µs 228.63 µs 228.84 µs]
change: [+3.2331% +3.4075% +3.5555%] (p = 0.00 <
0.05)
Performance has regressed.
Found 4 outliers among 100 measurements (4.00%)
2 (2.00%) low mild
2 (2.00%) high mild
4096 u64(0) - 1024 time: [199.65 µs 199.84 µs 200.02 µs]
change: [+3.5994% +3.7003% +3.8060%] (p = 0.00 <
0.05)
Performance has regressed.
Found 2 outliers among 100 measurements (2.00%)
1 (1.00%) high mild
1 (1.00%) high severe
4096 u64(0) - 4096 time: [207.64 µs 208.42 µs 209.10 µs]
change: [+1.6002% +2.2305% +2.8814%] (p = 0.00 <
0.05)
Performance has regressed.
4096 i64(0) - 128 time: [252.46 µs 252.63 µs 252.85 µs]
change: [-1.1848% -1.0121% -0.8452%] (p = 0.00 <
0.05)
Change within noise threshold.
4096 i64(0) - 1024 time: [226.17 µs 226.28 µs 226.40 µs]
change: [-1.3198% -1.2067% -1.1007%] (p = 0.00 <
0.05)
Performance has improved.
Found 3 outliers among 100 measurements (3.00%)
3 (3.00%) high mild
4096 i64(0) - 4096 time: [237.37 µs 238.27 µs 239.31 µs]
change: [-0.2543% +0.2821% +0.8587%] (p = 0.33 >
0.05)
No change in performance detected.
4096 f32(0) - 128 time: [242.69 µs 242.96 µs 243.22 µs]
change: [+0.2529% +0.4053% +0.5640%] (p = 0.00 <
0.05)
Change within noise threshold.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild
4096 f32(0) - 1024 time: [216.50 µs 216.94 µs 217.40 µs]
change: [+0.8552% +1.0164% +1.1941%] (p = 0.00 <
0.05)
Change within noise threshold.
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high mild
4096 f32(0) - 4096 time: [218.59 µs 219.23 µs 219.86 µs]
change: [-2.4562% -2.1355% -1.7614%] (p = 0.00 <
0.05)
Performance has improved.
Found 12 outliers among 100 measurements (12.00%)
10 (10.00%) low mild
1 (1.00%) high mild
1 (1.00%) high severe
4096 f64(0) - 128 time: [265.63 µs 266.24 µs 266.88 µs]
change: [+0.7456% +0.9606% +1.2133%] (p = 0.00 <
0.05)
Change within noise threshold.
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high mild
4096 f64(0) - 1024 time: [235.71 µs 235.82 µs 235.95 µs]
change: [+0.2742% +0.3610% +0.4471%] (p = 0.00 <
0.05)
Change within noise threshold.
Found 8 outliers among 100 measurements (8.00%)
5 (5.00%) high mild
3 (3.00%) high severe
4096 f64(0) - 4096 time: [247.69 µs 249.25 µs 250.70 µs]
change: [-0.6911% +0.0159% +0.7584%] (p = 0.96 >
0.05)
No change in performance detected.
Found 29 outliers among 100 measurements (29.00%)
12 (12.00%) low severe
3 (3.00%) low mild
10 (10.00%) high mild
4 (4.00%) high severe
4096 string(10, 0) - 128
time: [120.22 µs 120.44 µs 120.66 µs]
change: [-0.1170% +0.0390% +0.1963%] (p = 0.63 >
0.05)
No change in performance detected.
4096 string(10, 0) - 1024
time: [101.07 µs 101.10 µs 101.15 µs]
change: [-0.1678% -0.0755% +0.0136%] (p = 0.11 >
0.05)
No change in performance detected.
Found 11 outliers among 100 measurements (11.00%)
2 (2.00%) low mild
4 (4.00%) high mild
5 (5.00%) high severe
4096 string(10, 0) - 4096
time: [118.83 µs 119.73 µs 120.52 µs]
change: [+1.7587% +2.7841% +3.7795%] (p = 0.00 <
0.05)
Performance has regressed.
4096 string(30, 0) - 128
time: [199.96 µs 200.23 µs 200.45 µs]
change: [-0.4955% -0.3786% -0.2600%] (p = 0.00 <
0.05)
Change within noise threshold.
4096 string(30, 0) - 1024
time: [178.41 µs 178.47 µs 178.54 µs]
change: [-0.3514% -0.2803% -0.2062%] (p = 0.00 <
0.05)
Change within noise threshold.
Found 6 outliers among 100 measurements (6.00%)
5 (5.00%) high mild
1 (1.00%) high severe
4096 string(30, 0) - 4096
time: [184.26 µs 186.21 µs 188.00 µs]
change: [-1.9326% -0.9923% -0.1373%] (p = 0.02 <
0.05)
Change within noise threshold.
4096 string(100, 0) - 128
time: [430.75 µs 431.09 µs 431.41 µs]
change: [-0.3590% -0.2513% -0.1409%] (p = 0.00 <
0.05)
Change within noise threshold.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild
4096 string(100, 0) - 1024
time: [474.17 µs 479.79 µs 484.65 µs]
change: [+5.4907% +7.2059% +8.9017%] (p = 0.00 <
0.05)
Performance has regressed.
4096 string(100, 0) - 4096
time: [435.40 µs 436.45 µs 437.52 µs]
change: [-2.3235% -2.1234% -1.8919%] (p = 0.00 <
0.05)
Performance has improved.
Found 14 outliers among 100 measurements (14.00%)
11 (11.00%) high mild
3 (3.00%) high severe
4096 string(100, 0.5) - 128
time: [310.66 µs 312.32 µs 315.34 µs]
change: [-2.0074% -1.5844% -0.9803%] (p = 0.00 <
0.05)
Change within noise threshold.
Found 4 outliers among 100 measurements (4.00%)
2 (2.00%) high mild
2 (2.00%) high severe
4096 string(100, 0.5) - 1024
time: [291.23 µs 292.01 µs 292.91 µs]
change: [-4.9235% -4.1627% -3.4117%] (p = 0.00 <
0.05)
Performance has improved.
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high mild
4096 string(100, 0.5) - 4096
time: [305.76 µs 306.96 µs 308.23 µs]
change: [-1.0322% -0.4965% +0.0523%] (p = 0.07 >
0.05)
No change in performance detected.
Benchmarking 4096 string(20, 0.5), string(30, 0), string(100, 0), i64(0) -
128: Collecting 100 samples in estimated 9.54096 string(20, 0.5), string(30,
0), string(100, 0), i64(0) - 128
time: [949.42 µs 950.06 µs 950.69 µs]
change: [-0.3684% -0.2576% -0.1468%] (p = 0.00 <
0.05)
Change within noise threshold.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild
Benchmarking 4096 string(20, 0.5), string(30, 0), string(100, 0), i64(0) -
1024: Collecting 100 samples in estimated 8.4096 string(20, 0.5), string(30,
0), string(100, 0), i64(0) - 1024
time: [887.01 µs 888.57 µs 890.18 µs]
change: [-1.5528% -1.4042% -1.2439%] (p = 0.00 <
0.05)
Performance has improved.
Found 5 outliers among 100 measurements (5.00%)
5 (5.00%) high mild
Benchmarking 4096 string(20, 0.5), string(30, 0), string(100, 0), i64(0) -
4096: Collecting 100 samples in estimated 9.4096 string(20, 0.5), string(30,
0), string(100, 0), i64(0) - 4096
time: [900.61 µs 909.35 µs 917.34 µs]
change: [-0.2915% +0.6089% +1.5111%] (p = 0.18 >
0.05)
No change in performance detected.
Benchmarking 4096 string(20, 0.5), string(30, 0), f64(0), i64(0) - 128:
Collecting 100 samples in estimated 7.7663 s (14096 string(20, 0.5), string(30,
0), f64(0), i64(0) - 128
time: [770.68 µs 777.47 µs 790.18 µs]
change: [-0.1682% +1.5906% +4.4086%] (p = 0.21 >
0.05)
No change in performance detected.
Found 4 outliers among 100 measurements (4.00%)
1 (1.00%) high mild
3 (3.00%) high severe
Benchmarking 4096 string(20, 0.5), string(30, 0), f64(0), i64(0) - 1024:
Collecting 100 samples in estimated 7.1337 s (4096 string(20, 0.5), string(30,
0), f64(0), i64(0) - 1024
time: [706.19 µs 707.05 µs 707.90 µs]
change: [-0.6163% -0.3262% -0.0437%] (p = 0.03 <
0.05)
Change within noise threshold.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high severe
Benchmarking 4096 string(20, 0.5), string(30, 0), f64(0), i64(0) - 4096:
Collecting 100 samples in estimated 7.0071 s (4096 string(20, 0.5), string(30,
0), f64(0), i64(0) - 4096
time: [694.56 µs 695.28 µs 696.04 µs]
change: [-0.8192% -0.6161% -0.4063%] (p = 0.00 <
0.05)
Change within noise threshold.
Found 8 outliers among 100 measurements (8.00%)
1 (1.00%) low mild
7 (7.00%) high mild
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
