pitrou commented on pull request #10487:
URL: https://github.com/apache/arrow/pull/10487#issuecomment-870768509
Locally, I seem to get varying results from run to run (and also depending
on the compiler), but `archery benchmark diff` doesn't show very worrying
regressions:
```
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Non-regressions: (11)
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
benchmark baseline contender change
%
counters
ArrayArrayKernel<KleeneAnd>/524288/1 4.309 GiB/sec 5.868 GiB/sec
36.176 {'run_name': 'ArrayArrayKernel<KleeneAnd>/524288/1', 'repetitions':
0, 'repetition_index': 0, 'threads': 1, 'iterations': 6226, 'null_percent':
100.0}
ArrayArrayKernel<KleeneAnd>/524288/10 4.337 GiB/sec 5.888 GiB/sec
35.749 {'run_name': 'ArrayArrayKernel<KleeneAnd>/524288/10', 'repetitions':
0, 'repetition_index': 0, 'threads': 1, 'iterations': 6226, 'null_percent':
10.0}
ArrayArrayKernel<KleeneAnd>/524288/100 4.335 GiB/sec 5.850 GiB/sec
34.939 {'run_name': 'ArrayArrayKernel<KleeneAnd>/524288/100', 'repetitions':
0, 'repetition_index': 0, 'threads': 1, 'iterations': 6232, 'null_percent': 1.0}
ArrayArrayKernel<KleeneAnd>/524288/10000 4.318 GiB/sec 5.755 GiB/sec
33.290 {'run_name': 'ArrayArrayKernel<KleeneAnd>/524288/10000', 'repetitions':
0, 'repetition_index': 0, 'threads': 1, 'iterations': 6221, 'null_percent':
0.01}
ArrayArrayKernel<KleeneAnd>/524288/2 4.365 GiB/sec 5.762 GiB/sec
31.994 {'run_name': 'ArrayArrayKernel<KleeneAnd>/524288/2', 'repetitions':
0, 'repetition_index': 0, 'threads': 1, 'iterations': 6200, 'null_percent':
50.0}
ArrayArrayKernel<KleeneAnd>/32768/1 3.204 GiB/sec 4.220 GiB/sec
31.726 {'run_name': 'ArrayArrayKernel<KleeneAnd>/32768/1', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 75304, 'null_percent': 100.0}
ArrayArrayKernel<KleeneAnd>/32768/2 3.370 GiB/sec 4.212 GiB/sec
24.961 {'run_name': 'ArrayArrayKernel<KleeneAnd>/32768/2', 'repetitions':
0, 'repetition_index': 0, 'threads': 1, 'iterations': 77611, 'null_percent':
50.0}
ArrayArrayKernel<KleeneAnd>/32768/10000 3.360 GiB/sec 4.197 GiB/sec
24.906 {'run_name': 'ArrayArrayKernel<KleeneAnd>/32768/10000', 'repetitions':
0, 'repetition_index': 0, 'threads': 1, 'iterations': 76897, 'null_percent':
0.01}
ArrayArrayKernel<KleeneAnd>/32768/10 3.373 GiB/sec 4.208 GiB/sec
24.745 {'run_name': 'ArrayArrayKernel<KleeneAnd>/32768/10', 'repetitions':
0, 'repetition_index': 0, 'threads': 1, 'iterations': 76903, 'null_percent':
10.0}
ArrayArrayKernel<KleeneAnd>/32768/100 3.383 GiB/sec 4.202 GiB/sec
24.212 {'run_name': 'ArrayArrayKernel<KleeneAnd>/32768/100', 'repetitions':
0, 'repetition_index': 0, 'threads': 1, 'iterations': 77559, 'null_percent':
1.0}
ArrayArrayKernel<KleeneAnd>/32768/0 7.838 GiB/sec 7.956 GiB/sec
1.499 {'run_name': 'ArrayArrayKernel<KleeneAnd>/32768/0', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 187182, 'null_percent': 0.0}
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Regressions: (1)
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
benchmark baseline contender change %
counters
ArrayArrayKernel<KleeneAnd>/524288/0 15.853 GiB/sec 14.343 GiB/sec -9.527
{'run_name': 'ArrayArrayKernel<KleeneAnd>/524288/0', 'repetitions': 0,
'repetition_index': 0, 'threads': 1, 'iterations': 23504, 'null_percent': 0.0}
```
(on Ubuntu 20.04, AMD Ryzen 3900)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
