rok commented on issue #38432:
URL: https://github.com/apache/arrow/issues/38432#issuecomment-1777365984
On eba5044687372787c88ba800d580b2183eae3325 I ran:
```
archery benchmark run --output=run-head-1.json HEAD~1
--benchmark-filter=DictDecodingByteArray
archery benchmark diff HEAD run-head-1.json
--benchmark-filter=DictDecodingByteArray
---
```
And actually got a small regression (but could be noise):
```
--------------------------------------------------------------------------------------------------------------------------
Benchmark
Time CPU Iterations UserCounters...
--------------------------------------------------------------------------------------------------------------------------
BM_DictDecodingByteArray/max-string-length:8/batch-size:512 2750
ns 2750 ns 257429 bytes_per_second=1.3859G/s
items_per_second=186.194M/s
BM_DictDecodingByteArray/max-string-length:64/batch-size:512 3405
ns 3405 ns 207141 bytes_per_second=5.05129G/s
items_per_second=150.383M/s
BM_DictDecodingByteArray/max-string-length:1024/batch-size:512 10643
ns 10642 ns 67129 bytes_per_second=23.1467G/s
items_per_second=48.1097M/s
BM_DictDecodingByteArray/max-string-length:8/batch-size:2048 7744
ns 7744 ns 90086 bytes_per_second=1.96492G/s
items_per_second=264.454M/s
BM_DictDecodingByteArray/max-string-length:64/batch-size:2048 10882
ns 10882 ns 63705 bytes_per_second=6.29198G/s
items_per_second=188.207M/s
BM_DictDecodingByteArray/max-string-length:1024/batch-size:2048 56034
ns 56034 ns 14860 bytes_per_second=17.5095G/s
items_per_second=36.5494M/s
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Non-regressions: (5)
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
benchmark
baseline contender change %
counters
BM_DictDecodingByteArray/max-string-length:8/batch-size:2048 1.951
GiB/sec 1.965 GiB/sec 0.706 {'family_index': 0,
'per_family_instance_index': 3, 'run_name':
'BM_DictDecodingByteArray/max-string-length:8/batch-size:2048', 'repetitions':
1, 'repetition_index': 0, 'threads': 1, 'iterations': 86664}
BM_DictDecodingByteArray/max-string-length:1024/batch-size:512 23.075
GiB/sec 23.147 GiB/sec 0.310 {'family_index': 0,
'per_family_instance_index': 2, 'run_name':
'BM_DictDecodingByteArray/max-string-length:1024/batch-size:512',
'repetitions': 1, 'repetition_index': 0, 'threads': 1, 'iterations': 69531}
BM_DictDecodingByteArray/max-string-length:64/batch-size:2048 6.302
GiB/sec 6.292 GiB/sec -0.154 {'family_index': 0,
'per_family_instance_index': 4, 'run_name':
'BM_DictDecodingByteArray/max-string-length:64/batch-size:2048', 'repetitions':
1, 'repetition_index': 0, 'threads': 1, 'iterations': 64627}
BM_DictDecodingByteArray/max-string-length:64/batch-size:512 5.097
GiB/sec 5.051 GiB/sec -0.901 {'family_index': 0,
'per_family_instance_index': 1, 'run_name':
'BM_DictDecodingByteArray/max-string-length:64/batch-size:512', 'repetitions':
1, 'repetition_index': 0, 'threads': 1, 'iterations': 205168}
BM_DictDecodingByteArray/max-string-length:8/batch-size:512 1.410
GiB/sec 1.386 GiB/sec -1.730 {'family_index': 0,
'per_family_instance_index': 0, 'run_name':
'BM_DictDecodingByteArray/max-string-length:8/batch-size:512', 'repetitions':
1, 'repetition_index': 0, 'threads': 1, 'iterations': 259846}
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Regressions: (1)
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
benchmark
baseline contender change %
counters
BM_DictDecodingByteArray/max-string-length:1024/batch-size:2048 21.256
GiB/sec 17.510 GiB/sec -17.626 {'family_index': 0,
'per_family_instance_index': 5, 'run_name':
'BM_DictDecodingByteArray/max-string-length:1024/batch-size:2048',
'repetitions': 1, 'repetition_index': 0, 'threads': 1, 'iterations': 15530}
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
