liyafan82 commented on pull request #8210:
URL: https://github.com/apache/arrow/pull/8210#issuecomment-725281667
> At my end, I can generate the following JSON file by `archery benchmark
diff --language=java ...`
>
> @liyafan82 any comments regarding format and parameters are appreciated.
>
> ```
> benchmark baseline
contender change %
counters
> 0 org.apache.arrow.vector.IntBenchmarks.setIntDirectly 22.500 us/op
11.209 us/op -50.182 {'mode': 'avgt', 'threads': 1, 'warmups': 5,
'warmupTime': '10 s', 'measurements': 4, 'measurementTime': '10 s', 'jvmArgs':
['-Darrow.enable_null_check_for_get=false
-Darrow.enable_unsafe_memory_access=true']}
> 2 org.apache.arrow.vector.IntBenchmarks.setWithValueHolder 19.031 us/op
6.627 us/op -65.179 {'mode': 'avgt', 'threads': 1, 'warmups': 5,
'warmupTime': '10 s', 'measurements': 4, 'measurementTime': '10 s', 'jvmArgs':
['-Darrow.enable_null_check_for_get=false
-Darrow.enable_unsafe_memory_access=true']}
> 1 org.apache.arrow.vector.IntBenchmarks.setWithWriter 32.626 us/op
10.246 us/op -68.594 {'mode': 'avgt', 'threads': 1, 'warmups': 5,
'warmupTime': '10 s', 'measurements': 4, 'measurementTime': '10 s', 'jvmArgs':
['-Darrow.enable_null_check_for_get=false
-Darrow.enable_unsafe_memory_access=true']}
> ```
@kiszk Thanks for your effort. Generally, it looks great! Some minor
comments:
1. It is clearer to rename title 'counters' to 'configuration'?
2. I am curious how are the benchmarks sorted, by 'change %'?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]