DomGarguilo commented on PR #27:
URL: https://github.com/apache/accumulo-access/pull/27#issuecomment-1781534256
Benchmark results:
# miscImprovements branch
|Benchmark| Mode |Cnt|
Score| Error| Units|
|-------------|-----------|------------|--------|--------|------|
|AccessExpressionBenchmark.measureBytesParsing | thrpt | 12 |
**10.805**| ± 0.041 | ops/us|
|AccessExpressionBenchmark.measureEvaluation | thrpt | 12 |
**13.791**| ± 0.281| ops/us|
|AccessExpressionBenchmark.measureEvaluationAndParsing | thrpt | 12 |
**6.552** |± 0.121 | ops/us|
|AccessExpressionBenchmark.measureStringParsing | thrpt |12
|**9.864**| ± 0.051 | ops/us|
# main branch
|Benchmark| Mode |Cnt|
Score| Error| Units|
|-------------|-----------|------------|--------|--------|------|
|AccessExpressionBenchmark.measureBytesParsing | thrpt | 12 |
**9.450**| ± 0.170 | ops/us|
|AccessExpressionBenchmark.measureEvaluation | thrpt | 12 |
**14.012**| ± 0.107| ops/us|
|AccessExpressionBenchmark.measureEvaluationAndParsing | thrpt | 12 |
**6.015** |± 0.117 | ops/us|
|AccessExpressionBenchmark.measureStringParsing | thrpt |12
|**8.571**| ± 0.051 | ops/us|
<details>
<summary>Raw output</summary>
<br>
Misc improvements branch:
Result
"org.apache.accumulo.access.AccessExpressionBenchmark.measureStringParsing":
9.864 ±(99.9%) 0.051 ops/us [Average]
(min, avg, max) = (9.805, 9.864, 9.939), stdev = 0.040
CI (99.9%): [9.813, 9.914] (assumes normal distribution)
# Run complete. Total time: 00:11:08
REMEMBER: The numbers below are just data. To gain reusable insights, you
need to follow up on
why the numbers are the way they are. Use profilers (see -prof, -lprof),
design factorial
experiments, perform baseline and negative tests that provide experimental
control, make sure
the benchmarking environment is safe on JVM/OS/HW level, ask for reviews
from the domain experts.
Do not assume the numbers tell you what you want them to tell.
Benchmark Mode Cnt Score
Error Units
AccessExpressionBenchmark.measureBytesParsing thrpt 12 10.805 ±
0.041 ops/us
AccessExpressionBenchmark.measureEvaluation thrpt 12 13.791 ±
0.281 ops/us
AccessExpressionBenchmark.measureEvaluationAndParsing thrpt 12 6.552 ±
0.121 ops/us
AccessExpressionBenchmark.measureStringParsing thrpt 12 9.864 ±
0.051 ops/us
main branch:
Result
"org.apache.accumulo.access.AccessExpressionBenchmark.measureStringParsing":
8.571 ±(99.9%) 0.051 ops/us [Average]
(min, avg, max) = (8.514, 8.571, 8.621), stdev = 0.040
CI (99.9%): [8.521, 8.622] (assumes normal distribution)
# Run complete. Total time: 00:11:08
REMEMBER: The numbers below are just data. To gain reusable insights, you
need to follow up on
why the numbers are the way they are. Use profilers (see -prof, -lprof),
design factorial
experiments, perform baseline and negative tests that provide experimental
control, make sure
the benchmarking environment is safe on JVM/OS/HW level, ask for reviews
from the domain experts.
Do not assume the numbers tell you what you want them to tell.
Benchmark Mode Cnt Score
Error Units
AccessExpressionBenchmark.measureBytesParsing thrpt 12 9.450 ±
0.170 ops/us
AccessExpressionBenchmark.measureEvaluation thrpt 12 14.012 ±
0.107 ops/us
AccessExpressionBenchmark.measureEvaluationAndParsing thrpt 12 6.015 ±
0.117 ops/us
AccessExpressionBenchmark.measureStringParsing thrpt 12 8.571 ±
0.051 ops/us
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
