See <https://ci-beam.apache.org/job/beam_Java_JMH/1/display/redirect>
Changes:
------------------------------------------
[...truncated 375.83 KB...]
# Run progress: 78.07% complete, ETA 00:17:39
# Fork: 3 of 3
# Warmup Iteration 1: 20748548.302 ops/s
# Warmup Iteration 2: 20756359.095 ops/s
# Warmup Iteration 3: 20753534.347 ops/s
# Warmup Iteration 4: 20747824.405 ops/s
# Warmup Iteration 5: 20763201.513 ops/s
Iteration 1: 20748966.308 ops/s
Iteration 2: 20749832.481 ops/s
Iteration 3: 20748990.746 ops/s
Iteration 4: 20739914.575 ops/s
Iteration 5: 20759173.719 ops/s
Result
"org.apache.beam.fn.harness.jmh.control.MetricsBenchmark.testCounterCellReset":
20756160.043 ±(99.9%) 8662.714 ops/s [Average]
(min, avg, max) = (20739914.575, 20756160.043, 20765353.383), stdev = 8103.108
CI (99.9%): [20747497.330, 20764822.757] (assumes normal distribution)
# JMH version: 1.34
# VM version: JDK 1.8.0_342, OpenJDK 64-Bit Server VM, 25.342-b07
# VM invoker: /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java
# VM options:
-javaagent:/home/jenkins/.gradle/caches/modules-2/files-2.1/io.github.stephankoelle/jamm/0.4.1/df04e7daebba29088daaf1a00f103863b9df61c2/jamm-0.4.1.jar
-Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant
# Blackhole mode: full + dont-inline hint (auto-detected, use
-Djmh.blackhole.autoDetect=false to disable)
# Warmup: 5 iterations, 10 s each
# Measurement: 5 iterations, 10 s each
# Timeout: 10 min per iteration
# Threads: 16 threads, will synchronize iterations
# Benchmark mode: Throughput, ops/time
# Benchmark:
org.apache.beam.fn.harness.jmh.logging.BeamFnLoggingClientBenchmark.testLogging
# Run progress: 80.26% complete, ETA 00:15:52
# Fork: 1 of 3
# Warmup Iteration 1: 331026.858 ops/s
# Warmup Iteration 2: 363924.515 ops/s
# Warmup Iteration 3: 374086.360 ops/s
# Warmup Iteration 4: 372554.261 ops/s
# Warmup Iteration 5: 370690.872 ops/s
Iteration 1: 377983.322 ops/s
Iteration 2: 366988.301 ops/s
Iteration 3: 361686.256 ops/s
Iteration 4: 369207.198 ops/s
Iteration 5: 371157.591 ops/s
# Run progress: 82.46% complete, ETA 00:14:05
# Fork: 2 of 3
# Warmup Iteration 1: 333618.502 ops/s
# Warmup Iteration 2: 352536.794 ops/s
# Warmup Iteration 3: 356175.434 ops/s
# Warmup Iteration 4: 358874.877 ops/s
# Warmup Iteration 5: 356119.381 ops/s
Iteration 1: 356449.290 ops/s
Iteration 2: 352427.705 ops/s
Iteration 3: 356173.616 ops/s
Iteration 4: 348330.366 ops/s
Iteration 5: 352753.515 ops/s
# Run progress: 84.65% complete, ETA 00:12:19
# Fork: 3 of 3
# Warmup Iteration 1: 323785.995 ops/s
# Warmup Iteration 2: 344668.254 ops/s
# Warmup Iteration 3: 350331.362 ops/s
# Warmup Iteration 4: 351146.110 ops/s
# Warmup Iteration 5: 342016.973 ops/s
Iteration 1: 347967.140 ops/s
Iteration 2: 344737.175 ops/s
Iteration 3: 344156.824 ops/s
Iteration 4: 343639.642 ops/s
Iteration 5: 331331.082 ops/s
Result
"org.apache.beam.fn.harness.jmh.logging.BeamFnLoggingClientBenchmark.testLogging":
354999.268 ±(99.9%) 13403.920 ops/s [Average]
(min, avg, max) = (331331.082, 354999.268, 377983.322), stdev = 12538.035
CI (99.9%): [341595.348, 368403.188] (assumes normal distribution)
# JMH version: 1.34
# VM version: JDK 1.8.0_342, OpenJDK 64-Bit Server VM, 25.342-b07
# VM invoker: /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java
# VM options:
-javaagent:/home/jenkins/.gradle/caches/modules-2/files-2.1/io.github.stephankoelle/jamm/0.4.1/df04e7daebba29088daaf1a00f103863b9df61c2/jamm-0.4.1.jar
-Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant
# Blackhole mode: full + dont-inline hint (auto-detected, use
-Djmh.blackhole.autoDetect=false to disable)
# Warmup: 5 iterations, 10 s each
# Measurement: 5 iterations, 10 s each
# Timeout: 10 min per iteration
# Threads: 16 threads, will synchronize iterations
# Benchmark mode: Throughput, ops/time
# Benchmark:
org.apache.beam.fn.harness.jmh.logging.BeamFnLoggingClientBenchmark.testLoggingWithAllOptionalParameters
# Run progress: 86.84% complete, ETA 00:10:33
# Fork: 1 of 3
# Warmup Iteration 1: 297383.455 ops/s
# Warmup Iteration 2: 332599.655 ops/s
# Warmup Iteration 3: 335231.212 ops/s
# Warmup Iteration 4: 332766.182 ops/s
# Warmup Iteration 5: 339308.182 ops/s
Iteration 1: 341403.916 ops/s
Iteration 2: 327708.384 ops/s
Iteration 3: 331321.975 ops/s
Iteration 4: 337650.402 ops/s
Iteration 5: 339008.246 ops/s
# Run progress: 89.04% complete, ETA 00:08:47
# Fork: 2 of 3
# Warmup Iteration 1: 303992.404 ops/s
# Warmup Iteration 2: 315531.157 ops/s
# Warmup Iteration 3: 315715.845 ops/s
# Warmup Iteration 4: 322670.575 ops/s
# Warmup Iteration 5: 321499.257 ops/s
Iteration 1: 314191.804 ops/s
Iteration 2: 326987.360 ops/s
Iteration 3: 326675.376 ops/s
Iteration 4: 323321.415 ops/s
Iteration 5: 322690.542 ops/s
# Run progress: 91.23% complete, ETA 00:07:01
# Fork: 3 of 3
# Warmup Iteration 1: 313601.867 ops/s
# Warmup Iteration 2: 341656.649 ops/s
# Warmup Iteration 3: 342303.485 ops/s
# Warmup Iteration 4: 336939.748 ops/s
# Warmup Iteration 5: 337759.786 ops/s
Iteration 1: 340057.309 ops/s
Iteration 2: 340374.346 ops/s
Iteration 3: 333889.312 ops/s
Iteration 4: 337294.870 ops/s
Iteration 5: 324212.016 ops/s
Result
"org.apache.beam.fn.harness.jmh.logging.BeamFnLoggingClientBenchmark.testLoggingWithAllOptionalParameters":
331119.151 ±(99.9%) 8744.186 ops/s [Average]
(min, avg, max) = (314191.804, 331119.151, 341403.916), stdev = 8179.317
CI (99.9%): [322374.966, 339863.337] (assumes normal distribution)
# JMH version: 1.34
# VM version: JDK 1.8.0_342, OpenJDK 64-Bit Server VM, 25.342-b07
# VM invoker: /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java
# VM options:
-javaagent:/home/jenkins/.gradle/caches/modules-2/files-2.1/io.github.stephankoelle/jamm/0.4.1/df04e7daebba29088daaf1a00f103863b9df61c2/jamm-0.4.1.jar
-Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant
# Blackhole mode: full + dont-inline hint (auto-detected, use
-Djmh.blackhole.autoDetect=false to disable)
# Warmup: 5 iterations, 10 s each
# Measurement: 5 iterations, 10 s each
# Timeout: 10 min per iteration
# Threads: 16 threads, will synchronize iterations
# Benchmark mode: Throughput, ops/time
# Benchmark:
org.apache.beam.fn.harness.jmh.logging.BeamFnLoggingClientBenchmark.testSkippedLogging
# Run progress: 93.42% complete, ETA 00:05:16
# Fork: 1 of 3
# Warmup Iteration 1: 8483931336.381 ops/s
# Warmup Iteration 2: 8483097289.500 ops/s
# Warmup Iteration 3: 8533582099.128 ops/s
# Warmup Iteration 4: 8538986914.430 ops/s
# Warmup Iteration 5: 8539813052.937 ops/s
Iteration 1: 8534895095.169 ops/s
Iteration 2: 8539815283.047 ops/s
Iteration 3: 8537345834.564 ops/s
Iteration 4: 8532614996.663 ops/s
Iteration 5: 8539545750.183 ops/s
# Run progress: 95.61% complete, ETA 00:03:30
# Fork: 2 of 3
# Warmup Iteration 1: 8475508818.372 ops/s
# Warmup Iteration 2: 8466723677.887 ops/s
# Warmup Iteration 3: 8543507542.404 ops/s
# Warmup Iteration 4: 8537569094.852 ops/s
# Warmup Iteration 5: 8541733705.682 ops/s
Iteration 1: 8543983358.881 ops/s
Iteration 2: 8541551696.873 ops/s
Iteration 3: 8537384406.724 ops/s
Iteration 4: 8541004353.461 ops/s
Iteration 5: 8540781605.678 ops/s
# Run progress: 97.81% complete, ETA 00:01:45
# Fork: 3 of 3
# Warmup Iteration 1: 8481892589.864 ops/s
# Warmup Iteration 2: 8475804347.158 ops/s
# Warmup Iteration 3: 8539779520.841 ops/s
# Warmup Iteration 4: 8541038180.635 ops/s
# Warmup Iteration 5: 8543303312.312 ops/s
Iteration 1: 8538171556.381 ops/s
Iteration 2: 8525253897.580 ops/s
Iteration 3: 8537590069.113 ops/s
Iteration 4: 8533200018.309 ops/s
Iteration 5: 8536413811.052 ops/s
Result
"org.apache.beam.fn.harness.jmh.logging.BeamFnLoggingClientBenchmark.testSkippedLogging":
8537303448.912 ±(99.9%) 4876063.991 ops/s [Average]
(min, avg, max) = (8525253897.580, 8537303448.912, 8543983358.881), stdev =
4561073.282
CI (99.9%): [8532427384.921, 8542179512.902] (assumes normal distribution)
# Run complete. Total time: 01:19:55
REMEMBER: The numbers below are just data. To gain reusable insights, you need
to follow up on
why the numbers are the way they are. Use profilers (see -prof, -lprof), design
factorial
experiments, perform baseline and negative tests that provide experimental
control, make sure
the benchmarking environment is safe on JVM/OS/HW level, ask for reviews from
the domain experts.
Do not assume the numbers tell you what you want them to tell.
Benchmark
(globallyWindowed) Mode Cnt Score Error Units
CombinerTableBenchmark.uniformDistribution
true thrpt 15 15.720 ± 1.033 ops/s
CombinerTableBenchmark.uniformDistribution
false thrpt 15 6.718 ± 0.046 ops/s
ProcessBundleBenchmark.testLargeBundle
N/A thrpt 15 1084.923 ± 55.604 ops/s
ProcessBundleBenchmark.testStateWithCaching
N/A thrpt 15 3398.557 ± 82.906 ops/s
ProcessBundleBenchmark.testStateWithoutCaching
N/A thrpt 15 1835.709 ± 31.249 ops/s
ProcessBundleBenchmark.testTinyBundle
N/A thrpt 15 18551.910 ± 344.705 ops/s
control.ExecutionStateSamplerBenchmark.testLargeBundleHarnessStateSampler
N/A thrpt 15 54231.191 ± 13119.824 ops/s
control.ExecutionStateSamplerBenchmark.testLargeBundleRunnersCoreStateSampler
N/A thrpt 15 25906.562 ± 7171.872 ops/s
control.ExecutionStateSamplerBenchmark.testTinyBundleHarnessStateSampler
N/A thrpt 15 2715771.327 ± 86439.894 ops/s
control.ExecutionStateSamplerBenchmark.testTinyBundleRunnersCoreStateSampler
N/A thrpt 15 7162911.380 ± 724629.666 ops/s
control.MetricsBenchmark.testBundleProcessingThreadCounterMutation
N/A thrpt 15 534676751.285 ± 890183.269 ops/s
control.MetricsBenchmark.testBundleProcessingThreadCounterReset
N/A thrpt 15 255471512.698 ± 96760.530 ops/s
control.MetricsBenchmark.testCounterCellMutation
N/A thrpt 15 60832155.871 ± 30709.582 ops/s
control.MetricsBenchmark.testCounterCellReset
N/A thrpt 15 20756160.043 ± 8662.714 ops/s
logging.BeamFnLoggingClientBenchmark.testLogging
N/A thrpt 15 354999.268 ± 13403.920 ops/s
logging.BeamFnLoggingClientBenchmark.testLoggingWithAllOptionalParameters
N/A thrpt 15 331119.151 ± 8744.186 ops/s
logging.BeamFnLoggingClientBenchmark.testSkippedLogging
N/A thrpt 15 8537303448.912 ± 4876063.991 ops/s
Oct 02, 2022 1:56:13 AM
org.apache.beam.sdk.testutils.publishing.InfluxDBPublisher publishWithCheck
WARNING: Missing property -- measurement/database. Metrics won't be published.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:core:jmh:jmh'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 20m 47s
67 actionable tasks: 42 executed, 23 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/i7yvn5o34by3i
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]