bjornjorgensen commented on PR #40878: URL: https://github.com/apache/spark/pull/40878#issuecomment-1537501785
Here https://github.com/bjornjorgensen/GoogleThinkBenchmark is the code that I have used to test it. "com.google.crypto.tink" % "tink" % "1.6.1" ``` [info] compiling 5 Java sources to /home/bjorn/Documents/github/GoogleThinkBenchmark/target/scala-2.12/classes ... [info] running (fork) org.openjdk.jmh.Main [info] # JMH version: 1.31 [info] # VM version: JDK 17.0.6, OpenJDK 64-Bit Server VM, 17.0.6+10-Ubuntu-1ubuntu2 [info] # VM invoker: /usr/lib/jvm/java-17-openjdk-amd64/bin/java [info] # VM options: <none> [info] # Blackhole mode: full + dont-inline hint [info] # Warmup: 5 iterations, 10 s each [info] # Measurement: 5 iterations, 10 s each [info] # Timeout: 10 min per iteration [info] # Threads: 1 thread, will synchronize iterations [info] # Benchmark mode: Average time, time/op [info] # Benchmark: com.googlethinkbenchmark.GoogleThinkBenchmark.testAesGcmJceEncrypt [info] # Run progress: 0.00% complete, ETA 00:08:20 [info] # Fork: 1 of 5 [info] # Warmup Iteration 1: 79207785.709 ns/op [info] # Warmup Iteration 2: 75605599.346 ns/op [info] # Warmup Iteration 3: 76214904.538 ns/op [info] # Warmup Iteration 4: 76989327.792 ns/op [info] # Warmup Iteration 5: 77099889.177 ns/op [info] Iteration 1: 75762018.553 ns/op [info] Iteration 2: 75379888.865 ns/op [info] Iteration 3: 75498314.789 ns/op [info] Iteration 4: 75024163.500 ns/op [info] Iteration 5: 75680816.338 ns/op [info] # Run progress: 20.00% complete, ETA 00:06:43 [info] # Fork: 2 of 5 [info] # Warmup Iteration 1: 80245617.368 ns/op [info] # Warmup Iteration 2: 75652339.774 ns/op [info] # Warmup Iteration 3: 77061164.331 ns/op [info] # Warmup Iteration 4: 76287806.765 ns/op [info] # Warmup Iteration 5: 75317346.985 ns/op [info] Iteration 1: 75686301.880 ns/op [info] Iteration 2: 75330525.474 ns/op [info] Iteration 3: 75734112.594 ns/op [info] Iteration 4: 76288954.348 ns/op [info] Iteration 5: 76606136.962 ns/op [info] # Run progress: 40.00% complete, ETA 00:05:02 [info] # Fork: 3 of 5 [info] # Warmup Iteration 1: 80973643.427 ns/op [info] # Warmup Iteration 2: 77317109.354 ns/op [info] # Warmup Iteration 3: 76322130.439 ns/op [info] # Warmup Iteration 4: 76301836.621 ns/op [info] # Warmup Iteration 5: 77046937.308 ns/op [info] Iteration 1: 76474108.687 ns/op [info] Iteration 2: 77131903.554 ns/op [info] Iteration 3: 76728218.573 ns/op [info] Iteration 4: 77324718.069 ns/op [info] Iteration 5: 76930795.244 ns/op [info] # Run progress: 60.00% complete, ETA 00:03:21 [info] # Fork: 4 of 5 [info] # Warmup Iteration 1: 80497824.184 ns/op [info] # Warmup Iteration 2: 76670359.000 ns/op [info] # Warmup Iteration 3: 77410211.954 ns/op [info] # Warmup Iteration 4: 76880883.221 ns/op [info] # Warmup Iteration 5: 76903019.008 ns/op [info] Iteration 1: 76878110.405 ns/op [info] Iteration 2: 77073021.462 ns/op [info] Iteration 3: 76818391.687 ns/op [info] Iteration 4: 76985174.577 ns/op [info] Iteration 5: 76645837.389 ns/op [info] # Run progress: 80.00% complete, ETA 00:01:40 [info] # Fork: 5 of 5 [info] # Warmup Iteration 1: 80435216.312 ns/op [info] # Warmup Iteration 2: 76728526.878 ns/op [info] # Warmup Iteration 3: 76168514.106 ns/op [info] # Warmup Iteration 4: 75383839.180 ns/op [info] # Warmup Iteration 5: 75929712.985 ns/op [info] Iteration 1: 76427345.038 ns/op [info] Iteration 2: 76718093.679 ns/op [info] Iteration 3: 76872120.244 ns/op [info] Iteration 4: 76085370.545 ns/op [info] Iteration 5: 76203878.348 ns/op [info] Result "com.googlethinkbenchmark.GoogleThinkBenchmark.testAesGcmJceEncrypt": [info] 76331532.832 ±(99.9%) 488639.588 ns/op [Average] [info] (min, avg, max) = (75024163.500, 76331532.832, 77324718.069), stdev = 652319.870 [info] CI (99.9%): [75842893.244, 76820172.420] (assumes normal distribution) [info] # Run complete. Total time: 00:08:24 [info] REMEMBER: The numbers below are just data. To gain reusable insights, you need to follow up on [info] why the numbers are the way they are. Use profilers (see -prof, -lprof), design factorial [info] experiments, perform baseline and negative tests that provide experimental control, make sure [info] the benchmarking environment is safe on JVM/OS/HW level, ask for reviews from the domain experts. [info] Do not assume the numbers tell you what you want them to tell. [info] Benchmark Mode Cnt Score Error Units [info] GoogleThinkBenchmark.testAesGcmJceEncrypt avgt 25 76331532.832 ± 488639.588 ns/op [success] Total time: 509 s (08:29), completed May 7, 2023, 7:19:58 PM ``` "com.google.crypto.tink" % "tink" % "1.9.0" ``` [info] compiling 5 Java sources to /home/bjorn/Documents/github/GoogleThinkBenchmark/target/scala-2.12/classes ... [info] running (fork) org.openjdk.jmh.Main [info] # JMH version: 1.31 [info] # VM version: JDK 17.0.6, OpenJDK 64-Bit Server VM, 17.0.6+10-Ubuntu-1ubuntu2 [info] # VM invoker: /usr/lib/jvm/java-17-openjdk-amd64/bin/java [info] # VM options: <none> [info] # Blackhole mode: full + dont-inline hint [info] # Warmup: 5 iterations, 10 s each [info] # Measurement: 5 iterations, 10 s each [info] # Timeout: 10 min per iteration [info] # Threads: 1 thread, will synchronize iterations [info] # Benchmark mode: Average time, time/op [info] # Benchmark: com.googlethinkbenchmark.GoogleThinkBenchmark.testAesGcmJceEncrypt [info] # Run progress: 0.00% complete, ETA 00:08:20 [info] # Fork: 1 of 5 [info] # Warmup Iteration 1: 81974464.393 ns/op [info] # Warmup Iteration 2: 78344967.031 ns/op [info] # Warmup Iteration 3: 77870422.233 ns/op [info] # Warmup Iteration 4: 76366142.015 ns/op [info] # Warmup Iteration 5: 76969131.346 ns/op [info] Iteration 1: 77587424.279 ns/op [info] Iteration 2: 77137913.315 ns/op [info] Iteration 3: 76307498.705 ns/op [info] Iteration 4: 76561784.282 ns/op [info] Iteration 5: 77806261.512 ns/op [info] # Run progress: 20.00% complete, ETA 00:06:42 [info] # Fork: 2 of 5 [info] # Warmup Iteration 1: 80478869.944 ns/op [info] # Warmup Iteration 2: 77009168.477 ns/op [info] # Warmup Iteration 3: 77253208.562 ns/op [info] # Warmup Iteration 4: 77522236.047 ns/op [info] # Warmup Iteration 5: 77473338.262 ns/op [info] Iteration 1: 77294234.708 ns/op [info] Iteration 2: 77547845.969 ns/op [info] Iteration 3: 77319105.646 ns/op [info] Iteration 4: 77437665.792 ns/op [info] Iteration 5: 76279051.841 ns/op [info] # Run progress: 40.00% complete, ETA 00:05:02 [info] # Fork: 3 of 5 [info] # Warmup Iteration 1: 81151850.952 ns/op [info] # Warmup Iteration 2: 77319736.377 ns/op [info] # Warmup Iteration 3: 77127278.746 ns/op [info] # Warmup Iteration 4: 77566176.907 ns/op [info] # Warmup Iteration 5: 77195342.962 ns/op [info] Iteration 1: 77081135.108 ns/op [info] Iteration 2: 77275550.108 ns/op [info] Iteration 3: 76869123.466 ns/op [info] Iteration 4: 77654387.488 ns/op [info] Iteration 5: 77896922.171 ns/op [info] # Run progress: 60.00% complete, ETA 00:03:21 [info] # Fork: 4 of 5 [info] # Warmup Iteration 1: 82232457.566 ns/op [info] # Warmup Iteration 2: 78139230.227 ns/op [info] # Warmup Iteration 3: 78621229.438 ns/op [info] # Warmup Iteration 4: 78189807.516 ns/op [info] # Warmup Iteration 5: 78500250.758 ns/op [info] Iteration 1: 78417104.656 ns/op [info] Iteration 2: 77769043.891 ns/op [info] Iteration 3: 78550508.242 ns/op [info] Iteration 4: 78590966.453 ns/op [info] Iteration 5: 78112666.589 ns/op [info] # Run progress: 80.00% complete, ETA 00:01:40 [info] # Fork: 5 of 5 [info] # Warmup Iteration 1: 80581520.376 ns/op [info] # Warmup Iteration 2: 77263616.777 ns/op [info] # Warmup Iteration 3: 76836909.809 ns/op [info] # Warmup Iteration 4: 77991064.147 ns/op [info] # Warmup Iteration 5: 76437476.748 ns/op [info] Iteration 1: 77256809.777 ns/op [info] Iteration 2: 78291977.688 ns/op [info] Iteration 3: 77834381.442 ns/op [info] Iteration 4: 77869096.798 ns/op [info] Iteration 5: 77068233.792 ns/op [info] Result "com.googlethinkbenchmark.GoogleThinkBenchmark.testAesGcmJceEncrypt": [info] 77512667.749 ±(99.9%) 474041.907 ns/op [Average] [info] (min, avg, max) = (76279051.841, 77512667.749, 78590966.453), stdev = 632832.384 [info] CI (99.9%): [77038625.841, 77986709.656] (assumes normal distribution) [info] # Run complete. Total time: 00:08:23 [info] REMEMBER: The numbers below are just data. To gain reusable insights, you need to follow up on [info] why the numbers are the way they are. Use profilers (see -prof, -lprof), design factorial [info] experiments, perform baseline and negative tests that provide experimental control, make sure [info] the benchmarking environment is safe on JVM/OS/HW level, ask for reviews from the domain experts. [info] Do not assume the numbers tell you what you want them to tell. [info] Benchmark Mode Cnt Score Error Units [info] GoogleThinkBenchmark.testAesGcmJceEncrypt avgt 25 77512667.749 ± 474041.907 ns/op [success] Total time: 510 s (08:30), completed May 7, 2023, 7:34:13 PM ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
