austin3dickey opened a new issue, #40775: URL: https://github.com/apache/arrow/issues/40775
### Describe the bug, including details regarding any error messages, version, and platform. As part of the Arrow benchmarking suite, we have been running the [Java microbenchmarks](https://github.com/voltrondata-labs/benchmarks/blob/231078e715001c32d2f4ef2ffca27abb4625fd21/benchmarks/java_micro_benchmarks.py#L50) with Archery on every Arrow commit. They are run on a bare-metal machine with the characteristics listed in the "hardware" section of [this Conbench page](https://conbench.ursa.dev/benchmark-results/065fdf61d88f74978000a56a6131eba5/). Note that the benchmarks run [this Arrow CI script](https://github.com/apache/arrow/blob/main/ci/scripts/java_build.sh) to build Java Arrow, with the environment variables in [this file](https://github.com/apache/arrow/blob/main/dev/conbench_envs/benchmarks.env) used for building and running benchmarks. Starting with this PR's commit: - https://github.com/apache/arrow/pull/39708 the Java benchmarks have started to time out after the default timeout of 6 hours. They used to take less than an hour. Before timing out, the following traceback is printed: ``` Exception in thread "CommonsExecStreamPumper-pool-9-thread-2" java.lang.OutOfMemoryError: Java heap space at java.lang.StringCoding.decode(StringCoding.java:215) at java.lang.String.<init>(String.java:463) at java.lang.String.<init>(String.java:515) at com.gradle.d.a.a.a(SourceFile:83) at com.gradle.d.a.a.flush(SourceFile:78) at com.gradle.d.a.a.write(SourceFile:72) at java.io.PrintStream.write(PrintStream.java:480) at com.gradle.d.a.b.write(SourceFile:203) at org.apache.commons.exec.StreamPumper.run(StreamPumper.java:112) at java.lang.Thread.run(Thread.java:750) ``` I assume that the Java memory configs need to be changed, but I don't have any experience with Java. This could be an easy fix by changing the environment variable file linked above, and using `@ursabot please benchmark lang=Java` to see if the change fixed anything. Note that the microbenchmark results will not be tracked until this is fixed. ### Component(s) Benchmarking, Java -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
