LuciferYang commented on PR #37258: URL: https://github.com/apache/spark/pull/37258#issuecomment-1195084600
https://github.com/apache/spark/blob/72b55ccf8327c00e173ab6130fdb428ad0d5aacc/project/SparkBuild.scala#L1194-L1199 I change the 2 `-Xmx4g` in `SparkBuild.scala` to `-Xmx3200m` and add `-XX:+UseG1GC` options, but still found logs as follows: ``` sbt.ForkMain 42403 failed with exit code 137 2022-07-26T05:27:04.8785522Z [warn] In the last 3341 seconds, 19.769 (0.6%) were spent in GC. [Heap: 3.28GB free of 3.99GB, max 3.99GB] Consider increasing the JVM heap using `-Xmx` or try a different collector, e.g. `-XX:+UseG1GC`, for better performance. 2022-07-26T05:27:06.9932313Z [error] (hive / Test / test) sbt.TestsFailedException: Tests unsuccessful 2022-07-26T05:27:07.0186283Z [error] Total time: 3343 s (55:43), completed Jul 26, 2022 5:27:07 AM 2022-07-26T05:27:07.7573628Z [error] running /home/runner/work/spark/spark/build/sbt -Phadoop-3 -Phive -Dtest.include.tags=org.apache.spark.tags.SlowHiveTest hive/test ; received return code 1 ``` The max heap size still 4GB, it doesn't seem understandable, -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
