[
https://issues.apache.org/jira/browse/HBASE-28133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17772446#comment-17772446
]
Istvan Toth edited comment on HBASE-28133 at 10/6/23 6:16 AM:
--------------------------------------------------------------
Further testing reveals that it's not an aarch_64 vs x86_64 issue, the
increased memory consumption is tied to RHEL8.8
On my Ubuntu 22.04 x86_64 laptop the test requires *1700m* of heap.
On RHEL 8.8 AWS VMs the test requires the full default {*}2200m{*}, both on
aarch_64 and x86_64.
Each OS has the same OpenJDK version 1.8.0_382 (from the OS repo), and the test
is run with the default options apart from Xmx:
{noformat}
mvn test -pl hbase-server -Dtest=TestSyncTimeRangeTracker
-Dsurefire.Xmx=2200m{noformat}
was (Author: stoty):
Further testing reveals that it's not an aarch_64 vs x86_64 issue, the
increased memory consumption is tied to RHEL8.8
On my Ubuntu 22.04 x86_64 laptop the test requires *1700m* of heap.
On RHEL 8.8 AWS VMs the test requires the full default {*}2200m{*}, both on
aarch_64 and x86_64.
Each OS has the same OpenJDK version 1.8.0_382 (from the OS repo), and uses the
default options apart from Xmx:
{noformat}
mvn test -pl hbase-server -Dtest=TestSyncTimeRangeTracker
-Dsurefire.Xmx=2200m{noformat}
> TestSyncTimeRangeTracker fails with OOM on RHEL 8.8
> ---------------------------------------------------
>
> Key: HBASE-28133
> URL: https://issues.apache.org/jira/browse/HBASE-28133
> Project: HBase
> Issue Type: Bug
> Affects Versions: 2.4.17
> Reporter: Istvan Toth
> Assignee: Istvan Toth
> Priority: Major
> Labels: Arm64, test
>
> Edit: It's related to the OS and it's default java 8 , not to the processor
> architecture.
> This test seems to be cutting real close to the heap size.
> On ARM, it consistently fails on my RHEL8.8 Aarch64 VM with Java 8.
> {noformat}
> mvn test -P runDevTests -Dtest.build.data.basedirectory=/ram2G
> -Dhadoop.profile=3.0 -fn -B -Dtest=TestSyncTimeRangeTracker* -pl hbase-server
> ...
> [ERROR]
> org.apache.hadoop.hbase.regionserver.TestSyncTimeRangeTracker.testConcurrentIncludeTimestampCorrectness
> Time elapsed: 1.969 s <<< ERROR!
> java.lang.OutOfMemoryError: Java heap space
> {noformat}
> It seems that Java on ARM has some higher memory overhead than x86_64.
> Simply bumping -Xmx from the default 2200m to 2300m allows it to pass.
> {noformat}
> mvn test -P runDevTests -Dtest.build.data.basedirectory=/ram2G
> -Dhadoop.profile=3.0 -fn -B -Dtest=TestSyncTimeRangeTracker* -pl hbase-server
> -Dsurefire.Xmx=2300m
> ...
> [INFO] Running org.apache.hadoop.hbase.regionserver.TestSyncTimeRangeTracker
> [INFO] Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.395
> s - in org.apache.hadoop.hbase.regionserver.TestSyncTimeRangeTracker
> {noformat}
> However, the real solution should be reducing the memory usage for this test.
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
