[
https://issues.apache.org/jira/browse/HDDS-7983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Attila Doroszlai updated HDDS-7983:
-----------------------------------
Description:
{code}
[INFO] Running org.apache.hadoop.ozone.client.rpc.TestOzoneRpcClientWithRatis
[ERROR] java.lang.OutOfMemoryError: Java heap space
{code}
*
https://github.com/adoroszlai/ozone-build-results/blob/master/2022/12/19/19168/it-client/output.log
*
https://github.com/adoroszlai/ozone-build-results/blob/master/2023/01/24/19674/it-client/output.log
*
https://github.com/adoroszlai/ozone-build-results/blob/master/2023/01/25/19698/it-client/output.log
*
https://github.com/adoroszlai/ozone-build-results/blob/master/2023/01/30/19772/it-client/output.log
Dump from local run:
{code}
java.lang.OutOfMemoryError: Java heap space
at java.nio.HeapByteBuffer.<init>(HeapByteBuffer.java:57)
at java.nio.ByteBuffer.allocate(ByteBuffer.java:335)
at
org.apache.hadoop.hdds.scm.storage.StreamBuffer.allocate(StreamBuffer.java:56)
at
org.apache.hadoop.hdds.scm.storage.BlockDataStreamOutput.allocateNewBufferIfNeeded(BlockDataStreamOutput.java:286)
at
org.apache.hadoop.hdds.scm.storage.BlockDataStreamOutput.write(BlockDataStreamOutput.java:252)
at
org.apache.hadoop.ozone.client.io.BlockDataStreamOutputEntry.write(BlockDataStreamOutputEntry.java:108)
at
org.apache.hadoop.ozone.client.io.KeyDataStreamOutput.writeToDataStreamOutput(KeyDataStreamOutput.java:201)
at
org.apache.hadoop.ozone.client.io.KeyDataStreamOutput.handleWrite(KeyDataStreamOutput.java:179)
at
org.apache.hadoop.ozone.client.io.KeyDataStreamOutput.write(KeyDataStreamOutput.java:159)
at
org.apache.hadoop.ozone.client.io.OzoneDataStreamOutput.write(OzoneDataStreamOutput.java:44)
at
org.apache.hadoop.hdds.scm.storage.ByteBufferStreamOutput.write(ByteBufferStreamOutput.java:37)
at
org.apache.hadoop.ozone.client.rpc.TestOzoneRpcClientWithRatis.testUploadWithStreamAndMemoryMappedBuffer(TestOzoneRpcClientWithRatis.java:264)
{code}
CC [~szetszwo]
was:
{code}
[INFO] Running org.apache.hadoop.ozone.client.rpc.TestOzoneRpcClientWithRatis
[ERROR] java.lang.OutOfMemoryError: Java heap space
{code}
*
https://github.com/adoroszlai/ozone-build-results/blob/master/2022/12/19/19168/it-client/output.log
*
https://github.com/adoroszlai/ozone-build-results/blob/master/2023/01/24/19674/it-client/output.log
*
https://github.com/adoroszlai/ozone-build-results/blob/master/2023/01/25/19698/it-client/output.log
*
https://github.com/adoroszlai/ozone-build-results/blob/master/2023/01/30/19772/it-client/output.log
Dump from local run:
{code}
java.lang.OutOfMemoryError: Java heap space
at java.nio.HeapByteBuffer.<init>(HeapByteBuffer.java:57)
at java.nio.ByteBuffer.allocate(ByteBuffer.java:335)
at
org.apache.hadoop.hdds.scm.storage.StreamBuffer.allocate(StreamBuffer.java:56)
at
org.apache.hadoop.hdds.scm.storage.BlockDataStreamOutput.allocateNewBufferIfNeeded(BlockDataStreamOutput.java:286)
at
org.apache.hadoop.hdds.scm.storage.BlockDataStreamOutput.write(BlockDataStreamOutput.java:252)
at
org.apache.hadoop.ozone.client.io.BlockDataStreamOutputEntry.write(BlockDataStreamOutputEntry.java:108)
at
org.apache.hadoop.ozone.client.io.KeyDataStreamOutput.writeToDataStreamOutput(KeyDataStreamOutput.java:201)
at
org.apache.hadoop.ozone.client.io.KeyDataStreamOutput.handleWrite(KeyDataStreamOutput.java:179)
at
org.apache.hadoop.ozone.client.io.KeyDataStreamOutput.write(KeyDataStreamOutput.java:159)
at
org.apache.hadoop.ozone.client.io.OzoneDataStreamOutput.write(OzoneDataStreamOutput.java:44)
at
org.apache.hadoop.hdds.scm.storage.ByteBufferStreamOutput.write(ByteBufferStreamOutput.java:37)
at
org.apache.hadoop.ozone.client.rpc.TestOzoneRpcClientWithRatis.testUploadWithStreamAndMemoryMappedBuffer(TestOzoneRpcClientWithRatis.java:264)
{code}
> Intermittent OutOfMemoryError in
> TestOzoneRpcClientWithRatis#testUploadWithStreamAndMemoryMappedBuffer
> ------------------------------------------------------------------------------------------------------
>
> Key: HDDS-7983
> URL: https://issues.apache.org/jira/browse/HDDS-7983
> Project: Apache Ozone
> Issue Type: Sub-task
> Components: Ozone Client
> Affects Versions: 1.4.0
> Reporter: Attila Doroszlai
> Priority: Critical
>
> {code}
> [INFO] Running org.apache.hadoop.ozone.client.rpc.TestOzoneRpcClientWithRatis
> [ERROR] java.lang.OutOfMemoryError: Java heap space
> {code}
> *
> https://github.com/adoroszlai/ozone-build-results/blob/master/2022/12/19/19168/it-client/output.log
> *
> https://github.com/adoroszlai/ozone-build-results/blob/master/2023/01/24/19674/it-client/output.log
> *
> https://github.com/adoroszlai/ozone-build-results/blob/master/2023/01/25/19698/it-client/output.log
> *
> https://github.com/adoroszlai/ozone-build-results/blob/master/2023/01/30/19772/it-client/output.log
> Dump from local run:
> {code}
> java.lang.OutOfMemoryError: Java heap space
> at java.nio.HeapByteBuffer.<init>(HeapByteBuffer.java:57)
> at java.nio.ByteBuffer.allocate(ByteBuffer.java:335)
> at
> org.apache.hadoop.hdds.scm.storage.StreamBuffer.allocate(StreamBuffer.java:56)
> at
> org.apache.hadoop.hdds.scm.storage.BlockDataStreamOutput.allocateNewBufferIfNeeded(BlockDataStreamOutput.java:286)
> at
> org.apache.hadoop.hdds.scm.storage.BlockDataStreamOutput.write(BlockDataStreamOutput.java:252)
> at
> org.apache.hadoop.ozone.client.io.BlockDataStreamOutputEntry.write(BlockDataStreamOutputEntry.java:108)
> at
> org.apache.hadoop.ozone.client.io.KeyDataStreamOutput.writeToDataStreamOutput(KeyDataStreamOutput.java:201)
> at
> org.apache.hadoop.ozone.client.io.KeyDataStreamOutput.handleWrite(KeyDataStreamOutput.java:179)
> at
> org.apache.hadoop.ozone.client.io.KeyDataStreamOutput.write(KeyDataStreamOutput.java:159)
> at
> org.apache.hadoop.ozone.client.io.OzoneDataStreamOutput.write(OzoneDataStreamOutput.java:44)
> at
> org.apache.hadoop.hdds.scm.storage.ByteBufferStreamOutput.write(ByteBufferStreamOutput.java:37)
> at
> org.apache.hadoop.ozone.client.rpc.TestOzoneRpcClientWithRatis.testUploadWithStreamAndMemoryMappedBuffer(TestOzoneRpcClientWithRatis.java:264)
> {code}
> CC [~szetszwo]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
