renshangtao commented on issue #3950:
URL: https://github.com/apache/iceberg/issues/3950#issuecomment-1068138868
Hi , i got the same question with you.
I use flink session mode to run some job，and after several jobs finished , i
used top command to see the memory of linux，i foud the memory is only a little
left，and the taskmanager will be kill by the Linux because of oom
But i get what you have modify, and test again, the question is also here.
I see the code
HeapBytesCompressor(CompressionCodecName codecName) {
this.codecName = codecName;
this.codec = getCodec(codecName);
if (codec != null) {
this.compressor = CodecPool.getCompressor(codec);
this.compressedOutBuffer = new ByteArrayOutputStream(pageSize);
} else {
this.compressor = null;
this.compressedOutBuffer = null;
}
}
public ByteArrayOutputStream(int size) {
if (size < 0) {
throw new IllegalArgumentException("Negative initial size: "
+ size);
}
buf = new byte[size]; //here it only new size
byte of memroy needn't free
}
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
