liupengcheng created PARQUET-1485:
-------------------------------------
Summary: Snappy Decompressor/Compressor may cause direct memory
leak
Key: PARQUET-1485
URL: https://issues.apache.org/jira/browse/PARQUET-1485
Project: Parquet
Issue Type: Bug
Components: parquet-mr
Affects Versions: 1.8.1
Environment: parquet-1.8.1
spark2.1
Reporter: liupengcheng
In out production environment, we encountered a direct memory oom issues caused
by the direct buffer not released in time.
After carefully checked the code, it seems that the some methods of
SnappyDecompressor/SnappyCompressor would not release the direct buffer
manually, and if full gc not happen, this bug may result in direct memory oom.
Seems that the problem still exist in the latest code.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
