Eric Snyder created PARQUET-66:
----------------------------------
Summary: InternalParquetRecordWriter int overflow causes
unnecessary memory check warning
Key: PARQUET-66
URL: https://issues.apache.org/jira/browse/PARQUET-66
Project: Parquet
Issue Type: Bug
Components: parquet-mr
Affects Versions: 1.6.0
Reporter: Eric Snyder
Priority: Minor
flushStore() contains a check on the amount of memory allocated and if it is >
3 * blockSize it logs a warning. If blockSize is large enough, e.g. 1GiB then 3
* blockSize will overflow and be negative causing the warning to always be
logged.
{code}
if (store.allocatedSize() > 3 * blockSize) {
LOG.warn("Too much memory used: " + store.memUsageString());
}
{code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)