Eric Snyder created PARQUET-66:
----------------------------------

             Summary: InternalParquetRecordWriter int overflow causes 
unnecessary memory check warning
                 Key: PARQUET-66
                 URL: https://issues.apache.org/jira/browse/PARQUET-66
             Project: Parquet
          Issue Type: Bug
          Components: parquet-mr
    Affects Versions: 1.6.0
            Reporter: Eric Snyder
            Priority: Minor


flushStore() contains a check on the amount of memory allocated and if it is > 
3 * blockSize it logs a warning. If blockSize is large enough, e.g. 1GiB then 3 
* blockSize will overflow and be negative causing the warning to always be 
logged.

{code}
if (store.allocatedSize() > 3 * blockSize) {
    LOG.warn("Too much memory used: " + store.memUsageString());
}
{code}





--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to