[
https://issues.apache.org/jira/browse/PARQUET-66?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14090041#comment-14090041
]
Julien Le Dem commented on PARQUET-66:
--------------------------------------
Thanks for reporting.
Did you have a patch ready?
> InternalParquetRecordWriter int overflow causes unnecessary memory check
> warning
> --------------------------------------------------------------------------------
>
> Key: PARQUET-66
> URL: https://issues.apache.org/jira/browse/PARQUET-66
> Project: Parquet
> Issue Type: Bug
> Components: parquet-mr
> Affects Versions: 1.6.0
> Reporter: Eric Snyder
> Priority: Minor
>
> flushStore() contains a check on the amount of memory allocated and if it is
> > 3 * blockSize it logs a warning. If blockSize is large enough, e.g. 1GiB
> then 3 * blockSize will overflow and be negative causing the warning to
> always be logged.
> {code}
> if (store.allocatedSize() > 3 * blockSize) {
> LOG.warn("Too much memory used: " + store.memUsageString());
> }
> {code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
