[
https://issues.apache.org/jira/browse/HADOOP-17918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17417318#comment-17417318
]
yinan zhan commented on HADOOP-17918:
-------------------------------------
[~vjasani] yes
can consider changing memory field in SequenceFile.Sorter to long
> memory field in SequenceFile.Sorter java int overflow
> -----------------------------------------------------
>
> Key: HADOOP-17918
> URL: https://issues.apache.org/jira/browse/HADOOP-17918
> Project: Hadoop Common
> Issue Type: Bug
> Components: common
> Affects Versions: 3.3.1
> Reporter: yinan zhan
> Priority: Major
>
> memory field in SequenceFile.Sorter, can cause run method in
> SequenceFile.Sorter.SortPass enter an endless loop.
> If you set the "io.sort.mb" attribute to a value greater than 2050, as a
> result of
> {code:java}
> this.memory = conf.getInt(CommonConfigurationKeys.IO_SORT_MB_KEY,
> CommonConfigurationKeys.SEQ_IO_SORT_MB_DEFAULT) * 1024 * 1024;{code}
> , memory field java int overflow, may become negative, so memoryLimit field
> in SequenceFile.Sorter.SortPass will be negative too, lead to run method in
> SequenceFile.Sorter.SortPass enter an endless loop.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
