[jira] [Resolved] (TEZ-2186) OOM with a simple scatter gather job with re-use
[ https://issues.apache.org/jira/browse/TEZ-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan resolved TEZ-2186. --- Resolution: Fixed Thanks [~hitesh]. Committed to branch-0.5 and branch-0.6 as well. > OOM with a simple scatter gather job with re-use > > > Key: TEZ-2186 > URL: https://issues.apache.org/jira/browse/TEZ-2186 > Project: Apache Tez > Issue Type: Bug >Reporter: Siddharth Seth >Assignee: Rajesh Balamohan > Fix For: 0.7.0 > > Attachments: TEZ-2186.1.patch, TEZ-2186.2.patch, noopexample.txt > > > With a no-op scatter gather job, 20K x 2K, on a 20 node cluster with 20 2GB > containers per node - reducers end up failing with OOM errors. Haven't been > able to generate a heap dump yet. Will add details as they're found. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (TEZ-2186) OOM with a simple scatter gather job with re-use
[ https://issues.apache.org/jira/browse/TEZ-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan resolved TEZ-2186. --- Resolution: Fixed Fix Version/s: 0.7.0 Target Version/s: 0.7.0 Hadoop Flags: Reviewed committed to master. Thanks [~sseth] >> commit cbd7323cd9027e2f1459ba477c7f01c99306ba31 >> > OOM with a simple scatter gather job with re-use > > > Key: TEZ-2186 > URL: https://issues.apache.org/jira/browse/TEZ-2186 > Project: Apache Tez > Issue Type: Bug >Reporter: Siddharth Seth >Assignee: Rajesh Balamohan > Fix For: 0.7.0 > > Attachments: TEZ-2186.1.patch, TEZ-2186.2.patch, noopexample.txt > > > With a no-op scatter gather job, 20K x 2K, on a 20 node cluster with 20 2GB > containers per node - reducers end up failing with OOM errors. Haven't been > able to generate a heap dump yet. Will add details as they're found. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
