[jira] [Commented] (SPARK-8890) Reduce memory consumption for dynamic partition insert

2015-10-25 Thread Jerry Lam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14973529#comment-14973529 ] Jerry Lam commented on SPARK-8890: -- Hi guys, sorry by injecting comments into the closed jira. I just

[jira] [Commented] (SPARK-8890) Reduce memory consumption for dynamic partition insert

2015-08-09 Thread Fei Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679447#comment-14679447 ] Fei Wang commented on SPARK-8890: - should this be part of tungsten? Reduce memory

[jira] [Commented] (SPARK-8890) Reduce memory consumption for dynamic partition insert

2015-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660893#comment-14660893 ] Apache Spark commented on SPARK-8890: - User 'marmbrus' has created a pull request for

[jira] [Commented] (SPARK-8890) Reduce memory consumption for dynamic partition insert

2015-07-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14632863#comment-14632863 ] Apache Spark commented on SPARK-8890: - User 'ilganeli' has created a pull request for

[jira] [Commented] (SPARK-8890) Reduce memory consumption for dynamic partition insert

2015-07-15 Thread Ilya Ganelin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14628488#comment-14628488 ] Ilya Ganelin commented on SPARK-8890: - [~rxin] I want to make sure I correctly

[jira] [Commented] (SPARK-8890) Reduce memory consumption for dynamic partition insert

2015-07-15 Thread Ilya Ganelin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14628533#comment-14628533 ] Ilya Ganelin commented on SPARK-8890: - Once data is sorted, is the number of

[jira] [Commented] (SPARK-8890) Reduce memory consumption for dynamic partition insert

2015-07-15 Thread Ilya Ganelin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14628620#comment-14628620 ] Ilya Ganelin commented on SPARK-8890: - [~yhuai] That makes sense, thank you. Wouldn't

[jira] [Commented] (SPARK-8890) Reduce memory consumption for dynamic partition insert

2015-07-15 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14628573#comment-14628573 ] Yin Huai commented on SPARK-8890: - [~ilganeli] Let me try to explain it. The background

[jira] [Commented] (SPARK-8890) Reduce memory consumption for dynamic partition insert

2015-07-15 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14628496#comment-14628496 ] Reynold Xin commented on SPARK-8890: Let me explain it with an example. Assuming the