[jira] [Comment Edited] (SPARK-11844) can not read class org.apache.parquet.format.PageHeader: don't know what type: 13

2017-10-20 Thread Cosmin Lehene (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213216#comment-16213216 ] Cosmin Lehene edited comment on SPARK-11844 at 10/20/17 8:59 PM: - I'm

[jira] [Commented] (SPARK-11844) can not read class org.apache.parquet.format.PageHeader: don't know what type: 13

2017-10-20 Thread Cosmin Lehene (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213216#comment-16213216 ] Cosmin Lehene commented on SPARK-11844: --- I'm seeing these with spark-2.2.1-SNAPSHOT {noformat}

[jira] [Commented] (SPARK-21033) fix the potential OOM in UnsafeExternalSorter

2017-10-19 Thread Cosmin Lehene (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16211576#comment-16211576 ] Cosmin Lehene commented on SPARK-21033: --- [~srowen] I'm hitting this while running some large jobs.

[jira] [Commented] (SPARK-21033) fix the potential OOM in UnsafeExternalSorter

2017-10-19 Thread Cosmin Lehene (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16211574#comment-16211574 ] Cosmin Lehene commented on SPARK-21033: --- [~cloud_fan] Can you update the title and description? It

[jira] [Commented] (SPARK-21033) fix the potential OOM in UnsafeExternalSorter

2017-10-19 Thread Cosmin Lehene (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16211526#comment-16211526 ] Cosmin Lehene commented on SPARK-21033: --- I think this may be responsible for other problems, such

[jira] [Commented] (SPARK-22256) Introduce spark.mesos.driver.memoryOverhead

2017-10-11 Thread Cosmin Lehene (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16200855#comment-16200855 ] Cosmin Lehene commented on SPARK-22256: --- It seems I can't assign this issue to myself. [~srowen]

[jira] [Commented] (SPARK-22256) Introduce spark.mesos.driver.memoryOverhead

2017-10-11 Thread Cosmin Lehene (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16200852#comment-16200852 ] Cosmin Lehene commented on SPARK-22256: --- I have a patch, still testing it. I will go over the

[jira] [Created] (SPARK-22256) Introduce spark.mesos.driver.memoryOverhead

2017-10-11 Thread Cosmin Lehene (JIRA)
Cosmin Lehene created SPARK-22256: - Summary: Introduce spark.mesos.driver.memoryOverhead Key: SPARK-22256 URL: https://issues.apache.org/jira/browse/SPARK-22256 Project: Spark Issue Type: