[jira] [Commented] (SPARK-11617) MEMORY LEAK: ByteBuf.release() was not called before it's garbage-collected

2015-11-12 Thread Naden Franciscus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15001815#comment-15001815 ] Naden Franciscus commented on SPARK-11617: -- Can confirm both of these issues. Could it be

[jira] [Comment Edited] (SPARK-10929) Tungsten fails to acquire memory writing to HDFS

2015-11-01 Thread Naden Franciscus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14984615#comment-14984615 ] Naden Franciscus edited comment on SPARK-10929 at 11/2/15 12:48 AM:

[jira] [Commented] (SPARK-10929) Tungsten fails to acquire memory writing to HDFS

2015-11-01 Thread Naden Franciscus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14984615#comment-14984615 ] Naden Franciscus commented on SPARK-10929: -- Can confirm this issue has been resolved. Any

[jira] [Commented] (SPARK-10474) TungstenAggregation cannot acquire memory for pointer array after switching to sort-based

2015-11-01 Thread Naden Franciscus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14984614#comment-14984614 ] Naden Franciscus commented on SPARK-10474: -- Can confirm this issue has been resolved. Nice work.

[jira] [Commented] (SPARK-4226) SparkSQL - Add support for subqueries in predicates

2015-10-10 Thread Naden Franciscus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951663#comment-14951663 ] Naden Franciscus commented on SPARK-4226: - Is there a reason this pull request can't be merged in

[jira] [Created] (SPARK-10929) Tungsten fails to acquire memory writing to HDFS

2015-10-05 Thread Naden Franciscus (JIRA)
Naden Franciscus created SPARK-10929: Summary: Tungsten fails to acquire memory writing to HDFS Key: SPARK-10929 URL: https://issues.apache.org/jira/browse/SPARK-10929 Project: Spark

[jira] [Updated] (SPARK-10929) Tungsten fails to acquire memory writing to HDFS

2015-10-05 Thread Naden Franciscus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naden Franciscus updated SPARK-10929: - Priority: Blocker (was: Major) > Tungsten fails to acquire memory writing to HDFS >

[jira] [Updated] (SPARK-10929) Tungsten fails to acquire memory writing to HDFS

2015-10-05 Thread Naden Franciscus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naden Franciscus updated SPARK-10929: - Description: We are executing 20 Spark SQL jobs in parallel using Spark Job Server and

[jira] [Updated] (SPARK-10929) Tungsten fails to acquire memory writing to HDFS

2015-10-05 Thread Naden Franciscus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naden Franciscus updated SPARK-10929: - Description: We are executing 20 Spark SQL jobs in parallel using Spark Job Server and

[jira] [Commented] (SPARK-10474) TungstenAggregation cannot acquire memory for pointer array after switching to sort-based

2015-10-02 Thread Naden Franciscus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14942096#comment-14942096 ] Naden Franciscus commented on SPARK-10474: -- I have tried setting spark.buffer.pageSize to both

[jira] [Commented] (SPARK-10474) TungstenAggregation cannot acquire memory for pointer array after switching to sort-based

2015-10-01 Thread Naden Franciscus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14939808#comment-14939808 ] Naden Franciscus commented on SPARK-10474: -- We are executing 20 Spark SQL jobs in parallel using

[jira] [Comment Edited] (SPARK-10474) TungstenAggregation cannot acquire memory for pointer array after switching to sort-based

2015-10-01 Thread Naden Franciscus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14939808#comment-14939808 ] Naden Franciscus edited comment on SPARK-10474 at 10/1/15 1:30 PM: --- We

[jira] [Comment Edited] (SPARK-10474) TungstenAggregation cannot acquire memory for pointer array after switching to sort-based

2015-10-01 Thread Naden Franciscus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14939808#comment-14939808 ] Naden Franciscus edited comment on SPARK-10474 at 10/1/15 1:33 PM: --- We

[jira] [Commented] (SPARK-10474) TungstenAggregation cannot acquire memory for pointer array after switching to sort-based

2015-10-01 Thread Naden Franciscus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14940535#comment-14940535 ] Naden Franciscus commented on SPARK-10474: -- [~yhuai] Standalone > TungstenAggregation cannot

[jira] [Comment Edited] (SPARK-10474) TungstenAggregation cannot acquire memory for pointer array after switching to sort-based

2015-10-01 Thread Naden Franciscus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14940487#comment-14940487 ] Naden Franciscus edited comment on SPARK-10474 at 10/1/15 9:58 PM: --- I

[jira] [Commented] (SPARK-10309) Some tasks failed with Unable to acquire memory

2015-10-01 Thread Naden Franciscus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14940494#comment-14940494 ] Naden Franciscus commented on SPARK-10309: -- Has been difficult to get a clean stacktrace/explain

[jira] [Commented] (SPARK-10474) TungstenAggregation cannot acquire memory for pointer array after switching to sort-based

2015-10-01 Thread Naden Franciscus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14940505#comment-14940505 ] Naden Franciscus commented on SPARK-10474: -- Can confirm also getting this issue now. There must

[jira] [Commented] (SPARK-10474) TungstenAggregation cannot acquire memory for pointer array after switching to sort-based

2015-10-01 Thread Naden Franciscus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14940487#comment-14940487 ] Naden Franciscus commented on SPARK-10474: -- I can't provide the explain plan since we are

[jira] [Created] (SPARK-10908) ClassCastException in HadoopRDD.getJobConf

2015-10-01 Thread Naden Franciscus (JIRA)
Naden Franciscus created SPARK-10908: Summary: ClassCastException in HadoopRDD.getJobConf Key: SPARK-10908 URL: https://issues.apache.org/jira/browse/SPARK-10908 Project: Spark Issue

[jira] [Commented] (SPARK-10309) Some tasks failed with Unable to acquire memory

2015-09-09 Thread Naden Franciscus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14736304#comment-14736304 ] Naden Franciscus commented on SPARK-10309: -- Still working on the physical plan but we have been

[jira] [Comment Edited] (SPARK-10309) Some tasks failed with Unable to acquire memory

2015-09-09 Thread Naden Franciscus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14736304#comment-14736304 ] Naden Franciscus edited comment on SPARK-10309 at 9/9/15 6:43 AM: -- Still

[jira] [Comment Edited] (SPARK-10309) Some tasks failed with Unable to acquire memory

2015-09-08 Thread Naden Franciscus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735872#comment-14735872 ] Naden Franciscus edited comment on SPARK-10309 at 9/9/15 12:08 AM: --- We

[jira] [Commented] (SPARK-10309) Some tasks failed with Unable to acquire memory

2015-09-08 Thread Naden Franciscus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735872#comment-14735872 ] Naden Franciscus commented on SPARK-10309: -- We are using Spark Job Server to submit the job.

[jira] [Commented] (SPARK-10309) Some tasks failed with Unable to acquire memory

2015-09-05 Thread Naden Franciscus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14731862#comment-14731862 ] Naden Franciscus commented on SPARK-10309: -- Why is this targeted for 1.6 ? We are finding this

[jira] [Comment Edited] (SPARK-10309) Some tasks failed with Unable to acquire memory

2015-09-05 Thread Naden Franciscus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14731862#comment-14731862 ] Naden Franciscus edited comment on SPARK-10309 at 9/5/15 7:37 AM: -- Why

[jira] [Commented] (SPARK-6412) Add Char support in dataTypes.

2015-06-21 Thread Naden Franciscus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14595280#comment-14595280 ] Naden Franciscus commented on SPARK-6412: - This needs to be reopened. The use

[jira] [Issue Comment Deleted] (SPARK-6412) Add Char support in dataTypes.

2015-06-21 Thread Naden Franciscus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naden Franciscus updated SPARK-6412: Comment: was deleted (was: This needs to be reopened. The use case couldn't be more clear.