[jira] [Commented] (SPARK-13510) Shuffle may throw FetchFailedException: Direct buffer memory

[ https://issues.apache.org/jira/browse/SPARK-13510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16825798#comment-16825798 ] Mike Chan commented on SPARK-13510: --- Thanks man > Shuffle may throw FetchFailedException: Direct

[jira] [Commented] (SPARK-13510) Shuffle may throw FetchFailedException: Direct buffer memory

[ https://issues.apache.org/jira/browse/SPARK-13510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16825721#comment-16825721 ] Mike Chan commented on SPARK-13510: --- Hi [~belvey] I'm having similar issue and our 

[jira] [Commented] (SPARK-27505) autoBroadcastJoinThreshold including bigger table

[ https://issues.apache.org/jira/browse/SPARK-27505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823637#comment-16823637 ] Mike Chan commented on SPARK-27505: --- You mind sharing any info on self-reproducer? Tried to google

[jira] [Updated] (SPARK-27505) autoBroadcastJoinThreshold including bigger table

[ https://issues.apache.org/jira/browse/SPARK-27505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mike Chan updated SPARK-27505: -- Issue Type: Bug (was: Question) > autoBroadcastJoinThreshold including bigger table >

[jira] [Commented] (SPARK-27505) autoBroadcastJoinThreshold including bigger table

[ https://issues.apache.org/jira/browse/SPARK-27505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16820951#comment-16820951 ] Mike Chan commented on SPARK-27505: --- Table desc extended result: Statistics |24452111 bytes >

[jira] [Updated] (SPARK-27505) autoBroadcastJoinThreshold including bigger table

[ https://issues.apache.org/jira/browse/SPARK-27505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mike Chan updated SPARK-27505: -- Attachment: explain_plan.txt > autoBroadcastJoinThreshold including bigger table >

[jira] [Created] (SPARK-27505) autoBroadcastJoinThreshold including bigger table

Mike Chan created SPARK-27505: - Summary: autoBroadcastJoinThreshold including bigger table Key: SPARK-27505 URL: https://issues.apache.org/jira/browse/SPARK-27505 Project: Spark Issue Type:

[jira] [Commented] (SPARK-25422) flaky test: org.apache.spark.DistributedSuite.caching on disk, replicated (encryption = on) (with replication as stream)

[ https://issues.apache.org/jira/browse/SPARK-25422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16820707#comment-16820707 ] Mike Chan commented on SPARK-25422: --- Will this problem potentially hitting Spark 2.3.1 as well? I have

[jira] [Resolved] (SPARK-27264) spark sql released all executor but the job is not done

[ https://issues.apache.org/jira/browse/SPARK-27264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mike Chan resolved SPARK-27264. --- Resolution: Invalid Before making further attempt, I want to ensure broadcast join is enabled on

[jira] [Commented] (SPARK-27264) spark sql released all executor but the job is not done

[ https://issues.apache.org/jira/browse/SPARK-27264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16801437#comment-16801437 ] Mike Chan commented on SPARK-27264: --- I have repartition the data before transformation and still found

[jira] [Commented] (SPARK-27264) spark sql released all executor but the job is not done

[ https://issues.apache.org/jira/browse/SPARK-27264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16800357#comment-16800357 ] Mike Chan commented on SPARK-27264: --- [~ajithshetty] Would you mind providing some references for

[jira] [Updated] (SPARK-27264) spark sql released all executor but the job is not done

[ https://issues.apache.org/jira/browse/SPARK-27264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mike Chan updated SPARK-27264: -- Environment: Azure HDinsight spark 2.4 on Azure storage SQL: Read and Join some data and finally

[jira] [Created] (SPARK-27264) spark sql released all executor but the job is not done

Mike Chan created SPARK-27264: - Summary: spark sql released all executor but the job is not done Key: SPARK-27264 URL: https://issues.apache.org/jira/browse/SPARK-27264 Project: Spark Issue