[jira] [Updated] (SPARK-25081) Nested spill in ShuffleExternalSorter may access a released memory page

[ https://issues.apache.org/jira/browse/SPARK-25081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25081: Fix Version/s: 2.2.3 > Nested spill in ShuffleExternalSorter may access a released memory page >

[jira] [Resolved] (SPARK-25092) Add RewriteExceptAll and RewriteIntersectAll in the list of nonExcludableRules

[ https://issues.apache.org/jira/browse/SPARK-25092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-25092. - Resolution: Fixed Assignee: Dilip Biswal Fix Version/s: 2.4.0 > Add RewriteExceptAll

[jira] [Commented] (SPARK-24420) Upgrade ASM to 6.x to support JDK9+

[ https://issues.apache.org/jira/browse/SPARK-24420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577409#comment-16577409 ] Apache Spark commented on SPARK-24420: -- User 'gatorsmile' has created a pull request for this

[jira] [Commented] (SPARK-25051) where clause on dataset gives AnalysisException

[ https://issues.apache.org/jira/browse/SPARK-25051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577401#comment-16577401 ] Yuming Wang commented on SPARK-25051: - Can you it with Spark [2.3.2-rc4 

[jira] [Commented] (SPARK-25071) BuildSide is coming not as expected with join queries

[ https://issues.apache.org/jira/browse/SPARK-25071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577385#comment-16577385 ] Yuming Wang commented on SPARK-25071: - I think it's correct. CBO based on RowCount. {code:scala} def

[jira] [Resolved] (SPARK-24152) SparkR CRAN feasibility check server problem

[ https://issues.apache.org/jira/browse/SPARK-24152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-24152. -- Resolution: Fixed > SparkR CRAN feasibility check server problem >

[jira] [Commented] (SPARK-25080) NPE in HiveShim$.toCatalystDecimal(HiveShim.scala:110)

[ https://issues.apache.org/jira/browse/SPARK-25080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577379#comment-16577379 ] Liang-Chi Hsieh commented on SPARK-25080: - Did a quick test but can't reproduce that. Is it

[jira] [Commented] (SPARK-23654) Cut jets3t as a dependency of spark-core

[ https://issues.apache.org/jira/browse/SPARK-23654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577334#comment-16577334 ] Apache Spark commented on SPARK-23654: -- User 'srowen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23654) Cut jets3t as a dependency of spark-core

[ https://issues.apache.org/jira/browse/SPARK-23654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-23654: - Assignee: Steve Loughran > Cut jets3t as a dependency of spark-core >

[jira] [Comment Edited] (SPARK-24152) SparkR CRAN feasibility check server problem

[ https://issues.apache.org/jira/browse/SPARK-24152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577065#comment-16577065 ] Liang-Chi Hsieh edited comment on SPARK-24152 at 8/11/18 9:23 PM: -- CRAN

[jira] [Updated] (SPARK-25091) Spark Thrift Server: UNCACHE TABLE and CLEAR CACHE does not clean up executor memory

[ https://issues.apache.org/jira/browse/SPARK-25091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yunling Cai updated SPARK-25091: Description: UNCACHE TABLE and CLEAR CACHE does not clean up executor memory. Through Spark UI,

[jira] [Updated] (SPARK-25091) Spark Thrift Server: UNCACHE TABLE and CLEAR CACHE does not clean up executor memory

[ https://issues.apache.org/jira/browse/SPARK-25091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yunling Cai updated SPARK-25091: Description: UNCACHE TABLE and CLEAR CACHE does not clean up executor memory. Through Spark UI,

[jira] [Assigned] (SPARK-25092) Add RewriteExceptAll and RewriteIntersectAll in the list of nonExcludableRules

[ https://issues.apache.org/jira/browse/SPARK-25092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25092: Assignee: (was: Apache Spark) > Add RewriteExceptAll and RewriteIntersectAll in the

[jira] [Assigned] (SPARK-25092) Add RewriteExceptAll and RewriteIntersectAll in the list of nonExcludableRules

[ https://issues.apache.org/jira/browse/SPARK-25092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25092: Assignee: Apache Spark > Add RewriteExceptAll and RewriteIntersectAll in the list of

[jira] [Commented] (SPARK-25092) Add RewriteExceptAll and RewriteIntersectAll in the list of nonExcludableRules

[ https://issues.apache.org/jira/browse/SPARK-25092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577281#comment-16577281 ] Apache Spark commented on SPARK-25092: -- User 'dilipbiswal' has created a pull request for this

[jira] [Created] (SPARK-25092) Add RewriteExceptAll and RewriteIntersectAll in the list of nonExcludableRules

Dilip Biswal created SPARK-25092: Summary: Add RewriteExceptAll and RewriteIntersectAll in the list of nonExcludableRules Key: SPARK-25092 URL: https://issues.apache.org/jira/browse/SPARK-25092

[jira] [Created] (SPARK-25091) Spark Thrift Server: UNCACHE TABLE and CLEAR CACHE does not clean up executor memory

Yunling Cai created SPARK-25091: --- Summary: Spark Thrift Server: UNCACHE TABLE and CLEAR CACHE does not clean up executor memory Key: SPARK-25091 URL: https://issues.apache.org/jira/browse/SPARK-25091

[jira] [Commented] (SPARK-23207) Shuffle+Repartition on an DataFrame could lead to incorrect answers

[ https://issues.apache.org/jira/browse/SPARK-23207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577229#comment-16577229 ] Apache Spark commented on SPARK-23207: -- User 'bersprockets' has created a pull request for this

[jira] [Commented] (SPARK-25085) Insert overwrite a non-partitioned table can delete table folder

[ https://issues.apache.org/jira/browse/SPARK-25085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577221#comment-16577221 ] Yuming Wang commented on SPARK-25085: - [~lirui] A another issue you may be interest: 

[jira] [Assigned] (SPARK-25085) Insert overwrite a non-partitioned table can delete table folder

[ https://issues.apache.org/jira/browse/SPARK-25085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25085: Assignee: (was: Apache Spark) > Insert overwrite a non-partitioned table can delete

[jira] [Issue Comment Deleted] (SPARK-25085) Insert overwrite a non-partitioned table can delete table folder

[ https://issues.apache.org/jira/browse/SPARK-25085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-25085: Comment: was deleted (was: I'm working on this.) > Insert overwrite a non-partitioned table can

[jira] [Assigned] (SPARK-25085) Insert overwrite a non-partitioned table can delete table folder

[ https://issues.apache.org/jira/browse/SPARK-25085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25085: Assignee: Apache Spark > Insert overwrite a non-partitioned table can delete table

[jira] [Commented] (SPARK-25085) Insert overwrite a non-partitioned table can delete table folder

[ https://issues.apache.org/jira/browse/SPARK-25085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577219#comment-16577219 ] Apache Spark commented on SPARK-25085: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-25084) "distribute by" on multiple columns may lead to codegen issue

[ https://issues.apache.org/jira/browse/SPARK-25084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577211#comment-16577211 ] Apache Spark commented on SPARK-25084: -- User 'LantaoJin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-24822) Python support for barrier execution mode

[ https://issues.apache.org/jira/browse/SPARK-24822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-24822: --- Assignee: Jiang Xingbo > Python support for barrier execution mode >

[jira] [Resolved] (SPARK-24822) Python support for barrier execution mode

[ https://issues.apache.org/jira/browse/SPARK-24822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-24822. - Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 22011

[jira] [Assigned] (SPARK-25084) "distribute by" on multiple columns may lead to codegen issue

[ https://issues.apache.org/jira/browse/SPARK-25084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-25084: --- Assignee: yucai > "distribute by" on multiple columns may lead to codegen issue >

[jira] [Resolved] (SPARK-25084) "distribute by" on multiple columns may lead to codegen issue

[ https://issues.apache.org/jira/browse/SPARK-25084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-25084. - Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 22066

[jira] [Assigned] (SPARK-25090) java.lang.ClassCastException when using a CrossValidator

[ https://issues.apache.org/jira/browse/SPARK-25090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25090: Assignee: (was: Apache Spark) > java.lang.ClassCastException when using a

[jira] [Commented] (SPARK-25090) java.lang.ClassCastException when using a CrossValidator

[ https://issues.apache.org/jira/browse/SPARK-25090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577121#comment-16577121 ] Apache Spark commented on SPARK-25090: -- User 'mgaido91' has created a pull request for this issue:

[jira] [Assigned] (SPARK-25090) java.lang.ClassCastException when using a CrossValidator

[ https://issues.apache.org/jira/browse/SPARK-25090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25090: Assignee: Apache Spark > java.lang.ClassCastException when using a CrossValidator >

[jira] [Commented] (SPARK-23908) High-order function: transform(array, function) → array

[ https://issues.apache.org/jira/browse/SPARK-23908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577080#comment-16577080 ] Apache Spark commented on SPARK-23908: -- User 'ueshin' has created a pull request for this issue:

[jira] [Commented] (SPARK-24152) SparkR CRAN feasibility check server problem

[ https://issues.apache.org/jira/browse/SPARK-24152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577065#comment-16577065 ] Liang-Chi Hsieh commented on SPARK-24152: - CRAN sysadmin replied they fixed it now. Looks good