[jira] [Commented] (SPARK-32855) Improve DPP for some join type do not support broadcast filtering side

[ https://issues.apache.org/jira/browse/SPARK-32855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17421134#comment-17421134 ] Apache Spark commented on SPARK-32855: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-32855) Improve DPP for some join type do not support broadcast filtering side

[ https://issues.apache.org/jira/browse/SPARK-32855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17421133#comment-17421133 ] Apache Spark commented on SPARK-32855: -- User 'wangyum' has created a pull request for this issue:

[jira] [Updated] (SPARK-36872) Decommissioning executors get killed before transferring their data because of the hardcoded timeout of 60 secs

[ https://issues.apache.org/jira/browse/SPARK-36872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shekhar Gupta updated SPARK-36872: -- Description: During the graceful decommissioning phase, executors need to transfer all of

[jira] [Created] (SPARK-36872) Decommissioning executors get killed before transferring their data because of the hardcoded timeout of 60 secs

Shekhar Gupta created SPARK-36872: - Summary: Decommissioning executors get killed before transferring their data because of the hardcoded timeout of 60 secs Key: SPARK-36872 URL:

[jira] [Commented] (SPARK-36678) Migrate SHOW TABLES to use V2 command by default

[ https://issues.apache.org/jira/browse/SPARK-36678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17421120#comment-17421120 ] Terry Kim commented on SPARK-36678: --- Got it, thanks. > Migrate SHOW TABLES to use V2 command by

[jira] [Comment Edited] (SPARK-36586) Migrate all ParsedStatement to the new v2 command framework

[ https://issues.apache.org/jira/browse/SPARK-36586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17421106#comment-17421106 ] Terry Kim edited comment on SPARK-36586 at 9/28/21, 1:51 AM: - [~cloud_fan] 

[jira] [Commented] (SPARK-36586) Migrate all ParsedStatement to the new v2 command framework

[ https://issues.apache.org/jira/browse/SPARK-36586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17421106#comment-17421106 ] Terry Kim commented on SPARK-36586: --- [~cloud_fan] totally missed this ping. :) Looks like the work has

[jira] [Comment Edited] (SPARK-36058) Support replicasets/job API

[ https://issues.apache.org/jira/browse/SPARK-36058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420568#comment-17420568 ] Yikun Jiang edited comment on SPARK-36058 at 9/28/21, 1:11 AM: --- After

[jira] [Commented] (SPARK-36871) Migrate CreateViewStatement to v2 command

[ https://issues.apache.org/jira/browse/SPARK-36871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17421095#comment-17421095 ] Huaxin Gao commented on SPARK-36871: I am working on this > Migrate CreateViewStatement to v2

[jira] [Created] (SPARK-36871) Migrate CreateViewStatement to v2 command

Huaxin Gao created SPARK-36871: -- Summary: Migrate CreateViewStatement to v2 command Key: SPARK-36871 URL: https://issues.apache.org/jira/browse/SPARK-36871 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-36870) Introduce INTERNAL_ERROR error class

[ https://issues.apache.org/jira/browse/SPARK-36870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17421087#comment-17421087 ] Apache Spark commented on SPARK-36870: -- User 'karenfeng' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36870) Introduce INTERNAL_ERROR error class

[ https://issues.apache.org/jira/browse/SPARK-36870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36870: Assignee: Apache Spark > Introduce INTERNAL_ERROR error class >

[jira] [Assigned] (SPARK-36870) Introduce INTERNAL_ERROR error class

[ https://issues.apache.org/jira/browse/SPARK-36870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36870: Assignee: (was: Apache Spark) > Introduce INTERNAL_ERROR error class >

[jira] [Created] (SPARK-36870) Introduce INTERNAL_ERROR error class

Karen Feng created SPARK-36870: -- Summary: Introduce INTERNAL_ERROR error class Key: SPARK-36870 URL: https://issues.apache.org/jira/browse/SPARK-36870 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-34826) Adaptive fetch of shuffle mergers for Push based shuffle

[ https://issues.apache.org/jira/browse/SPARK-34826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17421077#comment-17421077 ] Apache Spark commented on SPARK-34826: -- User 'venkata91' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34826) Adaptive fetch of shuffle mergers for Push based shuffle

[ https://issues.apache.org/jira/browse/SPARK-34826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34826: Assignee: (was: Apache Spark) > Adaptive fetch of shuffle mergers for Push based

[jira] [Assigned] (SPARK-34826) Adaptive fetch of shuffle mergers for Push based shuffle

[ https://issues.apache.org/jira/browse/SPARK-34826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34826: Assignee: Apache Spark > Adaptive fetch of shuffle mergers for Push based shuffle >

[jira] [Commented] (SPARK-34826) Adaptive fetch of shuffle mergers for Push based shuffle

[ https://issues.apache.org/jira/browse/SPARK-34826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17421075#comment-17421075 ] Apache Spark commented on SPARK-34826: -- User 'venkata91' has created a pull request for this issue:

[jira] [Created] (SPARK-36869) Spark job fails due to java.io.InvalidClassException: scala.collection.mutable.WrappedArray$ofRef; local class incompatible

Hamid EL MAAZOUZ created SPARK-36869: Summary: Spark job fails due to java.io.InvalidClassException: scala.collection.mutable.WrappedArray$ofRef; local class incompatible Key: SPARK-36869 URL:

[jira] [Commented] (SPARK-36868) Migrate CreateFunctionStatement to v2 command framework

[ https://issues.apache.org/jira/browse/SPARK-36868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17421067#comment-17421067 ] Apache Spark commented on SPARK-36868: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36868) Migrate CreateFunctionStatement to v2 command framework

[ https://issues.apache.org/jira/browse/SPARK-36868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36868: Assignee: Apache Spark > Migrate CreateFunctionStatement to v2 command framework >

[jira] [Commented] (SPARK-36868) Migrate CreateFunctionStatement to v2 command framework

[ https://issues.apache.org/jira/browse/SPARK-36868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17421066#comment-17421066 ] Apache Spark commented on SPARK-36868: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36868) Migrate CreateFunctionStatement to v2 command framework

[ https://issues.apache.org/jira/browse/SPARK-36868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36868: Assignee: (was: Apache Spark) > Migrate CreateFunctionStatement to v2 command

[jira] [Created] (SPARK-36868) Migrate CreateFunctionStatement to v2 command framework

Huaxin Gao created SPARK-36868: -- Summary: Migrate CreateFunctionStatement to v2 command framework Key: SPARK-36868 URL: https://issues.apache.org/jira/browse/SPARK-36868 Project: Spark Issue

[jira] [Commented] (SPARK-35672) Spark fails to launch executors with very large user classpath lists on YARN

[ https://issues.apache.org/jira/browse/SPARK-35672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17421017#comment-17421017 ] Apache Spark commented on SPARK-35672: -- User 'xkrogen' has created a pull request for this issue:

[jira] [Commented] (SPARK-35672) Spark fails to launch executors with very large user classpath lists on YARN

[ https://issues.apache.org/jira/browse/SPARK-35672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17421016#comment-17421016 ] Erik Krogen commented on SPARK-35672: - Re-submitted at [PR

[jira] [Commented] (SPARK-35672) Spark fails to launch executors with very large user classpath lists on YARN

[ https://issues.apache.org/jira/browse/SPARK-35672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17421018#comment-17421018 ] Apache Spark commented on SPARK-35672: -- User 'xkrogen' has created a pull request for this issue:

[jira] [Created] (SPARK-36867) Misleading Error Message with Invalid Column and Group By

Alan Jackoway created SPARK-36867: - Summary: Misleading Error Message with Invalid Column and Group By Key: SPARK-36867 URL: https://issues.apache.org/jira/browse/SPARK-36867 Project: Spark

[jira] [Commented] (SPARK-17722) YarnScheduler: Initial job has not accepted any resources

[ https://issues.apache.org/jira/browse/SPARK-17722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420999#comment-17420999 ] Davide Benedetto commented on SPARK-17722: -- Hi Partha I have your same issue. Which yarn

[jira] [Assigned] (SPARK-36863) Update dependency manifests for all released artifacts

[ https://issues.apache.org/jira/browse/SPARK-36863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36863: Assignee: Apache Spark > Update dependency manifests for all released artifacts >

[jira] [Assigned] (SPARK-36863) Update dependency manifests for all released artifacts

[ https://issues.apache.org/jira/browse/SPARK-36863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36863: Assignee: (was: Apache Spark) > Update dependency manifests for all released

[jira] [Commented] (SPARK-36863) Update dependency manifests for all released artifacts

[ https://issues.apache.org/jira/browse/SPARK-36863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420994#comment-17420994 ] Apache Spark commented on SPARK-36863: -- User 'sunchao' has created a pull request for this issue:

[jira] [Commented] (SPARK-36863) Update dependency manifests for all released artifacts

[ https://issues.apache.org/jira/browse/SPARK-36863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420995#comment-17420995 ] Apache Spark commented on SPARK-36863: -- User 'sunchao' has created a pull request for this issue:

[jira] [Resolved] (SPARK-36847) Explicitly specify error codes when ignoring type hint errors

[ https://issues.apache.org/jira/browse/SPARK-36847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36847. --- Fix Version/s: 3.3.0 Assignee: Takuya Ueshin Resolution: Fixed Issue

[jira] [Created] (SPARK-36866) Pushdown filters with ANSI interval values to parquet

Max Gekk created SPARK-36866: Summary: Pushdown filters with ANSI interval values to parquet Key: SPARK-36866 URL: https://issues.apache.org/jira/browse/SPARK-36866 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-36865) Add PySpark API document of session_window

[ https://issues.apache.org/jira/browse/SPARK-36865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36865: Assignee: Kousuke Saruta (was: Apache Spark) > Add PySpark API document of

[jira] [Commented] (SPARK-36865) Add PySpark API document of session_window

[ https://issues.apache.org/jira/browse/SPARK-36865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420959#comment-17420959 ] Apache Spark commented on SPARK-36865: -- User 'sarutak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36865) Add PySpark API document of session_window

[ https://issues.apache.org/jira/browse/SPARK-36865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36865: Assignee: Apache Spark (was: Kousuke Saruta) > Add PySpark API document of

[jira] [Assigned] (SPARK-36821) Create a test to extend ColumnarBatch

[ https://issues.apache.org/jira/browse/SPARK-36821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai reassigned SPARK-36821: --- Assignee: Yufei Gu > Create a test to extend ColumnarBatch > -

[jira] [Resolved] (SPARK-36821) Create a test to extend ColumnarBatch

[ https://issues.apache.org/jira/browse/SPARK-36821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-36821. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34087

[jira] [Updated] (SPARK-36865) Add PySpark API document of session_window

[ https://issues.apache.org/jira/browse/SPARK-36865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36865: --- Summary: Add PySpark API document of session_window (was: Add PySpark API document for

[jira] [Updated] (SPARK-36865) Add PySpark API document of session_window

[ https://issues.apache.org/jira/browse/SPARK-36865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36865: --- Description: There is no PySpark API document of session_window. The docstring of the

[jira] [Updated] (SPARK-36865) Add PySpark API document for session_window

[ https://issues.apache.org/jira/browse/SPARK-36865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36865: --- Description: There is no PySpark API document for session_window. The docstring of the

[jira] [Updated] (SPARK-36865) Add PySpark API document for session_window

[ https://issues.apache.org/jira/browse/SPARK-36865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-36865: --- Summary: Add PySpark API document for session_window (was: The layout of PySpark API

[jira] [Created] (SPARK-36865) The layout of PySpark API document for session_window is broken

Kousuke Saruta created SPARK-36865: -- Summary: The layout of PySpark API document for session_window is broken Key: SPARK-36865 URL: https://issues.apache.org/jira/browse/SPARK-36865 Project: Spark

[jira] [Assigned] (SPARK-36864) guava version mismatch with hadoop-aws

[ https://issues.apache.org/jira/browse/SPARK-36864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36864: Assignee: (was: Apache Spark) > guava version mismatch with hadoop-aws >

[jira] [Assigned] (SPARK-36864) guava version mismatch with hadoop-aws

[ https://issues.apache.org/jira/browse/SPARK-36864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36864: Assignee: Apache Spark > guava version mismatch with hadoop-aws >

[jira] [Commented] (SPARK-36864) guava version mismatch with hadoop-aws

[ https://issues.apache.org/jira/browse/SPARK-36864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420935#comment-17420935 ] Apache Spark commented on SPARK-36864: -- User 'warrenzhu25' has created a pull request for this

[jira] [Updated] (SPARK-36864) guava version mismatch with hadoop-aws

[ https://issues.apache.org/jira/browse/SPARK-36864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongwei Zhu updated SPARK-36864: - Summary: guava version mismatch with hadoop-aws (was: guava version mismatch between

[jira] [Assigned] (SPARK-36848) Migrate ShowCurrentNamespaceStatement to v2 command framework

[ https://issues.apache.org/jira/browse/SPARK-36848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-36848: --- Assignee: Huaxin Gao > Migrate ShowCurrentNamespaceStatement to v2 command framework >

[jira] [Resolved] (SPARK-36848) Migrate ShowCurrentNamespaceStatement to v2 command framework

[ https://issues.apache.org/jira/browse/SPARK-36848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36848. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34104

[jira] [Created] (SPARK-36864) guava version mismatch between hadoop-aws and spark

Zhongwei Zhu created SPARK-36864: Summary: guava version mismatch between hadoop-aws and spark Key: SPARK-36864 URL: https://issues.apache.org/jira/browse/SPARK-36864 Project: Spark Issue

[jira] [Created] (SPARK-36863) Update dependency manifests for all released artifacts

Chao Sun created SPARK-36863: Summary: Update dependency manifests for all released artifacts Key: SPARK-36863 URL: https://issues.apache.org/jira/browse/SPARK-36863 Project: Spark Issue Type:

[jira] [Commented] (SPARK-31646) Remove unused registeredConnections counter from ShuffleMetrics

[ https://issues.apache.org/jira/browse/SPARK-31646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420870#comment-17420870 ] Yongjun Zhang commented on SPARK-31646: --- Thanks [~mauzhang]. > Remove unused

[jira] [Commented] (SPARK-32855) Improve DPP for some join type do not support broadcast filtering side

[ https://issues.apache.org/jira/browse/SPARK-32855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420835#comment-17420835 ] Apache Spark commented on SPARK-32855: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-32855) Improve DPP for some join type do not support broadcast filtering side

[ https://issues.apache.org/jira/browse/SPARK-32855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420834#comment-17420834 ] Apache Spark commented on SPARK-32855: -- User 'wangyum' has created a pull request for this issue:

[jira] [Updated] (SPARK-36861) Partition columns are overly eagerly parsed as dates

[ https://issues.apache.org/jira/browse/SPARK-36861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-36861: Target Version/s: 3.3.0 Priority: Blocker (was: Major) > Partition columns are overly

[jira] [Comment Edited] (SPARK-36058) Support replicasets/job API

[ https://issues.apache.org/jira/browse/SPARK-36058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420568#comment-17420568 ] Yikun Jiang edited comment on SPARK-36058 at 9/27/21, 2:32 PM: --- After

[jira] [Comment Edited] (SPARK-36058) Support replicasets/job API

[ https://issues.apache.org/jira/browse/SPARK-36058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420568#comment-17420568 ] Yikun Jiang edited comment on SPARK-36058 at 9/27/21, 2:31 PM: --- After

[jira] [Assigned] (SPARK-36829) Refactor collectionOperation related Null check related code

[ https://issues.apache.org/jira/browse/SPARK-36829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-36829: --- Assignee: angerszhu > Refactor collectionOperation related Null check related code >

[jira] [Resolved] (SPARK-36829) Refactor collectionOperation related Null check related code

[ https://issues.apache.org/jira/browse/SPARK-36829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36829. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34077

[jira] [Commented] (SPARK-36862) ERROR CodeGenerator: failed to compile: org.codehaus.commons.compiler.CompileException: File 'generated.java'

[ https://issues.apache.org/jira/browse/SPARK-36862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420746#comment-17420746 ] Jungtaek Lim commented on SPARK-36862: -- I guess you'd have the generated code in the log. Please

[jira] [Commented] (SPARK-36817) Does Apache Spark 3 support GPU usage for Spark RDDs?

[ https://issues.apache.org/jira/browse/SPARK-36817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420737#comment-17420737 ] Thomas Graves commented on SPARK-36817: --- please refer to 

[jira] [Commented] (SPARK-36862) ERROR CodeGenerator: failed to compile: org.codehaus.commons.compiler.CompileException: File 'generated.java'

[ https://issues.apache.org/jira/browse/SPARK-36862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420730#comment-17420730 ] Magdalena Pilawska commented on SPARK-36862: Hi [~kabhwan], I updated the description with

[jira] [Updated] (SPARK-36862) ERROR CodeGenerator: failed to compile: org.codehaus.commons.compiler.CompileException: File 'generated.java'

[ https://issues.apache.org/jira/browse/SPARK-36862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Magdalena Pilawska updated SPARK-36862: --- Description: Hi, I am getting the following error running spark-submit command:

[jira] [Updated] (SPARK-36862) ERROR CodeGenerator: failed to compile: org.codehaus.commons.compiler.CompileException: File 'generated.java'

[ https://issues.apache.org/jira/browse/SPARK-36862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Magdalena Pilawska updated SPARK-36862: --- Description: Hi, I am getting the following error running spark-submit command:

[jira] [Commented] (SPARK-31646) Remove unused registeredConnections counter from ShuffleMetrics

[ https://issues.apache.org/jira/browse/SPARK-31646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420688#comment-17420688 ] Manu Zhang commented on SPARK-31646: {quote}So I will try to derive numBackLoggedConnections outside

[jira] [Comment Edited] (SPARK-36058) Support replicasets/job API

[ https://issues.apache.org/jira/browse/SPARK-36058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420568#comment-17420568 ] Yikun Jiang edited comment on SPARK-36058 at 9/27/21, 11:22 AM: After

[jira] [Commented] (SPARK-36862) ERROR CodeGenerator: failed to compile: org.codehaus.commons.compiler.CompileException: File 'generated.java'

[ https://issues.apache.org/jira/browse/SPARK-36862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420671#comment-17420671 ] Jungtaek Lim commented on SPARK-36862: -- Could you please provide more information? I guess the log

[jira] [Created] (SPARK-36862) ERROR CodeGenerator: failed to compile: org.codehaus.commons.compiler.CompileException: File 'generated.java'

Magdalena Pilawska created SPARK-36862: -- Summary: ERROR CodeGenerator: failed to compile: org.codehaus.commons.compiler.CompileException: File 'generated.java' Key: SPARK-36862 URL:

[jira] [Commented] (SPARK-36438) Support list-like Python objects for Series comparison

[ https://issues.apache.org/jira/browse/SPARK-36438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420656#comment-17420656 ] Apache Spark commented on SPARK-36438: -- User 'itholic' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36438) Support list-like Python objects for Series comparison

[ https://issues.apache.org/jira/browse/SPARK-36438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36438: Assignee: Apache Spark > Support list-like Python objects for Series comparison >

[jira] [Commented] (SPARK-36438) Support list-like Python objects for Series comparison

[ https://issues.apache.org/jira/browse/SPARK-36438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420655#comment-17420655 ] Apache Spark commented on SPARK-36438: -- User 'itholic' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36438) Support list-like Python objects for Series comparison

[ https://issues.apache.org/jira/browse/SPARK-36438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36438: Assignee: (was: Apache Spark) > Support list-like Python objects for Series

[jira] [Commented] (SPARK-36816) Introduce a config variable for the incrementalCollects row batch size

[ https://issues.apache.org/jira/browse/SPARK-36816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420578#comment-17420578 ] Ole commented on SPARK-36816: - I am running a Thrift Server {{/spark/sbin/start-thriftserver.sh}} with

[jira] [Commented] (SPARK-36058) Support replicasets/job API

[ https://issues.apache.org/jira/browse/SPARK-36058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420568#comment-17420568 ] Yikun Jiang commented on SPARK-36058: - After this, it makes the executor pod allocator pluggable, we

[jira] [Commented] (SPARK-36861) Partition columns are overly eagerly parsed as dates

[ https://issues.apache.org/jira/browse/SPARK-36861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420553#comment-17420553 ] Tanel Kiis commented on SPARK-36861: Sorry, indeed I ran the test on master. Nevermind it then, does

[jira] [Comment Edited] (SPARK-36861) Partition columns are overly eagerly parsed as dates

[ https://issues.apache.org/jira/browse/SPARK-36861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420549#comment-17420549 ] Gengliang Wang edited comment on SPARK-36861 at 9/27/21, 8:06 AM: -- Hmm,

[jira] [Updated] (SPARK-36861) Partition columns are overly eagerly parsed as dates

[ https://issues.apache.org/jira/browse/SPARK-36861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-36861: --- Affects Version/s: (was: 3.2.0) 3.3.0 > Partition columns are

[jira] [Commented] (SPARK-36861) Partition columns are overly eagerly parsed as dates

[ https://issues.apache.org/jira/browse/SPARK-36861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420549#comment-17420549 ] Gengliang Wang commented on SPARK-36861: Hmm, the PR https://github.com/apache/spark/pull/33709

[jira] [Resolved] (SPARK-32712) Support writing Hive non-ORC/Parquet bucketed table

[ https://issues.apache.org/jira/browse/SPARK-32712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32712. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34103

[jira] [Assigned] (SPARK-32712) Support writing Hive non-ORC/Parquet bucketed table

[ https://issues.apache.org/jira/browse/SPARK-32712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-32712: --- Assignee: Cheng Su > Support writing Hive non-ORC/Parquet bucketed table >

[jira] [Commented] (SPARK-36861) Partition columns are overly eagerly parsed as dates

[ https://issues.apache.org/jira/browse/SPARK-36861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420538#comment-17420538 ] Gengliang Wang commented on SPARK-36861: [~tanelk] This is a new behavior introduced from

[jira] [Assigned] (SPARK-36797) Union should resolve nested columns as top-level columns

[ https://issues.apache.org/jira/browse/SPARK-36797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-36797: --- Assignee: L. C. Hsieh > Union should resolve nested columns as top-level columns >

[jira] [Resolved] (SPARK-36797) Union should resolve nested columns as top-level columns

[ https://issues.apache.org/jira/browse/SPARK-36797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36797. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34038

[jira] [Commented] (SPARK-36435) Implement MultIndex.equal_levels

[ https://issues.apache.org/jira/browse/SPARK-36435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420534#comment-17420534 ] Apache Spark commented on SPARK-36435: -- User 'itholic' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36435) Implement MultIndex.equal_levels

[ https://issues.apache.org/jira/browse/SPARK-36435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36435: Assignee: (was: Apache Spark) > Implement MultIndex.equal_levels >

[jira] [Assigned] (SPARK-36435) Implement MultIndex.equal_levels

[ https://issues.apache.org/jira/browse/SPARK-36435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36435: Assignee: Apache Spark > Implement MultIndex.equal_levels >

[jira] [Commented] (SPARK-36861) Partition columns are overly eagerly parsed as dates

[ https://issues.apache.org/jira/browse/SPARK-36861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420533#comment-17420533 ] Tanel Kiis commented on SPARK-36861: If this is expected behaviour, then I would expect there to be

[jira] [Comment Edited] (SPARK-36861) Partition columns are overly eagerly parsed as dates

[ https://issues.apache.org/jira/browse/SPARK-36861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420532#comment-17420532 ] Tanel Kiis edited comment on SPARK-36861 at 9/27/21, 7:45 AM: --

[jira] [Commented] (SPARK-36861) Partition columns are overly eagerly parsed as dates

[ https://issues.apache.org/jira/browse/SPARK-36861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420532#comment-17420532 ] Tanel Kiis commented on SPARK-36861: [~Gengliang.Wang] I think, that this should be considered as a

[jira] [Created] (SPARK-36861) Partition columns are overly eagerly parsed as dates

Tanel Kiis created SPARK-36861: -- Summary: Partition columns are overly eagerly parsed as dates Key: SPARK-36861 URL: https://issues.apache.org/jira/browse/SPARK-36861 Project: Spark Issue Type:

[jira] [Commented] (SPARK-36711) Support multi-index in new syntax

[ https://issues.apache.org/jira/browse/SPARK-36711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420522#comment-17420522 ] Apache Spark commented on SPARK-36711: -- User 'thangnd197' has created a pull request for this

[jira] [Commented] (SPARK-36711) Support multi-index in new syntax

[ https://issues.apache.org/jira/browse/SPARK-36711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420519#comment-17420519 ] Apache Spark commented on SPARK-36711: -- User 'thangnd197' has created a pull request for this

[jira] [Updated] (SPARK-36856) Building by "./build/mvn" may be stuck on MacOS

[ https://issues.apache.org/jira/browse/SPARK-36856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] copperybean updated SPARK-36856: Issue Type: Bug (was: Improvement) > Building by "./build/mvn" may be stuck on MacOS >

[jira] [Updated] (SPARK-36860) Create the external hive table for HBase failed

[ https://issues.apache.org/jira/browse/SPARK-36860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wineternity updated SPARK-36860: Attachment: image-2021-09-27-14-25-28-900.png > Create the external hive table for HBase failed

[jira] [Commented] (SPARK-36860) Create the external hive table for HBase failed

[ https://issues.apache.org/jira/browse/SPARK-36860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420497#comment-17420497 ] wineternity commented on SPARK-36860: - thanks, [~sarutak] , may I ask why spark doesn't support

[jira] [Updated] (SPARK-36860) Create the external hive table for HBase failed

[ https://issues.apache.org/jira/browse/SPARK-36860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wineternity updated SPARK-36860: Attachment: image-2021-09-27-14-18-10-910.png > Create the external hive table for HBase failed