[jira] [Assigned] (SPARK-43150) Remove workaround for PARQUET-2160

[ https://issues.apache.org/jira/browse/SPARK-43150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned SPARK-43150: Assignee: Cheng Pan > Remove workaround for PARQUET-2160 > -- >

[jira] [Resolved] (SPARK-43150) Remove workaround for PARQUET-2160

[ https://issues.apache.org/jira/browse/SPARK-43150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved SPARK-43150. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40802

[jira] [Resolved] (SPARK-43050) Fix construct aggregate expressions by replacing grouping functions

[ https://issues.apache.org/jira/browse/SPARK-43050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-43050. - Fix Version/s: 3.3.3 3.4.1 3.5.0 Assignee: Yuming

[jira] [Created] (SPARK-43150) Remove workaround for PARQUET-2160

Cheng Pan created SPARK-43150: - Summary: Remove workaround for PARQUET-2160 Key: SPARK-43150 URL: https://issues.apache.org/jira/browse/SPARK-43150 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-43149) When CREATE USING fails to store metadata in metastore, data gets left around

Bruce Robbins created SPARK-43149: - Summary: When CREATE USING fails to store metadata in metastore, data gets left around Key: SPARK-43149 URL: https://issues.apache.org/jira/browse/SPARK-43149

[jira] [Updated] (SPARK-43149) When CTAS with USING fails to store metadata in metastore, data gets left around

[ https://issues.apache.org/jira/browse/SPARK-43149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-43149: -- Summary: When CTAS with USING fails to store metadata in metastore, data gets left around

[jira] [Resolved] (SPARK-43095) Avoid Once strategy's idempotence is broken for batch: Infer Filters

[ https://issues.apache.org/jira/browse/SPARK-43095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-43095. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40742

[jira] [Assigned] (SPARK-43095) Avoid Once strategy's idempotence is broken for batch: Infer Filters

[ https://issues.apache.org/jira/browse/SPARK-43095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-43095: --- Assignee: Yuming Wang > Avoid Once strategy's idempotence is broken for batch: Infer

[jira] [Resolved] (SPARK-42926) Upgrade Parquet to 1.13.0

[ https://issues.apache.org/jira/browse/SPARK-42926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-42926. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40555

[jira] [Assigned] (SPARK-42926) Upgrade Parquet to 1.13.0

[ https://issues.apache.org/jira/browse/SPARK-42926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-42926: --- Assignee: Yuming Wang > Upgrade Parquet to 1.13.0 > - > >

[jira] [Resolved] (SPARK-43107) Coalesce buckets in join applied on broadcast join stream side

[ https://issues.apache.org/jira/browse/SPARK-43107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-43107. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40756

[jira] [Created] (SPARK-43148) Add official image dockerfile for Spark v3.4.0

Yikun Jiang created SPARK-43148: --- Summary: Add official image dockerfile for Spark v3.4.0 Key: SPARK-43148 URL: https://issues.apache.org/jira/browse/SPARK-43148 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-43107) Coalesce buckets in join applied on broadcast join stream side

[ https://issues.apache.org/jira/browse/SPARK-43107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-43107: --- Assignee: Yuming Wang > Coalesce buckets in join applied on broadcast join stream side >

[jira] [Created] (SPARK-43147) Python lint local config

Wei Liu created SPARK-43147: --- Summary: Python lint local config Key: SPARK-43147 URL: https://issues.apache.org/jira/browse/SPARK-43147 Project: Spark Issue Type: Task Components:

[jira] [Created] (SPARK-43146) Implement eager evaluation.

Takuya Ueshin created SPARK-43146: - Summary: Implement eager evaluation. Key: SPARK-43146 URL: https://issues.apache.org/jira/browse/SPARK-43146 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-43145) Reduce ClassNotFound of hive storage handler table

[ https://issues.apache.org/jira/browse/SPARK-43145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17712569#comment-17712569 ] Yi Zhang commented on SPARK-43145: -- PR https://github.com/apache/spark/pull/40799 > Reduce

[jira] [Created] (SPARK-43145) Reduce ClassNotFound of hive storage handler table

Yi Zhang created SPARK-43145: Summary: Reduce ClassNotFound of hive storage handler table Key: SPARK-43145 URL: https://issues.apache.org/jira/browse/SPARK-43145 Project: Spark Issue Type:

[jira] [Created] (SPARK-43144) Scala: DataStreamReader table() API

Raghu Angadi created SPARK-43144: Summary: Scala: DataStreamReader table() API Key: SPARK-43144 URL: https://issues.apache.org/jira/browse/SPARK-43144 Project: Spark Issue Type: Task

[jira] [Created] (SPARK-43143) Scala: Add StreamingQuery awaitTermination() API

Raghu Angadi created SPARK-43143: Summary: Scala: Add StreamingQuery awaitTermination() API Key: SPARK-43143 URL: https://issues.apache.org/jira/browse/SPARK-43143 Project: Spark Issue Type:

[jira] [Commented] (SPARK-43022) protobuf functions

[ https://issues.apache.org/jira/browse/SPARK-43022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17712468#comment-17712468 ] Ignite TC Bot commented on SPARK-43022: --- User 'LuciferYang' has created a pull request for this

[jira] [Updated] (SPARK-39892) Use ArrowType.Decimal(precision, scale, bitWidth) instead of ArrowType.Decimal(precision, scale)

[ https://issues.apache.org/jira/browse/SPARK-39892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-39892: - Fix Version/s: 3.5.0 (was: 3.4.0) > Use ArrowType.Decimal(precision,

[jira] [Updated] (SPARK-41259) Spark-sql cli query results should correspond to schema

[ https://issues.apache.org/jira/browse/SPARK-41259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-41259: - Fix Version/s: 3.5.0 (was: 3.4.0) > Spark-sql cli query results should

[jira] [Updated] (SPARK-39814) Use AmazonKinesisClientBuilder.withCredentials instead of new AmazonKinesisClient(credentials)

[ https://issues.apache.org/jira/browse/SPARK-39814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-39814: - Fix Version/s: 3.5.0 (was: 3.4.0) > Use

[jira] [Updated] (SPARK-39136) JDBCTable support properties

[ https://issues.apache.org/jira/browse/SPARK-39136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-39136: - Fix Version/s: 3.5.0 (was: 3.4.0) > JDBCTable support properties >

[jira] [Updated] (SPARK-37935) Migrate onto error classes

[ https://issues.apache.org/jira/browse/SPARK-37935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-37935: - Fix Version/s: 3.5.0 (was: 3.4.0) > Migrate onto error classes >

[jira] [Updated] (SPARK-42169) Implement code generation for `to_csv` function (StructsToCsv)

[ https://issues.apache.org/jira/browse/SPARK-42169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-42169: - Fix Version/s: 3.5.0 (was: 3.4.0) > Implement code generation for

[jira] [Updated] (SPARK-38945) simply KEYTAB and PRINCIPAL in KerberosConfDriverFeatureStep

[ https://issues.apache.org/jira/browse/SPARK-38945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-38945: - Fix Version/s: 3.5.0 (was: 3.4.0) > simply KEYTAB and PRINCIPAL in

[jira] [Resolved] (SPARK-43064) Spark SQL CLI SQL tab should only show once statement once

[ https://issues.apache.org/jira/browse/SPARK-43064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved SPARK-43064. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40701

[jira] [Assigned] (SPARK-43064) Spark SQL CLI SQL tab should only show once statement once

[ https://issues.apache.org/jira/browse/SPARK-43064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned SPARK-43064: Assignee: angerszhu > Spark SQL CLI SQL tab should only show once statement once >

[jira] [Assigned] (SPARK-43104) Set `shadeTestJar` of protobuf module to false

[ https://issues.apache.org/jira/browse/SPARK-43104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned SPARK-43104: Assignee: Yang Jie > Set `shadeTestJar` of protobuf module to false >

[jira] [Resolved] (SPARK-43104) Set `shadeTestJar` of protobuf module to false

[ https://issues.apache.org/jira/browse/SPARK-43104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved SPARK-43104. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40753

[jira] [Commented] (SPARK-43142) DSL expressions fail on attribute with special characters

[ https://issues.apache.org/jira/browse/SPARK-43142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17712395#comment-17712395 ] Willi Raschkowski commented on SPARK-43142: --- https://github.com/apache/spark/pull/40794 > DSL

[jira] [Commented] (SPARK-43142) DSL expressions fail on attribute with special characters

[ https://issues.apache.org/jira/browse/SPARK-43142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17712383#comment-17712383 ] Willi Raschkowski commented on SPARK-43142: --- The solution I'd propose is to have

[jira] [Comment Edited] (SPARK-43142) DSL expressions fail on attribute with special characters

[ https://issues.apache.org/jira/browse/SPARK-43142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17712383#comment-17712383 ] Willi Raschkowski edited comment on SPARK-43142 at 4/14/23 1:18 PM:

[jira] [Commented] (SPARK-43142) DSL expressions fail on attribute with special characters

[ https://issues.apache.org/jira/browse/SPARK-43142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17712382#comment-17712382 ] Willi Raschkowski commented on SPARK-43142: --- Here's what's happening: {{ImplicitOperators}}

[jira] [Created] (SPARK-43142) DSL expressions fail on attribute with special characters

Willi Raschkowski created SPARK-43142: - Summary: DSL expressions fail on attribute with special characters Key: SPARK-43142 URL: https://issues.apache.org/jira/browse/SPARK-43142 Project: Spark

[jira] [Created] (SPARK-43141) Ignore generated Java files in checkstyle

Hyukjin Kwon created SPARK-43141: Summary: Ignore generated Java files in checkstyle Key: SPARK-43141 URL: https://issues.apache.org/jira/browse/SPARK-43141 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-30552) Chained spark column expressions with distinct windows specs produce inefficient DAG

[ https://issues.apache.org/jira/browse/SPARK-30552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17712339#comment-17712339 ] Dovi Joel commented on SPARK-30552: --- Is this resolved with [SPARK-41805] Reuse expressions in

[jira] [Commented] (SPARK-43140) Override computeStats in DummyLeafNode

[ https://issues.apache.org/jira/browse/SPARK-43140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17712315#comment-17712315 ] Yuming Wang commented on SPARK-43140: - https://github.com/apache/spark/pull/40791 > Override

[jira] [Created] (SPARK-43140) Override computeStats in DummyLeafNode

Yuming Wang created SPARK-43140: --- Summary: Override computeStats in DummyLeafNode Key: SPARK-43140 URL: https://issues.apache.org/jira/browse/SPARK-43140 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-43123) special internal field metadata should not be leaked to catalogs

[ https://issues.apache.org/jira/browse/SPARK-43123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43123. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40776

[jira] [Assigned] (SPARK-43123) special internal field metadata should not be leaked to catalogs

[ https://issues.apache.org/jira/browse/SPARK-43123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43123: --- Assignee: Wenchen Fan > special internal field metadata should not be leaked to catalogs >

[jira] [Created] (SPARK-43139) Bug in INSERT INTO documentation

Bjorn Olsen created SPARK-43139: --- Summary: Bug in INSERT INTO documentation Key: SPARK-43139 URL: https://issues.apache.org/jira/browse/SPARK-43139 Project: Spark Issue Type: Documentation

[jira] [Updated] (SPARK-43138) ClassNotFoundException during RDD block replication/migration

[ https://issues.apache.org/jira/browse/SPARK-43138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Emil Ejbyfeldt updated SPARK-43138: --- Summary: ClassNotFoundException during RDD block replication/migration (was: ClassNotFound

[jira] [Commented] (SPARK-43138) ClassNotFound during RDD block replication/migration

[ https://issues.apache.org/jira/browse/SPARK-43138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17712212#comment-17712212 ] Yuming Wang commented on SPARK-43138: - Did you set some config to

[jira] [Created] (SPARK-43138) ClassNotFound during RDD block replication/migration

Emil Ejbyfeldt created SPARK-43138: -- Summary: ClassNotFound during RDD block replication/migration Key: SPARK-43138 URL: https://issues.apache.org/jira/browse/SPARK-43138 Project: Spark

[jira] [Comment Edited] (SPARK-43113) Codegen error when full outer join's bound condition has multiple references to the same stream-side column

[ https://issues.apache.org/jira/browse/SPARK-43113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17711614#comment-17711614 ] Bruce Robbins edited comment on SPARK-43113 at 4/14/23 6:02 AM: PR here: