[jira] [Commented] (SPARK-40099) Merge adjacent CaseWhen branches if their values are the same

2023-02-08 Thread daile (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17686249#comment-17686249 ] daile commented on SPARK-40099: --- [~yumwang]  can you help review it again ? > Merge adjacent CaseWhen

[jira] [Comment Edited] (SPARK-4073) Parquet+Snappy can cause significant off-heap memory usage

2023-02-08 Thread shufan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-4073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17686239#comment-17686239 ] shufan edited comment on SPARK-4073 at 2/9/23 7:46 AM: --- I had a similar problem。

[jira] [Commented] (SPARK-4073) Parquet+Snappy can cause significant off-heap memory usage

2023-02-08 Thread shufan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-4073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17686239#comment-17686239 ] shufan commented on SPARK-4073: --- I had a similar problem。 When I submitted a hive on spark task, which was

[jira] [Updated] (SPARK-42388) Avoid unnecessary parquet footer reads when no filters in vectorized parquet reader

2023-02-08 Thread Mars (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mars updated SPARK-42388: - Summary: Avoid unnecessary parquet footer reads when no filters in vectorized parquet reader (was: Avoid

[jira] [Created] (SPARK-42388) Avoid unnecessary parquet footer reads when no filters

2023-02-08 Thread Mars (Jira)
Mars created SPARK-42388: Summary: Avoid unnecessary parquet footer reads when no filters Key: SPARK-42388 URL: https://issues.apache.org/jira/browse/SPARK-42388 Project: Spark Issue Type:

[jira] [Created] (SPARK-42387) Avoid unnecessary parquet footer reads when no filters

2023-02-08 Thread Mars (Jira)
Mars created SPARK-42387: Summary: Avoid unnecessary parquet footer reads when no filters Key: SPARK-42387 URL: https://issues.apache.org/jira/browse/SPARK-42387 Project: Spark Issue Type:

[jira] [Commented] (SPARK-42386) Rewrite HiveGenericUDF with Invoke

2023-02-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17686222#comment-17686222 ] Apache Spark commented on SPARK-42386: -- User 'panbingkun' has created a pull request for this

[jira] [Assigned] (SPARK-42386) Rewrite HiveGenericUDF with Invoke

2023-02-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42386: Assignee: (was: Apache Spark) > Rewrite HiveGenericUDF with Invoke >

[jira] [Assigned] (SPARK-42386) Rewrite HiveGenericUDF with Invoke

2023-02-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42386: Assignee: Apache Spark > Rewrite HiveGenericUDF with Invoke >

[jira] [Created] (SPARK-42386) Rewrite HiveGenericUDF with Invoke

2023-02-08 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-42386: --- Summary: Rewrite HiveGenericUDF with Invoke Key: SPARK-42386 URL: https://issues.apache.org/jira/browse/SPARK-42386 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-42385) Upgrade RoaringBitmap to 0.9.39

2023-02-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17686190#comment-17686190 ] Apache Spark commented on SPARK-42385: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-42385) Upgrade RoaringBitmap to 0.9.39

2023-02-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42385: Assignee: (was: Apache Spark) > Upgrade RoaringBitmap to 0.9.39 >

[jira] [Assigned] (SPARK-42385) Upgrade RoaringBitmap to 0.9.39

2023-02-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42385: Assignee: Apache Spark > Upgrade RoaringBitmap to 0.9.39 >

[jira] [Commented] (SPARK-41715) Catch specific exceptions for both Spark Connect and PySpark

2023-02-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17686163#comment-17686163 ] Apache Spark commented on SPARK-41715: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-41715) Catch specific exceptions for both Spark Connect and PySpark

2023-02-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17686164#comment-17686164 ] Apache Spark commented on SPARK-41715: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-41715) Catch specific exceptions for both Spark Connect and PySpark

2023-02-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41715: Assignee: (was: Apache Spark) > Catch specific exceptions for both Spark Connect and

[jira] [Commented] (SPARK-41715) Catch specific exceptions for both Spark Connect and PySpark

2023-02-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17686162#comment-17686162 ] Apache Spark commented on SPARK-41715: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-41715) Catch specific exceptions for both Spark Connect and PySpark

2023-02-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41715: Assignee: Apache Spark > Catch specific exceptions for both Spark Connect and PySpark >

[jira] [Assigned] (SPARK-40453) Improve error handling for GRPC server

2023-02-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40453: Assignee: Apache Spark > Improve error handling for GRPC server >

[jira] [Commented] (SPARK-40453) Improve error handling for GRPC server

2023-02-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17686161#comment-17686161 ] Apache Spark commented on SPARK-40453: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-40453) Improve error handling for GRPC server

2023-02-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40453: Assignee: (was: Apache Spark) > Improve error handling for GRPC server >

[jira] [Commented] (SPARK-40453) Improve error handling for GRPC server

2023-02-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17686160#comment-17686160 ] Apache Spark commented on SPARK-40453: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Created] (SPARK-42385) Upgrade RoaringBitmap to 0.9.39

2023-02-08 Thread Yang Jie (Jira)
Yang Jie created SPARK-42385: Summary: Upgrade RoaringBitmap to 0.9.39 Key: SPARK-42385 URL: https://issues.apache.org/jira/browse/SPARK-42385 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-42355) Upgrade some maven-plugins

2023-02-08 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-42355: Assignee: Yang Jie > Upgrade some maven-plugins > -- > >

[jira] [Resolved] (SPARK-42355) Upgrade some maven-plugins

2023-02-08 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-42355. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 39899

[jira] [Resolved] (SPARK-42350) Replcace `get().getOrElse` with `getOrElse`

2023-02-08 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-42350. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 39893

[jira] [Assigned] (SPARK-42350) Replcace `get().getOrElse` with `getOrElse`

2023-02-08 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-42350: Assignee: Yang Jie > Replcace `get().getOrElse` with `getOrElse` >

[jira] [Updated] (SPARK-40770) Improved error messages for applyInPandas for schema mismatch

2023-02-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-40770: - Fix Version/s: 3.5.0 (was: 3.4.0) > Improved error messages for

[jira] [Assigned] (SPARK-40770) Improved error messages for applyInPandas for schema mismatch

2023-02-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40770: Assignee: Enrico Minack > Improved error messages for applyInPandas for schema mismatch

[jira] [Resolved] (SPARK-40770) Improved error messages for applyInPandas for schema mismatch

2023-02-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40770. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38223

[jira] [Resolved] (SPARK-42379) Use FileSystem.exists in FileSystemBasedCheckpointFileManager.exists

2023-02-08 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-42379. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 39936

[jira] [Assigned] (SPARK-42379) Use FileSystem.exists in FileSystemBasedCheckpointFileManager.exists

2023-02-08 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-42379: Assignee: Jungtaek Lim > Use FileSystem.exists in

[jira] [Updated] (SPARK-41962) Update the import order of scala package in class SpecificParquetRecordReaderBase

2023-02-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-41962: -- Fix Version/s: (was: 3.2.4) > Update the import order of scala package in class >

[jira] [Resolved] (SPARK-42335) Pass the comment option through to univocity if users set it explicitly in CSV dataSource

2023-02-08 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-42335. -- Fix Version/s: 3.5.0 (was: 3.4.0) Resolution: Fixed Issue

[jira] [Assigned] (SPARK-42335) Pass the comment option through to univocity if users set it explicitly in CSV dataSource

2023-02-08 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-42335: Assignee: Wei Guo > Pass the comment option through to univocity if users set it

[jira] [Resolved] (SPARK-41695) Upgrade netty to 4.1.86.Final

2023-02-08 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-41695. - Resolution: Won't Fix > Upgrade netty to 4.1.86.Final > - > >

[jira] [Resolved] (SPARK-41696) Upgrade Hadoop to 3.3.4

2023-02-08 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-41696. - Resolution: Won't Fix > Upgrade Hadoop to 3.3.4 > --- > >

[jira] [Commented] (SPARK-42346) distinct(count colname) with UNION ALL causes query analyzer bug

2023-02-08 Thread Ritika Maheshwari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17686081#comment-17686081 ] Ritika Maheshwari commented on SPARK-42346: --- Yes that caused the error to appear. Thanks >

[jira] [Resolved] (SPARK-42318) Assign name to _LEGACY_ERROR_TEMP_2125

2023-02-08 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-42318. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39891

[jira] [Assigned] (SPARK-42318) Assign name to _LEGACY_ERROR_TEMP_2125

2023-02-08 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-42318: Assignee: Haejoon Lee > Assign name to _LEGACY_ERROR_TEMP_2125 >

[jira] [Resolved] (SPARK-42319) Assign name to _LEGACY_ERROR_TEMP_2123

2023-02-08 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-42319. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39891

[jira] [Assigned] (SPARK-42319) Assign name to _LEGACY_ERROR_TEMP_2123

2023-02-08 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-42319: Assignee: Haejoon Lee > Assign name to _LEGACY_ERROR_TEMP_2123 >

[jira] [Assigned] (SPARK-42310) Assign name to _LEGACY_ERROR_TEMP_1289

2023-02-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42310: Assignee: (was: Apache Spark) > Assign name to _LEGACY_ERROR_TEMP_1289 >

[jira] [Assigned] (SPARK-42310) Assign name to _LEGACY_ERROR_TEMP_1289

2023-02-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42310: Assignee: Apache Spark > Assign name to _LEGACY_ERROR_TEMP_1289 >

[jira] [Commented] (SPARK-42310) Assign name to _LEGACY_ERROR_TEMP_1289

2023-02-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17686036#comment-17686036 ] Apache Spark commented on SPARK-42310: -- User 'itholic' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42314) Assign name to _LEGACY_ERROR_TEMP_2127

2023-02-08 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-42314: Assignee: Haejoon Lee > Assign name to _LEGACY_ERROR_TEMP_2127 >

[jira] [Resolved] (SPARK-42314) Assign name to _LEGACY_ERROR_TEMP_2127

2023-02-08 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-42314. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39890

[jira] [Commented] (SPARK-42384) Mask function's generated code does not handle null input

2023-02-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17685995#comment-17685995 ] Apache Spark commented on SPARK-42384: -- User 'bersprockets' has created a pull request for this

[jira] [Assigned] (SPARK-42384) Mask function's generated code does not handle null input

2023-02-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42384: Assignee: (was: Apache Spark) > Mask function's generated code does not handle null

[jira] [Assigned] (SPARK-42384) Mask function's generated code does not handle null input

2023-02-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42384: Assignee: Apache Spark > Mask function's generated code does not handle null input >

[jira] [Updated] (SPARK-42384) Mask function's generated code does not handle null input

2023-02-08 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-42384: -- Affects Version/s: 3.4.0 > Mask function's generated code does not handle null input >

[jira] [Created] (SPARK-42384) Mask function's generated code does not handle null input

2023-02-08 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-42384: - Summary: Mask function's generated code does not handle null input Key: SPARK-42384 URL: https://issues.apache.org/jira/browse/SPARK-42384 Project: Spark

[jira] [Assigned] (SPARK-42383) Protobuf serializer for RocksDB.TypeAliases

2023-02-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42383: Assignee: Apache Spark > Protobuf serializer for RocksDB.TypeAliases >

[jira] [Assigned] (SPARK-42383) Protobuf serializer for RocksDB.TypeAliases

2023-02-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42383: Assignee: (was: Apache Spark) > Protobuf serializer for RocksDB.TypeAliases >

[jira] [Commented] (SPARK-42383) Protobuf serializer for RocksDB.TypeAliases

2023-02-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17685950#comment-17685950 ] Apache Spark commented on SPARK-42383: -- User 'LuciferYang' has created a pull request for this

[jira] [Created] (SPARK-42383) Protobuf serializer for RocksDB.TypeAliases

2023-02-08 Thread Yang Jie (Jira)
Yang Jie created SPARK-42383: Summary: Protobuf serializer for RocksDB.TypeAliases Key: SPARK-42383 URL: https://issues.apache.org/jira/browse/SPARK-42383 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-40819) Parquet INT64 (TIMESTAMP(NANOS,true)) now throwing Illegal Parquet type instead of automatically converting to LongType

2023-02-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17685928#comment-17685928 ] Apache Spark commented on SPARK-40819: -- User 'awdavidson' has created a pull request for this

[jira] [Assigned] (SPARK-42305) Assign name to _LEGACY_ERROR_TEMP_1229

2023-02-08 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-42305: Assignee: Haejoon Lee > Assign name to _LEGACY_ERROR_TEMP_1229 >

[jira] [Resolved] (SPARK-42305) Assign name to _LEGACY_ERROR_TEMP_1229

2023-02-08 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-42305. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39875

[jira] [Resolved] (SPARK-42131) Extract the function that construct the select statement for JDBC dialect.

2023-02-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42131. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 39667

[jira] [Assigned] (SPARK-42131) Extract the function that construct the select statement for JDBC dialect.

2023-02-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42131: --- Assignee: jiaan.geng > Extract the function that construct the select statement for JDBC

[jira] [Assigned] (SPARK-42303) Assign name to _LEGACY_ERROR_TEMP_1326

2023-02-08 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-42303: Assignee: Haejoon Lee > Assign name to _LEGACY_ERROR_TEMP_1326 >

[jira] [Resolved] (SPARK-42303) Assign name to _LEGACY_ERROR_TEMP_1326

2023-02-08 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-42303. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39873

[jira] [Commented] (SPARK-34645) [K8S] Driver pod stuck in Running state after job completes

2023-02-08 Thread Hussein Awala (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17685897#comment-17685897 ] Hussein Awala commented on SPARK-34645: --- I am facing a similar problem with Spark 3.2.1 and JDK 8,

[jira] [Comment Edited] (SPARK-42380) Upgrade maven to 3.9.0

2023-02-08 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17685881#comment-17685881 ] Yang Jie edited comment on SPARK-42380 at 2/8/23 12:24 PM: --- Upgrade

[jira] [Commented] (SPARK-42380) Upgrade maven to 3.9.0

2023-02-08 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17685881#comment-17685881 ] Yang Jie commented on SPARK-42380: -- Upgrade `cyclonedx-maven-plugin` to 2.7.4 can avoid this error, but

[jira] [Updated] (SPARK-42380) Upgrade maven to 3.9.0

2023-02-08 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42380: - Description: {code:java} [ERROR] An error occurred attempting to read POM

[jira] [Commented] (SPARK-42382) Upgrade `cyclonedx-maven-plugin` to 2.7.4

2023-02-08 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17685880#comment-17685880 ] Yang Jie commented on SPARK-42382: -- [https://github.com/CycloneDX/cyclonedx-maven-plugin/issues/272]

[jira] [Resolved] (SPARK-42342) Introduce base hierarchy to exceptions.

2023-02-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42342. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39882

[jira] [Assigned] (SPARK-42342) Introduce base hierarchy to exceptions.

2023-02-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42342: Assignee: Takuya Ueshin > Introduce base hierarchy to exceptions. >

[jira] [Commented] (SPARK-30022) Supporting Parsing of Simple Hive Virtual View created from Presto

2023-02-08 Thread jorge arada (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17685861#comment-17685861 ] jorge arada commented on SPARK-30022: - We are facing the same problem. The presto/trino views are

[jira] [Assigned] (SPARK-42381) `CreateDataFrame` should accept objects

2023-02-08 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-42381: - Assignee: Ruifeng Zheng > `CreateDataFrame` should accept objects >

[jira] [Comment Edited] (SPARK-42346) distinct(count colname) with UNION ALL causes query analyzer bug

2023-02-08 Thread Peter Toth (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17685858#comment-17685858 ] Peter Toth edited comment on SPARK-42346 at 2/8/23 11:16 AM: - [~ritikam],

[jira] [Commented] (SPARK-42346) distinct(count colname) with UNION ALL causes query analyzer bug

2023-02-08 Thread Peter Toth (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17685858#comment-17685858 ] Peter Toth commented on SPARK-42346: [~ritikam], you also need to disable the

[jira] [Resolved] (SPARK-42381) `CreateDataFrame` should accept objects

2023-02-08 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-42381. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39939

[jira] [Created] (SPARK-42382) Upgrade `cyclonedx-maven-plugin` to 2.7.4

2023-02-08 Thread Yang Jie (Jira)
Yang Jie created SPARK-42382: Summary: Upgrade `cyclonedx-maven-plugin` to 2.7.4 Key: SPARK-42382 URL: https://issues.apache.org/jira/browse/SPARK-42382 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-41053) Better Spark UI scalability and Driver stability for large applications

2023-02-08 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17685765#comment-17685765 ] Gengliang Wang commented on SPARK-41053: [~dongjoon] sure.  [~LuciferYang] [~techaddict]

[jira] [Resolved] (SPARK-41053) Better Spark UI scalability and Driver stability for large applications

2023-02-08 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-41053. Resolution: Fixed > Better Spark UI scalability and Driver stability for large

[jira] [Assigned] (SPARK-41053) Better Spark UI scalability and Driver stability for large applications

2023-02-08 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-41053: -- Assignee: Apache Spark > Better Spark UI scalability and Driver stability for large

[jira] [Updated] (SPARK-38005) Support cleaning up merged shuffle files and state from external shuffle service

2023-02-08 Thread Mars (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mars updated SPARK-38005: - Fix Version/s: 3.4.0 > Support cleaning up merged shuffle files and state from external shuffle > service >

[jira] [Resolved] (SPARK-38005) Support cleaning up merged shuffle files and state from external shuffle service

2023-02-08 Thread Mars (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mars resolved SPARK-38005. -- Resolution: Fixed > Support cleaning up merged shuffle files and state from external shuffle > service >

[jira] [Commented] (SPARK-42267) Support left_outer join

2023-02-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17685758#comment-17685758 ] Apache Spark commented on SPARK-42267: -- User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-42267) Support left_outer join

2023-02-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17685760#comment-17685760 ] Apache Spark commented on SPARK-42267: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-42267) Support left_outer join

2023-02-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42267: Assignee: Ruifeng Zheng > Support left_outer join > --- > >

[jira] [Resolved] (SPARK-42267) Support left_outer join

2023-02-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42267. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39938

[jira] [Commented] (SPARK-42381) `CreateDataFrame` should accept objects

2023-02-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17685752#comment-17685752 ] Apache Spark commented on SPARK-42381: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-42381) `CreateDataFrame` should accept objects

2023-02-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42381: Assignee: (was: Apache Spark) > `CreateDataFrame` should accept objects >

[jira] [Commented] (SPARK-42381) `CreateDataFrame` should accept objects

2023-02-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17685750#comment-17685750 ] Apache Spark commented on SPARK-42381: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-42381) `CreateDataFrame` should accept objects

2023-02-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42381: Assignee: Apache Spark > `CreateDataFrame` should accept objects >

[jira] [Created] (SPARK-42381) `CreateDataFrame` should accept objects

2023-02-08 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-42381: - Summary: `CreateDataFrame` should accept objects Key: SPARK-42381 URL: https://issues.apache.org/jira/browse/SPARK-42381 Project: Spark Issue Type: