[jira] [Updated] (SPARK-48292) Revert [SPARK-39195][SQL] Spark OutputCommitCoordinator should abort stage when committed file not consistent with task status

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48292: --- Labels: pull-request-available (was: ) > Revert [SPARK-39195][SQL] Spark

[jira] [Updated] (SPARK-48292) Revert [SPARK-39195][SQL] Spark OutputCommitCoordinator should abort stage when committed file not consistent with task status

2024-05-21 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-48292: -- Summary: Revert [SPARK-39195][SQL] Spark OutputCommitCoordinator should abort stage when committed

[jira] [Resolved] (SPARK-48314) FileStreamSource shouldn't double cache files for availableNow

2024-05-21 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-48314. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46627

[jira] [Assigned] (SPARK-48314) FileStreamSource shouldn't double cache files for availableNow

2024-05-21 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-48314: Assignee: Adam Binford > FileStreamSource shouldn't double cache files for availableNow

[jira] [Updated] (SPARK-48384) Exclude `io.netty:netty-tcnative-boringssl-static` from `zookeeper`

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48384: --- Labels: pull-request-available (was: ) > Exclude

[jira] [Created] (SPARK-48384) Exclude `io.netty:netty-tcnative-boringssl-static` from `zookeeper`

2024-05-21 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48384: --- Summary: Exclude `io.netty:netty-tcnative-boringssl-static` from `zookeeper` Key: SPARK-48384 URL: https://issues.apache.org/jira/browse/SPARK-48384 Project: Spark

[jira] [Commented] (SPARK-47952) Support retrieving the real SparkConnectService GRPC address and port programmatically when running on Yarn

2024-05-21 Thread Adam Binford (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17848408#comment-17848408 ] Adam Binford commented on SPARK-47952: -- We have a similar setup, currently using Livy and Zeppelin

[jira] [Resolved] (SPARK-48341) Allow Spark Connect plugins to use QueryTest in their tests

2024-05-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48341. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46667

[jira] [Updated] (SPARK-48383) In KafkaOffsetReader, partition mismatch should not be an assertion

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48383: --- Labels: pull-request-available (was: ) > In KafkaOffsetReader, partition mismatch should

[jira] [Created] (SPARK-48383) In KafkaOffsetReader, partition mismatch should not be an assertion

2024-05-21 Thread Siying Dong (Jira)
Siying Dong created SPARK-48383: --- Summary: In KafkaOffsetReader, partition mismatch should not be an assertion Key: SPARK-48383 URL: https://issues.apache.org/jira/browse/SPARK-48383 Project: Spark

[jira] [Commented] (SPARK-48380) AutoBatchedPickler caused Unsafe allocate to fail due to 2GB limit

2024-05-21 Thread Zheng Shao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17848375#comment-17848375 ] Zheng Shao commented on SPARK-48380: A draft PR can be found here:

[jira] [Created] (SPARK-48382) Add controller / reconciler module to operator

2024-05-21 Thread Zhou JIANG (Jira)
Zhou JIANG created SPARK-48382: -- Summary: Add controller / reconciler module to operator Key: SPARK-48382 URL: https://issues.apache.org/jira/browse/SPARK-48382 Project: Spark Issue Type:

[jira] [Updated] (SPARK-48380) AutoBatchedPickler caused Unsafe allocate to fail due to 2GB limit

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48380: --- Labels: pull-request-available (was: ) > AutoBatchedPickler caused Unsafe allocate to fail

[jira] [Updated] (SPARK-48380) AutoBatchedPickler caused Unsafe allocate to fail due to 2GB limit

2024-05-21 Thread Zheng Shao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated SPARK-48380: --- Description: AutoBatchedPickler assumes that the row sizes are more or less uniform. That's of

[jira] [Resolved] (SPARK-48381) Update `YuniKorn` docs with v1.5.1

2024-05-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48381. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46690

[jira] [Assigned] (SPARK-48381) Update `YuniKorn` docs with v1.5.1

2024-05-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48381: - Assignee: Dongjoon Hyun > Update `YuniKorn` docs with v1.5.1 >

[jira] [Updated] (SPARK-48381) Update `YuniKorn` docs with v1.5.1

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48381: --- Labels: pull-request-available (was: ) > Update `YuniKorn` docs with v1.5.1 >

[jira] [Created] (SPARK-48381) Update `YuniKorn` docs with v1.5.1

2024-05-21 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-48381: - Summary: Update `YuniKorn` docs with v1.5.1 Key: SPARK-48381 URL: https://issues.apache.org/jira/browse/SPARK-48381 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-48329) Enable `spark.sql.sources.v2.bucketing.pushPartValues.enabled` by default

2024-05-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48329: -- Summary: Enable `spark.sql.sources.v2.bucketing.pushPartValues.enabled` by default (was:

[jira] [Updated] (SPARK-48329) Default spark.sql.sources.v2.bucketing.pushPartValues.enabled to true

2024-05-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48329: -- Parent Issue: SPARK-44111 (was: SPARK-37375) > Default

[jira] [Resolved] (SPARK-48329) Default spark.sql.sources.v2.bucketing.pushPartValues.enabled to true

2024-05-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48329. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46673

[jira] [Assigned] (SPARK-48329) Default spark.sql.sources.v2.bucketing.pushPartValues.enabled to true

2024-05-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48329: - Assignee: Szehon Ho > Default spark.sql.sources.v2.bucketing.pushPartValues.enabled to

[jira] [Updated] (SPARK-48380) AutoBatchedPickler caused Unsafe allocate to fail due to 2GB limit

2024-05-21 Thread Zheng Shao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated SPARK-48380: --- Description: AutoBatchedPickler assumes that the row sizes are more or less uniform. That's of

[jira] [Updated] (SPARK-48380) AutoBatchedPickler caused Unsafe allocate to fail due to 2GB limit

2024-05-21 Thread Zheng Shao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated SPARK-48380: --- Description: The stacktrace: {{```}} {{Py4JJavaError: An error occurred while calling

[jira] [Updated] (SPARK-48380) AutoBatchedPickler caused Unsafe allocate to fail due to 2GB limit

2024-05-21 Thread Zheng Shao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated SPARK-48380: --- Description: The stacktrace: {{```}} {{Py4JJavaError: An error occurred while calling

[jira] [Created] (SPARK-48380) AutoBatchedPickler caused Unsafe allocate to fail due to 2GB limit

2024-05-21 Thread Zheng Shao (Jira)
Zheng Shao created SPARK-48380: -- Summary: AutoBatchedPickler caused Unsafe allocate to fail due to 2GB limit Key: SPARK-48380 URL: https://issues.apache.org/jira/browse/SPARK-48380 Project: Spark

[jira] [Updated] (SPARK-48379) Cancel build during a PR when a new commit is pushed

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48379: --- Labels: pull-request-available (was: ) > Cancel build during a PR when a new commit is

[jira] [Created] (SPARK-48379) Cancel build during a PR when a new commit is pushed

2024-05-21 Thread Stefan Kandic (Jira)
Stefan Kandic created SPARK-48379: - Summary: Cancel build during a PR when a new commit is pushed Key: SPARK-48379 URL: https://issues.apache.org/jira/browse/SPARK-48379 Project: Spark Issue

[jira] [Created] (SPARK-48378) Limit the maximum number of dynamic partitions

2024-05-21 Thread guihuawen (Jira)
guihuawen created SPARK-48378: - Summary: Limit the maximum number of dynamic partitions Key: SPARK-48378 URL: https://issues.apache.org/jira/browse/SPARK-48378 Project: Spark Issue Type:

[jira] [Created] (SPARK-48377) Multiple results API - sqlScript()

2024-05-21 Thread David Milicevic (Jira)
David Milicevic created SPARK-48377: --- Summary: Multiple results API - sqlScript() Key: SPARK-48377 URL: https://issues.apache.org/jira/browse/SPARK-48377 Project: Spark Issue Type:

[jira] [Created] (SPARK-48376) Support for ITERATE statement

2024-05-21 Thread David Milicevic (Jira)
David Milicevic created SPARK-48376: --- Summary: Support for ITERATE statement Key: SPARK-48376 URL: https://issues.apache.org/jira/browse/SPARK-48376 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-48357) Support for LOOP and LEAVE statements

2024-05-21 Thread David Milicevic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Milicevic updated SPARK-48357: Summary: Support for LOOP and LEAVE statements (was: Support for LOOP and LEAVE/ITERATE

[jira] [Updated] (SPARK-48357) Support for LOOP and LEAVE statements

2024-05-21 Thread David Milicevic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Milicevic updated SPARK-48357: Description: Details TBD. Maybe split to multiple items?   LEAVE should be the

[jira] [Created] (SPARK-48375) Support for SIGNAL statement

2024-05-21 Thread David Milicevic (Jira)
David Milicevic created SPARK-48375: --- Summary: Support for SIGNAL statement Key: SPARK-48375 URL: https://issues.apache.org/jira/browse/SPARK-48375 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-48353) Support for TRY/CATCH statement

2024-05-21 Thread David Milicevic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Milicevic updated SPARK-48353: Description: Details TBD.   For more details: * Design doc in parent Jira item. *

[jira] [Updated] (SPARK-48353) Support for TRY/CATCH statement

2024-05-21 Thread David Milicevic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Milicevic updated SPARK-48353: Summary: Support for TRY/CATCH statement (was: Support for SIGNAL and TRY/CATCH

[jira] [Updated] (SPARK-48220) Allow passing PyArrow Table to createDataFrame()

2024-05-21 Thread Ian Cook (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ian Cook updated SPARK-48220: - Fix Version/s: (was: 4.0.0) Target Version/s: 4.0.0 > Allow passing PyArrow Table to

[jira] [Updated] (SPARK-48374) Support additional PyArrow Table column types

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48374: --- Labels: pull-request-available (was: ) > Support additional PyArrow Table column types >

[jira] [Created] (SPARK-48374) Support additional PyArrow Table column types

2024-05-21 Thread Ian Cook (Jira)
Ian Cook created SPARK-48374: Summary: Support additional PyArrow Table column types Key: SPARK-48374 URL: https://issues.apache.org/jira/browse/SPARK-48374 Project: Spark Issue Type:

[jira] [Updated] (SPARK-48374) Support additional PyArrow Table column types

2024-05-21 Thread Ian Cook (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ian Cook updated SPARK-48374: - Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Support additional PyArrow Table

[jira] [Updated] (SPARK-48373) Allow schema parameter of createDataFrame() to be length-1 list or tuple of StructType

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48373: --- Labels: pull-request-available (was: ) > Allow schema parameter of createDataFrame() to be

[jira] [Created] (SPARK-48373) Allow schema parameter of createDataFrame() to be length-1 list or tuple of StructType

2024-05-21 Thread Ian Cook (Jira)
Ian Cook created SPARK-48373: Summary: Allow schema parameter of createDataFrame() to be length-1 list or tuple of StructType Key: SPARK-48373 URL: https://issues.apache.org/jira/browse/SPARK-48373

[jira] [Updated] (SPARK-48372) Implement `StructType.treeString`

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48372: --- Labels: pull-request-available (was: ) > Implement `StructType.treeString` >

[jira] [Created] (SPARK-48372) Implement `StructType.treeString`

2024-05-21 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-48372: - Summary: Implement `StructType.treeString` Key: SPARK-48372 URL: https://issues.apache.org/jira/browse/SPARK-48372 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-48342) Parser support

2024-05-21 Thread David Milicevic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Milicevic updated SPARK-48342: Description: Implement parse for SQL scripting with all supporting changes for upcoming

[jira] [Resolved] (SPARK-48369) Add function timestamp_add

2024-05-21 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-48369. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46680

[jira] [Resolved] (SPARK-48371) Upgrade to Parquet 1.14

2024-05-21 Thread Willi Raschkowski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Willi Raschkowski resolved SPARK-48371. --- Resolution: Duplicate > Upgrade to Parquet 1.14 > --- > >

[jira] [Commented] (SPARK-48371) Upgrade to Parquet 1.14

2024-05-21 Thread Willi Raschkowski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17848166#comment-17848166 ] Willi Raschkowski commented on SPARK-48371: --- Apologies, I noticed we already have SPARK-48177.

[jira] [Created] (SPARK-48371) Upgrade to Parquet 1.14

2024-05-21 Thread Willi Raschkowski (Jira)
Willi Raschkowski created SPARK-48371: - Summary: Upgrade to Parquet 1.14 Key: SPARK-48371 URL: https://issues.apache.org/jira/browse/SPARK-48371 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-48370) Checkpoint and localCheckpoint in Scala Spark Connect client

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48370: --- Labels: pull-request-available (was: ) > Checkpoint and localCheckpoint in Scala Spark

[jira] [Created] (SPARK-48370) Checkpoint and localCheckpoint in Scala Spark Connect client

2024-05-21 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-48370: Summary: Checkpoint and localCheckpoint in Scala Spark Connect client Key: SPARK-48370 URL: https://issues.apache.org/jira/browse/SPARK-48370 Project: Spark

[jira] [Updated] (SPARK-48370) Checkpoint and localCheckpoint in Scala Spark Connect client

2024-05-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-48370: - Issue Type: Improvement (was: Bug) > Checkpoint and localCheckpoint in Scala Spark Connect

[jira] [Updated] (SPARK-48282) Alter string search logic for: replace, find_in_set (UTF8_BINARY_LCASE)

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48282: --- Labels: pull-request-available (was: ) > Alter string search logic for: replace,

[jira] [Updated] (SPARK-48282) Alter logic for: replace, find_in_set (UTF8_BINARY_LCASE)

2024-05-21 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-48282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-48282: - Summary: Alter logic for: replace, find_in_set (UTF8_BINARY_LCASE) (was: Alter logic for:

[jira] [Updated] (SPARK-48282) Alter string search logic for: replace, find_in_set (UTF8_BINARY_LCASE)

2024-05-21 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-48282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-48282: - Summary: Alter string search logic for: replace, find_in_set (UTF8_BINARY_LCASE) (was: Alter

[jira] [Updated] (SPARK-48281) Alter string search logic for: instr, substring_index (UTF8_BINARY_LCASE)

2024-05-21 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-48281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-48281: - Summary: Alter string search logic for: instr, substring_index (UTF8_BINARY_LCASE) (was: Alter

[jira] [Updated] (SPARK-48221) Alter string search logic for: startsWith, endsWith, contains, locate (UTF8_BINARY_LCASE)

2024-05-21 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-48221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-48221: - Summary: Alter string search logic for: startsWith, endsWith, contains, locate

[jira] [Updated] (SPARK-48311) Nested pythonUDF in groupBy and aggregate result in Binding Exception

2024-05-21 Thread Sumit Singh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sumit Singh updated SPARK-48311: Component/s: SQL > Nested pythonUDF in groupBy and aggregate result in Binding Exception >

[jira] [Assigned] (SPARK-48369) Add function timestamp_add

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48369: -- Assignee: Apache Spark > Add function timestamp_add > -- > >

[jira] [Assigned] (SPARK-48359) Built-in functions for Zstd compression and decompression

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48359: -- Assignee: (was: Apache Spark) > Built-in functions for Zstd compression and

[jira] [Updated] (SPARK-48369) Add function timestamp_add

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48369: --- Labels: pull-request-available (was: ) > Add function timestamp_add >

[jira] [Resolved] (SPARK-48365) DB2: Document Mapping Spark SQL Data Types to DB2

2024-05-21 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-48365. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46677

[jira] [Assigned] (SPARK-48365) DB2: Document Mapping Spark SQL Data Types to DB2

2024-05-21 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-48365: Assignee: Kent Yao > DB2: Document Mapping Spark SQL Data Types to DB2 >

[jira] [Assigned] (SPARK-48342) Parser support

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48342: -- Assignee: Apache Spark > Parser support > -- > > Key:

[jira] [Assigned] (SPARK-48342) Parser support

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48342: -- Assignee: (was: Apache Spark) > Parser support > -- > >

[jira] [Created] (SPARK-48369) Add function timestamp_add

2024-05-21 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-48369: - Summary: Add function timestamp_add Key: SPARK-48369 URL: https://issues.apache.org/jira/browse/SPARK-48369 Project: Spark Issue Type: New Feature

[jira] [Assigned] (SPARK-48365) DB2: Document Mapping Spark SQL Data Types to DB2

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48365: -- Assignee: (was: Apache Spark) > DB2: Document Mapping Spark SQL Data Types to

[jira] [Assigned] (SPARK-48354) Added function support and testing for filter push down in JDBC connectors

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48354: -- Assignee: (was: Apache Spark) > Added function support and testing for filter

[jira] [Assigned] (SPARK-48365) DB2: Document Mapping Spark SQL Data Types to DB2

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48365: -- Assignee: Apache Spark > DB2: Document Mapping Spark SQL Data Types to DB2 >

[jira] [Assigned] (SPARK-48354) Added function support and testing for filter push down in JDBC connectors

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48354: -- Assignee: Apache Spark > Added function support and testing for filter push down in

[jira] [Assigned] (SPARK-47008) Spark to support S3 Express One Zone Storage

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47008: -- Assignee: Apache Spark > Spark to support S3 Express One Zone Storage >

[jira] [Assigned] (SPARK-47008) Spark to support S3 Express One Zone Storage

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-47008: -- Assignee: (was: Apache Spark) > Spark to support S3 Express One Zone Storage >

[jira] [Created] (SPARK-48368) Use WITH expression in PushDownPredicates to avoid duplicate expressions

2024-05-21 Thread Mingliang Zhu (Jira)
Mingliang Zhu created SPARK-48368: - Summary: Use WITH expression in PushDownPredicates to avoid duplicate expressions Key: SPARK-48368 URL: https://issues.apache.org/jira/browse/SPARK-48368 Project:

[jira] [Resolved] (SPARK-48367) Fix lint-scala for scalafmt to detect properly

2024-05-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48367. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46679

[jira] [Assigned] (SPARK-48367) Fix lint-scala for scalafmt to detect properly

2024-05-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48367: Assignee: Hyukjin Kwon > Fix lint-scala for scalafmt to detect properly >

[jira] [Updated] (SPARK-48367) Fix lint-scala for scalafmt to detect properly

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48367: --- Labels: pull-request-available (was: ) > Fix lint-scala for scalafmt to detect properly >

[jira] [Created] (SPARK-48367) Fix lint-scala for scalafmt to detect properly

2024-05-21 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-48367: Summary: Fix lint-scala for scalafmt to detect properly Key: SPARK-48367 URL: https://issues.apache.org/jira/browse/SPARK-48367 Project: Spark Issue Type:

[jira] [Updated] (SPARK-48341) Allow Spark Connect plugins to use QueryTest in their tests

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48341: --- Labels: pull-request-available (was: ) > Allow Spark Connect plugins to use QueryTest in

[jira] [Updated] (SPARK-47008) Spark to support S3 Express One Zone Storage

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47008: --- Labels: pull-request-available (was: ) > Spark to support S3 Express One Zone Storage >

[jira] [Updated] (SPARK-48365) DB2: Document Mapping Spark SQL Data Types to DB2

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48365: --- Labels: pull-request-available (was: ) > DB2: Document Mapping Spark SQL Data Types to DB2

[jira] [Updated] (SPARK-48366) Simplify statements related to `filter`

2024-05-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48366: --- Labels: pull-request-available (was: ) > Simplify statements related to `filter` >

[jira] [Created] (SPARK-48366) Simplify statements related to `filter`

2024-05-21 Thread Yang Jie (Jira)
Yang Jie created SPARK-48366: Summary: Simplify statements related to `filter` Key: SPARK-48366 URL: https://issues.apache.org/jira/browse/SPARK-48366 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-48365) DB2: Document Mapping Spark SQL Data Types to DB2

2024-05-21 Thread Kent Yao (Jira)
Kent Yao created SPARK-48365: Summary: DB2: Document Mapping Spark SQL Data Types to DB2 Key: SPARK-48365 URL: https://issues.apache.org/jira/browse/SPARK-48365 Project: Spark Issue Type:

[jira] [Created] (SPARK-48364) Type casting for AbstractMapType

2024-05-21 Thread Jira
Uroš Bojanić created SPARK-48364: Summary: Type casting for AbstractMapType Key: SPARK-48364 URL: https://issues.apache.org/jira/browse/SPARK-48364 Project: Spark Issue Type: Sub-task