[jira] [Commented] (SPARK-47017) Show metrics of the physical plan of RDDScanExec's internal RDD in the history server

2024-05-06 Thread Eric Yang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844145#comment-17844145 ] Eric Yang commented on SPARK-47017: --- I'm preparing a PR for it.  > Show metrics of the physical plan

[jira] [Resolved] (SPARK-48163) Disable `SparkConnectServiceSuite.SPARK-43923: commands send events - get_resources_command`

2024-05-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48163. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46425

[jira] [Updated] (SPARK-48139) Re-enable `SparkSessionE2ESuite.interrupt tag`

2024-05-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48139: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Bug) > Re-enable

[jira] [Updated] (SPARK-48164) Re-enable `SparkConnectServiceSuite.SPARK-43923: commands send events - get_resources_command`

2024-05-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48164: -- Component/s: Tests > Re-enable `SparkConnectServiceSuite.SPARK-43923: commands send events -

[jira] [Updated] (SPARK-48164) Re-enable `SparkConnectServiceSuite.SPARK-43923: commands send events - get_resources_command`

2024-05-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48164: -- Target Version/s: 4.0.0 > Re-enable `SparkConnectServiceSuite.SPARK-43923: commands send

[jira] [Assigned] (SPARK-48163) Disable `SparkConnectServiceSuite.SPARK-43923: commands send events - get_resources_command`

2024-05-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48163: - Assignee: Dongjoon Hyun > Disable `SparkConnectServiceSuite.SPARK-43923: commands send

[jira] [Updated] (SPARK-48163) Disable `SparkConnectServiceSuite.SPARK-43923: commands send events - get_resources_command`

2024-05-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48163: --- Labels: pull-request-available (was: ) > Disable `SparkConnectServiceSuite.SPARK-43923:

[jira] [Created] (SPARK-48164) Re-enable `SparkConnectServiceSuite.SPARK-43923: commands send events - get_resources_command`

2024-05-06 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-48164: - Summary: Re-enable `SparkConnectServiceSuite.SPARK-43923: commands send events - get_resources_command` Key: SPARK-48164 URL: https://issues.apache.org/jira/browse/SPARK-48164

[jira] [Commented] (SPARK-48000) Hash join support for strings with collation

2024-05-06 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-48000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844127#comment-17844127 ] Uroš Bojanić commented on SPARK-48000: -- wip: https://github.com/apache/spark/pull/46166 > Hash

[jira] [Created] (SPARK-48163) Disable `SparkConnectServiceSuite.SPARK-43923: commands send events - get_resources_command`

2024-05-06 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-48163: - Summary: Disable `SparkConnectServiceSuite.SPARK-43923: commands send events - get_resources_command` Key: SPARK-48163 URL: https://issues.apache.org/jira/browse/SPARK-48163

[jira] [Commented] (SPARK-48158) XML expressions (all collations)

2024-05-06 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-48158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844122#comment-17844122 ] Uroš Bojanić commented on SPARK-48158: -- work in progress > XML expressions (all collations) >

[jira] [Created] (SPARK-48160) XPath expressions (all collations)

2024-05-06 Thread Jira
Uroš Bojanić created SPARK-48160: Summary: XPath expressions (all collations) Key: SPARK-48160 URL: https://issues.apache.org/jira/browse/SPARK-48160 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-48161) JSON expressions (all collations)

2024-05-06 Thread Jira
Uroš Bojanić created SPARK-48161: Summary: JSON expressions (all collations) Key: SPARK-48161 URL: https://issues.apache.org/jira/browse/SPARK-48161 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-48162) Miscellaneous expressions (all collations)

2024-05-06 Thread Jira
Uroš Bojanić created SPARK-48162: Summary: Miscellaneous expressions (all collations) Key: SPARK-48162 URL: https://issues.apache.org/jira/browse/SPARK-48162 Project: Spark Issue Type:

[jira] [Created] (SPARK-48158) XML expressions (all collations)

2024-05-06 Thread Jira
Uroš Bojanić created SPARK-48158: Summary: XML expressions (all collations) Key: SPARK-48158 URL: https://issues.apache.org/jira/browse/SPARK-48158 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-48159) Datetime expressions (all collations)

2024-05-06 Thread Jira
Uroš Bojanić created SPARK-48159: Summary: Datetime expressions (all collations) Key: SPARK-48159 URL: https://issues.apache.org/jira/browse/SPARK-48159 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-48157) CSV expressions (all collations)

2024-05-06 Thread Jira
Uroš Bojanić created SPARK-48157: Summary: CSV expressions (all collations) Key: SPARK-48157 URL: https://issues.apache.org/jira/browse/SPARK-48157 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-47421) URL expressions (all collations)

2024-05-06 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47421: - Summary: URL expressions (all collations) (was: TBD) > URL expressions (all collations) >

[jira] [Updated] (SPARK-47354) Variant expressions (all collations)

2024-05-06 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47354: - Summary: Variant expressions (all collations) (was: ParseJson & VariantExplode (all

[jira] [Updated] (SPARK-47297) Format expressions

2024-05-06 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47297: - Summary: Format expressions (was: Hash functions) > Format expressions > -- >

[jira] [Updated] (SPARK-47297) Format expressions (all collations)

2024-05-06 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47297: - Summary: Format expressions (all collations) (was: Format expressions) > Format expressions

[jira] [Commented] (SPARK-47297) Format expressions

2024-05-06 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844118#comment-17844118 ] Uroš Bojanić commented on SPARK-47297: -- wip: https://github.com/apache/spark/pull/46423 > Format

[jira] [Commented] (SPARK-47267) Hash functions should respect collation

2024-05-06 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844117#comment-17844117 ] Uroš Bojanić commented on SPARK-47267: -- wip: https://github.com/apache/spark/pull/46422 > Hash

[jira] [Updated] (SPARK-47297) Hash functions

2024-05-06 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47297: - Summary: Hash functions (was: TBD) > Hash functions > -- > > Key:

[jira] [Resolved] (SPARK-47355) Use wildcard imports in CollationTypeCasts

2024-05-06 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić resolved SPARK-47355. -- Resolution: Fixed Resolved by https://github.com/apache/spark/pull/46230 > Use wildcard

[jira] [Commented] (SPARK-48084) pyspark.ml.connect.evaluation not working in 3.5 client <> 4.0 server

2024-05-06 Thread Weichen Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844112#comment-17844112 ] Weichen Xu commented on SPARK-48084: This test error {{pyspark.ml.connect.evaluation not working in

[jira] [Updated] (SPARK-48155) PropagateEmpty relation cause LogicalQueryStage only with broadcast without join then execute failed

2024-05-06 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-48155: -- Description: {code:java} 24/05/07 09:48:55 ERROR [main] PlanChangeLogger: === Applying Rule

[jira] [Commented] (SPARK-48083) session.copyFromLocalToFs failure with 3.5 client <> 4.0 server

2024-05-06 Thread Weichen Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17844111#comment-17844111 ] Weichen Xu commented on SPARK-48083: this is not an issue, {{copyFromLocalToFs}} requires spark

[jira] [Created] (SPARK-48155) PropagateEmpty relation cause LogicalQueryStage only with broadcast without join then execute failed

2024-05-06 Thread angerszhu (Jira)
angerszhu created SPARK-48155: - Summary: PropagateEmpty relation cause LogicalQueryStage only with broadcast without join then execute failed Key: SPARK-48155 URL: https://issues.apache.org/jira/browse/SPARK-48155

[jira] [Resolved] (SPARK-48141) Update the Oracle docker image version used for test and integration to use Oracle Database 23ai Free

2024-05-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48141. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46399

[jira] [Assigned] (SPARK-48141) Update the Oracle docker image version used for test and integration to use Oracle Database 23ai Free

2024-05-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48141: - Assignee: Luca Canali > Update the Oracle docker image version used for test and

[jira] [Updated] (SPARK-48083) session.copyFromLocalToFs failure with 3.5 client <> 4.0 server

2024-05-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48083: --- Labels: pull-request-available (was: ) > session.copyFromLocalToFs failure with 3.5 client

[jira] [Updated] (SPARK-48154) Enable `PandasUDFGroupedAggParityTests.test_manual`

2024-05-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48154: --- Labels: pull-request-available (was: ) > Enable

[jira] [Updated] (SPARK-48090) Streaming exception catch failure in 3.5 client <> 4.0 server

2024-05-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-48090: - Description: {code} == FAIL

[jira] [Resolved] (SPARK-48150) Fix nullability of try_parse_json

2024-05-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48150. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46409

[jira] [Updated] (SPARK-48090) Streaming exception catch failure in 3.5 client <> 4.0 server

2024-05-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48090: --- Labels: pull-request-available (was: ) > Streaming exception catch failure in 3.5 client

[jira] [Resolved] (SPARK-48147) Remove all client listeners when local spark session is deleted

2024-05-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48147. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46406

[jira] [Resolved] (SPARK-48153) Run `build` job of `build_and_test.yml` only if needed

2024-05-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48153. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46412

[jira] [Updated] (SPARK-48153) Run `build` job only if needed

2024-05-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48153: --- Labels: pull-request-available (was: ) > Run `build` job only if needed >

[jira] [Updated] (SPARK-48153) Run `build` job of `build_and_test.yml` only if needed

2024-05-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48153: -- Summary: Run `build` job of `build_and_test.yml` only if needed (was: Run `build` job only

[jira] [Updated] (SPARK-48152) Make the module `spark-profiler` as a part of Spark release

2024-05-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48152: --- Labels: pull-request-available (was: ) > Make the module `spark-profiler` as a part of

[jira] [Assigned] (SPARK-48151) `build_and_test.yml` should use `Volcano` 1.7.0 for `branch-3.4/3.5`

2024-05-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48151: - Assignee: Dongjoon Hyun > `build_and_test.yml` should use `Volcano` 1.7.0 for

[jira] [Resolved] (SPARK-48151) `build_and_test.yml` should use `Volcano` 1.7.0 for `branch-3.4/3.5`

2024-05-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48151. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46410

[jira] [Created] (SPARK-48152) Make the module `spark-profiler` as a part of Spark release

2024-05-06 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-48152: --- Summary: Make the module `spark-profiler` as a part of Spark release Key: SPARK-48152 URL: https://issues.apache.org/jira/browse/SPARK-48152 Project: Spark

[jira] [Assigned] (SPARK-48142) Enable `CogroupedApplyInPandasTests.test_wrong_args`

2024-05-06 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-48142: - Assignee: Ruifeng Zheng > Enable `CogroupedApplyInPandasTests.test_wrong_args` >

[jira] [Resolved] (SPARK-48142) Enable `CogroupedApplyInPandasTests.test_wrong_args`

2024-05-06 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-48142. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46397

[jira] [Assigned] (SPARK-48035) try_add/try_multiply should not be semantic equal to add/multiply

2024-05-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48035: Assignee: Gengliang Wang > try_add/try_multiply should not be semantic equal to

[jira] [Resolved] (SPARK-48035) try_add/try_multiply should not be semantic equal to add/multiply

2024-05-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48035. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46307

[jira] [Updated] (SPARK-48105) Fix the data corruption issue when state store unload and snapshotting happens concurrently for HDFS state store

2024-05-06 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-48105: - Affects Version/s: 3.5.2 3.4.4 > Fix the data corruption issue when

[jira] [Resolved] (SPARK-48105) Fix the data corruption issue when state store unload and snapshotting happens concurrently for HDFS state store

2024-05-06 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-48105. -- Fix Version/s: 4.0.0 Assignee: Huanli Wang Resolution: Fixed Issue resolved

[jira] [Updated] (SPARK-48151) `build_and_test.yml` should use `Volcano` 1.7.0 for `branch-3.4/3.5`

2024-05-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48151: --- Labels: pull-request-available (was: ) > `build_and_test.yml` should use `Volcano` 1.7.0

[jira] [Created] (SPARK-48151) `build_and_test.yml` should use `Volcano` 1.7.0 for `branch-3.4/3.5`

2024-05-06 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-48151: - Summary: `build_and_test.yml` should use `Volcano` 1.7.0 for `branch-3.4/3.5` Key: SPARK-48151 URL: https://issues.apache.org/jira/browse/SPARK-48151 Project:

[jira] [Resolved] (SPARK-48112) Expose session in SparkConnectPlanner to plugin developers

2024-05-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48112. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46363

[jira] [Resolved] (SPARK-48149) Serialize `build_python.yml` to run a single Python version per cron schedule

2024-05-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48149. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46407

[jira] [Created] (SPARK-48150) Fix nullability of try_parse_json

2024-05-06 Thread Josh Rosen (Jira)
Josh Rosen created SPARK-48150: -- Summary: Fix nullability of try_parse_json Key: SPARK-48150 URL: https://issues.apache.org/jira/browse/SPARK-48150 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-48148) JSON objects should not be modified when read as STRING

2024-05-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48148: --- Labels: pull-request-available (was: ) > JSON objects should not be modified when read as

[jira] [Assigned] (SPARK-48149) Serialize `build_python.yml` to run a single Python version per cron schedule

2024-05-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48149: - Assignee: Dongjoon Hyun > Serialize `build_python.yml` to run a single Python version

[jira] [Updated] (SPARK-48149) Serialize `build_python.yml` to run a single Python version per cron schedule

2024-05-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48149: --- Labels: pull-request-available (was: ) > Serialize `build_python.yml` to run a single

[jira] [Created] (SPARK-48149) Serialize `build_python.yml` to run a single Python version per cron schedule

2024-05-06 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-48149: - Summary: Serialize `build_python.yml` to run a single Python version per cron schedule Key: SPARK-48149 URL: https://issues.apache.org/jira/browse/SPARK-48149

[jira] [Updated] (SPARK-48148) JSON objects should not be modified when read as STRING

2024-05-06 Thread Eric Maynard (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Maynard updated SPARK-48148: - Description: Currently, when reading a JSON like this: bq. {"a": {"b":

[jira] [Resolved] (SPARK-48145) Remove logDebug and logTrace with MDC in java structured logging framework

2024-05-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48145. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46405

[jira] [Updated] (SPARK-48147) Remove all client listeners when local spark session is deleted

2024-05-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48147: --- Labels: pull-request-available (was: ) > Remove all client listeners when local spark

[jira] [Created] (SPARK-48147) Remove all client listeners when local spark session is deleted

2024-05-06 Thread Wei Liu (Jira)
Wei Liu created SPARK-48147: --- Summary: Remove all client listeners when local spark session is deleted Key: SPARK-48147 URL: https://issues.apache.org/jira/browse/SPARK-48147 Project: Spark Issue

[jira] [Updated] (SPARK-48146) Fix error with aggregate function in With child

2024-05-06 Thread Kelvin Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kelvin Jiang updated SPARK-48146: - Description: Right now, if we have an aggregate function in the child of a With expression, we

[jira] [Created] (SPARK-48146) Fix error with aggregate function in With child

2024-05-06 Thread Kelvin Jiang (Jira)
Kelvin Jiang created SPARK-48146: Summary: Fix error with aggregate function in With child Key: SPARK-48146 URL: https://issues.apache.org/jira/browse/SPARK-48146 Project: Spark Issue Type:

[jira] [Created] (SPARK-48145) Remove logDebug and logTrace with MDC in java structured logging framework

2024-05-06 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-48145: -- Summary: Remove logDebug and logTrace with MDC in java structured logging framework Key: SPARK-48145 URL: https://issues.apache.org/jira/browse/SPARK-48145

[jira] [Commented] (SPARK-47353) Mode (all collations)

2024-05-06 Thread Gideon P (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17843777#comment-17843777 ] Gideon P commented on SPARK-47353: -- [~uros-db] ready for initial round of review! Still a draft, but

[jira] [Updated] (SPARK-47353) Mode (all collations)

2024-05-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47353: --- Labels: pull-request-available (was: ) > Mode (all collations) > - > >

[jira] [Created] (SPARK-48144) canPlanAsBroadcastHashJoin should respect shuffle join hints

2024-05-06 Thread Jira
Fredrik Klauß created SPARK-48144: - Summary: canPlanAsBroadcastHashJoin should respect shuffle join hints Key: SPARK-48144 URL: https://issues.apache.org/jira/browse/SPARK-48144 Project: Spark

[jira] [Updated] (SPARK-48143) UnivocityParser is slow when parsing partially-malformed CSV in PERMISSIVE mode

2024-05-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48143: --- Labels: pull-request-available (was: ) > UnivocityParser is slow when parsing

[jira] [Created] (SPARK-48143) UnivocityParser is slow when parsing partially-malformed CSV in PERMISSIVE mode

2024-05-06 Thread Vladimir Golubev (Jira)
Vladimir Golubev created SPARK-48143: Summary: UnivocityParser is slow when parsing partially-malformed CSV in PERMISSIVE mode Key: SPARK-48143 URL: https://issues.apache.org/jira/browse/SPARK-48143

[jira] [Updated] (SPARK-48142) Enable `CogroupedApplyInPandasTests.test_wrong_args`

2024-05-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48142: --- Labels: pull-request-available (was: ) > Enable

[jira] [Created] (SPARK-48142) Enable `CogroupedApplyInPandasTests.test_wrong_args`

2024-05-06 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-48142: - Summary: Enable `CogroupedApplyInPandasTests.test_wrong_args` Key: SPARK-48142 URL: https://issues.apache.org/jira/browse/SPARK-48142 Project: Spark Issue

[jira] [Assigned] (SPARK-48134) Spark core (java side): Migrate `error/warn/info` with variables to structured logging framework

2024-05-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48134: -- Assignee: (was: Apache Spark) > Spark core (java side): Migrate

[jira] [Assigned] (SPARK-48134) Spark core (java side): Migrate `error/warn/info` with variables to structured logging framework

2024-05-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48134: -- Assignee: Apache Spark > Spark core (java side): Migrate `error/warn/info` with

[jira] [Assigned] (SPARK-48027) InjectRuntimeFilter for multi-level join should check child join type

2024-05-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48027: -- Assignee: (was: Apache Spark) > InjectRuntimeFilter for multi-level join should

[jira] [Assigned] (SPARK-48027) InjectRuntimeFilter for multi-level join should check child join type

2024-05-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48027: -- Assignee: Apache Spark > InjectRuntimeFilter for multi-level join should check child

[jira] [Assigned] (SPARK-48027) InjectRuntimeFilter for multi-level join should check child join type

2024-05-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48027: -- Assignee: (was: Apache Spark) > InjectRuntimeFilter for multi-level join should

[jira] [Assigned] (SPARK-48027) InjectRuntimeFilter for multi-level join should check child join type

2024-05-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-48027: -- Assignee: Apache Spark > InjectRuntimeFilter for multi-level join should check child

[jira] [Updated] (SPARK-48141) Update the Oracle docker image version used for test and integration to use Oracle Database 23ai Free

2024-05-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48141: --- Labels: pull-request-available (was: ) > Update the Oracle docker image version used for

[jira] [Created] (SPARK-48141) Update the Oracle docker image version used for test and integration to use Oracle Database 23ai Free

2024-05-06 Thread Luca Canali (Jira)
Luca Canali created SPARK-48141: --- Summary: Update the Oracle docker image version used for test and integration to use Oracle Database 23ai Free Key: SPARK-48141 URL: