[jira] [Resolved] (SPARK-45713) Support registering Python data sources

2023-10-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45713. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43566

[jira] [Assigned] (SPARK-45713) Support registering Python data sources

2023-10-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45713: --- Assignee: Allison Wang > Support registering Python data sources >

[jira] [Updated] (SPARK-45730) [CORE] Make ReloadingX509TrustManagerSuite less flaky

2023-10-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45730: --- Labels: pull-request-available (was: ) > [CORE] Make ReloadingX509TrustManagerSuite less

[jira] [Updated] (SPARK-45735) Reenable CatalogTests without Spark Connect

2023-10-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45735: --- Labels: pull-request-available (was: ) > Reenable CatalogTests without Spark Connect >

[jira] [Created] (SPARK-45735) Reenable CatalogTests without Spark Connect

2023-10-30 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-45735: Summary: Reenable CatalogTests without Spark Connect Key: SPARK-45735 URL: https://issues.apache.org/jira/browse/SPARK-45735 Project: Spark Issue Type: New

[jira] [Resolved] (SPARK-45729) Fix PySpark testing guide links

2023-10-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45729. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43587

[jira] [Assigned] (SPARK-45729) Fix PySpark testing guide links

2023-10-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45729: Assignee: Amanda Liu > Fix PySpark testing guide links > ---

[jira] [Resolved] (SPARK-45727) Remove unused map in watermark propagation

2023-10-30 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-45727. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43588

[jira] [Resolved] (SPARK-45592) AQE and InMemoryTableScanExec correctness bug

2023-10-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45592. - Fix Version/s: 4.0.0 3.5.1 Resolution: Fixed Issue resolved by pull

[jira] [Created] (SPARK-45734) Upgrade commons-io to 2.15.0

2023-10-30 Thread Yang Jie (Jira)
Yang Jie created SPARK-45734: Summary: Upgrade commons-io to 2.15.0 Key: SPARK-45734 URL: https://issues.apache.org/jira/browse/SPARK-45734 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-45733) Classify errors into different classes and support different retry policies.

2023-10-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45733: --- Labels: pull-request-available (was: ) > Classify errors into different classes and

[jira] [Created] (SPARK-45733) Classify errors into different classes and support different retry policies.

2023-10-30 Thread Alice Sayutina (Jira)
Alice Sayutina created SPARK-45733: -- Summary: Classify errors into different classes and support different retry policies. Key: SPARK-45733 URL: https://issues.apache.org/jira/browse/SPARK-45733

[jira] [Resolved] (SPARK-45728) Upgrade `kubernetes-client` to 6.9.1

2023-10-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45728. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43589

[jira] [Assigned] (SPARK-45728) Upgrade `kubernetes-client` to 6.9.1

2023-10-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45728: - Assignee: Dongjoon Hyun > Upgrade `kubernetes-client` to 6.9.1 >

[jira] [Updated] (SPARK-45732) Upgrade commons-text to 1.11.0

2023-10-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45732: --- Labels: pull-request-available (was: ) > Upgrade commons-text to 1.11.0 >

[jira] [Created] (SPARK-45732) Upgrade commons-text to 1.11.0

2023-10-30 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-45732: --- Summary: Upgrade commons-text to 1.11.0 Key: SPARK-45732 URL: https://issues.apache.org/jira/browse/SPARK-45732 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-45282) Join loses records for cached datasets

2023-10-30 Thread koert kuipers (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17781171#comment-17781171 ] koert kuipers commented on SPARK-45282: --- last time i checked this issue was still present in

[jira] [Updated] (SPARK-44512) dataset.sort.select.write.partitionBy sorts wrong column

2023-10-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44512: -- Fix Version/s: (was: 3.4.2) > dataset.sort.select.write.partitionBy sorts wrong column >

[jira] [Updated] (SPARK-44512) dataset.sort.select.write.partitionBy sorts wrong column

2023-10-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44512: -- Target Version/s: 3.4.2 > dataset.sort.select.write.partitionBy sorts wrong column >

[jira] [Commented] (SPARK-44512) dataset.sort.select.write.partitionBy sorts wrong column

2023-10-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17781169#comment-17781169 ] Dongjoon Hyun commented on SPARK-44512: --- Hi, All. Is this correctness issue valid in

[jira] [Commented] (SPARK-45282) Join loses records for cached datasets

2023-10-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17781168#comment-17781168 ] Dongjoon Hyun commented on SPARK-45282: --- Let me increase the priority to `Blocker` for now. >

[jira] [Updated] (SPARK-44512) dataset.sort.select.write.partitionBy sorts wrong column

2023-10-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44512: -- Fix Version/s: 3.4.2 > dataset.sort.select.write.partitionBy sorts wrong column >

[jira] [Updated] (SPARK-45282) Join loses records for cached datasets

2023-10-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45282: -- Priority: Blocker (was: Major) > Join loses records for cached datasets >

[jira] [Updated] (SPARK-45282) Join loses records for cached datasets

2023-10-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45282: -- Target Version/s: 3.4.2 > Join loses records for cached datasets >

[jira] [Commented] (SPARK-45282) Join loses records for cached datasets

2023-10-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17781167#comment-17781167 ] Dongjoon Hyun commented on SPARK-45282: --- Hi, All Is this correctness issue still valid in

[jira] [Resolved] (SPARK-45245) PythonWorkerFactory create gets stuck in case of worker failures

2023-10-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45245. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43023

[jira] [Assigned] (SPARK-45245) PythonWorkerFactory create gets stuck in case of worker failures

2023-10-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45245: Assignee: Raghu Angadi > PythonWorkerFactory create gets stuck in case of worker

[jira] [Assigned] (SPARK-45506) Support ivy URIs in SparkConnect addArtifact

2023-10-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45506: Assignee: Vsevolod Stepanov > Support ivy URIs in SparkConnect addArtifact >

[jira] [Resolved] (SPARK-45506) Support ivy URIs in SparkConnect addArtifact

2023-10-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45506. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43354

[jira] [Created] (SPARK-45731) Update partition statistics with ANALYZE TABLE command

2023-10-30 Thread Chao Sun (Jira)
Chao Sun created SPARK-45731: Summary: Update partition statistics with ANALYZE TABLE command Key: SPARK-45731 URL: https://issues.apache.org/jira/browse/SPARK-45731 Project: Spark Issue Type:

[jira] [Updated] (SPARK-45652) SPJ: Handle empty input partitions after dynamic filtering

2023-10-30 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-45652: - Description: When the number of input partitions become 0 after dynamic filtering, in

[jira] [Updated] (SPARK-45729) Fix PySpark testing guide links

2023-10-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45729: --- Labels: pull-request-available (was: ) > Fix PySpark testing guide links >

[jira] [Created] (SPARK-45730) [CORE] Make ReloadingX509TrustManagerSuite less flaky

2023-10-30 Thread Hasnain Lakhani (Jira)
Hasnain Lakhani created SPARK-45730: --- Summary: [CORE] Make ReloadingX509TrustManagerSuite less flaky Key: SPARK-45730 URL: https://issues.apache.org/jira/browse/SPARK-45730 Project: Spark

[jira] [Created] (SPARK-45729) Fix PySpark testing guide links

2023-10-30 Thread Amanda Liu (Jira)
Amanda Liu created SPARK-45729: -- Summary: Fix PySpark testing guide links Key: SPARK-45729 URL: https://issues.apache.org/jira/browse/SPARK-45729 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-45728) Upgrade `kubernetes-client` to 6.9.1

2023-10-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45728: --- Labels: pull-request-available (was: ) > Upgrade `kubernetes-client` to 6.9.1 >

[jira] [Commented] (SPARK-45727) Remove unused map in watermark propagation

2023-10-30 Thread Anish Shrigondekar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17781093#comment-17781093 ] Anish Shrigondekar commented on SPARK-45727: [https://github.com/apache/spark/pull/43588]  

[jira] [Created] (SPARK-45728) Upgrade `kubernetes-client` to 6.9.1

2023-10-30 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-45728: - Summary: Upgrade `kubernetes-client` to 6.9.1 Key: SPARK-45728 URL: https://issues.apache.org/jira/browse/SPARK-45728 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-45644) After upgrading to Spark 3.4.1 and 3.5.0 we receive RuntimeException "scala.Some is not a valid external type for schema of array"

2023-10-30 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17781091#comment-17781091 ] Bruce Robbins commented on SPARK-45644: --- You can turn on display of the generated code by adding

[jira] [Updated] (SPARK-45726) Make Dataset.collectResult private

2023-10-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45726: --- Labels: pull-request-available (was: ) > Make Dataset.collectResult private >

[jira] [Created] (SPARK-45726) Make Dataset.collectResult private

2023-10-30 Thread Yihong He (Jira)
Yihong He created SPARK-45726: - Summary: Make Dataset.collectResult private Key: SPARK-45726 URL: https://issues.apache.org/jira/browse/SPARK-45726 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-45691) Clean up the deprecated API usage related to `RightProjection/LeftProjection/Either`

2023-10-30 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-45691. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43576

[jira] [Resolved] (SPARK-45690) Clean up type use of `BufferedIterator/CanBuildFrom/Traversable`

2023-10-30 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-45690. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43576

[jira] [Assigned] (SPARK-45691) Clean up the deprecated API usage related to `RightProjection/LeftProjection/Either`

2023-10-30 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-45691: Assignee: Yang Jie > Clean up the deprecated API usage related to >

[jira] [Assigned] (SPARK-45689) Clean up the deprecated API usage related to `StringContext/StringOps`

2023-10-30 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-45689: Assignee: Yang Jie > Clean up the deprecated API usage related to `StringContext/StringOps` >

[jira] [Resolved] (SPARK-45689) Clean up the deprecated API usage related to `StringContext/StringOps`

2023-10-30 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-45689. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43576

[jira] [Resolved] (SPARK-45724) Add a separate LogAppender for tests that need to print `RuleExecutor.dumpTimeSpent()` to avoid truncation of Metrics

2023-10-30 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-45724. -- Resolution: Not A Problem > Add a separate LogAppender for tests that need to print >

[jira] [Updated] (SPARK-45725) remove the non-default IN subquery runtime filter

2023-10-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45725: --- Labels: pull-request-available (was: ) > remove the non-default IN subquery runtime filter

[jira] [Created] (SPARK-45725) remove the non-default IN subquery runtime filter

2023-10-30 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-45725: --- Summary: remove the non-default IN subquery runtime filter Key: SPARK-45725 URL: https://issues.apache.org/jira/browse/SPARK-45725 Project: Spark Issue Type:

[jira] [Commented] (SPARK-45694) Fix `method signum in trait ScalaNumberProxy is deprecated`

2023-10-30 Thread Tengfei Huang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17781022#comment-17781022 ] Tengfei Huang commented on SPARK-45694: --- Hi [~LuciferYang], I will work on this. > Fix `method

[jira] [Assigned] (SPARK-45681) Clone a js version of UIUtils.errorMessageCell to for consistent error parsing on UI

2023-10-30 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-45681: Assignee: Kent Yao > Clone a js version of UIUtils.errorMessageCell to for consistent error >

[jira] [Resolved] (SPARK-45681) Clone a js version of UIUtils.errorMessageCell to for consistent error parsing on UI

2023-10-30 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-45681. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43547

[jira] [Commented] (SPARK-45522) Migrate jetty 9 to jetty 12

2023-10-30 Thread HiuFung (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17781012#comment-17781012 ] HiuFung commented on SPARK-45522: - [~LuciferYang] Sweet, can you assign this to me? I will work on it.

[jira] [Commented] (SPARK-45522) Migrate jetty 9 to jetty 12

2023-10-30 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17781007#comment-17781007 ] Yang Jie commented on SPARK-45522: -- [~HF] I'm very glad you're interested in this work. As there is

[jira] [Updated] (SPARK-45724) Add a separate LogAppender for tests that need to print `RuleExecutor.dumpTimeSpent()` to avoid truncation of Metrics

2023-10-30 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45724: - Summary: Add a separate LogAppender for tests that need to print `RuleExecutor.dumpTimeSpent()` to

[jira] [Updated] (SPARK-45724) Add a separate LogAppender for tests that need to print `RuleExecutor.dumpTimeSpent()` to avoid truncation of Metrics

2023-10-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45724: --- Labels: pull-request-available (was: ) > Add a separate LogAppender for tests that need to

[jira] [Created] (SPARK-45724) Add a separate LogAppender for tests that need to print `RuleExecutor.dumpTimeSpent()` to avoid truncation of Metrics information.

2023-10-30 Thread Yang Jie (Jira)
Yang Jie created SPARK-45724: Summary: Add a separate LogAppender for tests that need to print `RuleExecutor.dumpTimeSpent()` to avoid truncation of Metrics information. Key: SPARK-45724 URL:

[jira] [Commented] (SPARK-44319) Migrate jersey 2 to jersey 3

2023-10-30 Thread HiuFung (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17780994#comment-17780994 ] HiuFung commented on SPARK-44319: - [~LuciferYang]  Hi, by checking on the migration guide of jersey 3,

[jira] [Comment Edited] (SPARK-45722) False positive when cheking for ambigious columns

2023-10-30 Thread Alexey Dmitriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17780965#comment-17780965 ] Alexey Dmitriev edited comment on SPARK-45722 at 10/30/23 11:27 AM:

[jira] [Commented] (SPARK-45722) False positive when cheking for ambigious columns

2023-10-30 Thread Alexey Dmitriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17780965#comment-17780965 ] Alexey Dmitriev commented on SPARK-45722: - turning off spark.sql.analyzer.failAmbiguousSelfJoin

[jira] [Assigned] (SPARK-45723) Catalog methods avoid pandas conversion

2023-10-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45723: Assignee: Ruifeng Zheng > Catalog methods avoid pandas conversion >

[jira] [Resolved] (SPARK-45723) Catalog methods avoid pandas conversion

2023-10-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45723. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43583

[jira] [Updated] (SPARK-45722) False positive when cheking for ambigious columns

2023-10-30 Thread Alexey Dmitriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Dmitriev updated SPARK-45722: Description: I have following code, which I expect to work {code:java} from pyspark.sql

[jira] [Updated] (SPARK-45722) False positive when cheking for ambigious columns

2023-10-30 Thread Alexey Dmitriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Dmitriev updated SPARK-45722: Description: I have following code, which I expect to work {code:java} from pyspark.sql

[jira] [Commented] (SPARK-45722) False positive when cheking for ambigious columns

2023-10-30 Thread Alexey Dmitriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17780942#comment-17780942 ] Alexey Dmitriev commented on SPARK-45722: - I think the type of the merge should be checked

[jira] [Updated] (SPARK-45722) False positive when cheking for ambigious columns

2023-10-30 Thread Alexey Dmitriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Dmitriev updated SPARK-45722: Description: I have following code, which I expect to work ``` from pyspark.sql import

[jira] [Updated] (SPARK-45722) False positive when cheking for ambigious columns

2023-10-30 Thread Alexey Dmitriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Dmitriev updated SPARK-45722: Description: I have following code: ``` from pyspark.sql import SparkSession session =

[jira] [Created] (SPARK-45722) False positive when cheking for ambigious columns

2023-10-30 Thread Alexey Dmitriev (Jira)
Alexey Dmitriev created SPARK-45722: --- Summary: False positive when cheking for ambigious columns Key: SPARK-45722 URL: https://issues.apache.org/jira/browse/SPARK-45722 Project: Spark

[jira] [Updated] (SPARK-45722) False positive when cheking for ambigious columns

2023-10-30 Thread Alexey Dmitriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Dmitriev updated SPARK-45722: Environment: py3.11  pyspark 3.4.0 was: py3.11  pyspark 3.4.0   I have following

[jira] [Commented] (SPARK-44124) Upgrade AWS SDK to v2

2023-10-30 Thread Lantao Jin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17780929#comment-17780929 ] Lantao Jin commented on SPARK-44124: Thanks, I created three sub-tasks so far. [~Junyu Chen], could

[jira] [Updated] (SPARK-45700) Fix `The outer reference in this type test cannot be checked at run time`

2023-10-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45700: --- Labels: pull-request-available (was: ) > Fix `The outer reference in this type test cannot

[jira] [Created] (SPARK-45721) Upgrade AWS SDK to v2 for Hadoop dependency

2023-10-30 Thread Lantao Jin (Jira)
Lantao Jin created SPARK-45721: -- Summary: Upgrade AWS SDK to v2 for Hadoop dependency Key: SPARK-45721 URL: https://issues.apache.org/jira/browse/SPARK-45721 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-45719) Upgrade AWS SDK to v2 for Kubernetes integration tests

2023-10-30 Thread Lantao Jin (Jira)
Lantao Jin created SPARK-45719: -- Summary: Upgrade AWS SDK to v2 for Kubernetes integration tests Key: SPARK-45719 URL: https://issues.apache.org/jira/browse/SPARK-45719 Project: Spark Issue

[jira] [Assigned] (SPARK-45592) AQE and InMemoryTableScanExec correctness bug

2023-10-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45592: -- Assignee: Apache Spark > AQE and InMemoryTableScanExec correctness bug >

[jira] [Updated] (SPARK-45718) Remove remaining deprecated Pandas APIs from Spark 3.4.0

2023-10-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45718: --- Labels: pull-request-available (was: ) > Remove remaining deprecated Pandas APIs from

[jira] [Created] (SPARK-45718) Remove remaining deprecated Pandas APIs from Spark 3.4.0

2023-10-30 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-45718: --- Summary: Remove remaining deprecated Pandas APIs from Spark 3.4.0 Key: SPARK-45718 URL: https://issues.apache.org/jira/browse/SPARK-45718 Project: Spark Issue

[jira] [Updated] (SPARK-45683) Fix `method any2stringadd in object Predef is deprecated`

2023-10-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45683: --- Labels: pull-request-available (was: ) > Fix `method any2stringadd in object Predef is

[jira] [Updated] (SPARK-45688) Clean up the deprecated API usage related to `MapOps`

2023-10-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45688: --- Labels: pull-request-available (was: ) > Clean up the deprecated API usage related to