[jira] [Updated] (SPARK-45588) Minor scaladoc improvement in StreamingForeachBatchHelper

2023-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45588: --- Labels: pull-request-available (was: ) > Minor scaladoc improvement in

[jira] [Created] (SPARK-45588) Minor scaladoc improvement in StreamingForeachBatchHelper

2023-10-17 Thread Raghu Angadi (Jira)
Raghu Angadi created SPARK-45588: Summary: Minor scaladoc improvement in StreamingForeachBatchHelper Key: SPARK-45588 URL: https://issues.apache.org/jira/browse/SPARK-45588 Project: Spark

[jira] [Updated] (SPARK-45587) Skip UNIDOC and MIMA in build GitHub Action job

2023-10-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45587: -- Summary: Skip UNIDOC and MIMA in build GitHub Action job (was: Skip Unidoc in `build` GitHub

[jira] [Updated] (SPARK-45587) Skip Unidoc in `build` GitHub Action jobs

2023-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45587: --- Labels: pull-request-available (was: ) > Skip Unidoc in `build` GitHub Action jobs >

[jira] [Created] (SPARK-45587) Skip Unidoc in `build` GitHub Action jobs

2023-10-17 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-45587: - Summary: Skip Unidoc in `build` GitHub Action jobs Key: SPARK-45587 URL: https://issues.apache.org/jira/browse/SPARK-45587 Project: Spark Issue Type:

[jira] [Commented] (SPARK-45533) Use `j.l.r.Cleaner` instead of `finalize` for `RocksDBIterator/LevelDBIterator`

2023-10-17 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17776484#comment-17776484 ] Yang Jie commented on SPARK-45533: -- Feel free to pick up this one. Thanks. [~zhaomin]  > Use

[jira] [Assigned] (SPARK-45576) [CORE] Remove unnecessary debug logs in ReloadingX509TrustManagerSuite

2023-10-17 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-45576: --- Assignee: Hasnain Lakhani > [CORE] Remove unnecessary debug logs in

[jira] [Resolved] (SPARK-45576) [CORE] Remove unnecessary debug logs in ReloadingX509TrustManagerSuite

2023-10-17 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-45576. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request

[jira] [Updated] (SPARK-45585) Fix time format and redirection issues in SparkSubmit tests

2023-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45585: --- Labels: pull-request-available (was: ) > Fix time format and redirection issues in

[jira] [Updated] (SPARK-45586) Reduce compilation time for large expression trees

2023-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45586: --- Labels: pull-request-available (was: ) > Reduce compilation time for large expression

[jira] [Updated] (SPARK-45586) Reduce compilation time for large expression trees

2023-10-17 Thread Kelvin Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kelvin Jiang updated SPARK-45586: - Description: Some rules, such as TypeCoercion, are very expensive when the query plan contains

[jira] [Updated] (SPARK-45584) Execution fails when there are subqueries in TakeOrderedAndProjectExec

2023-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45584: --- Labels: pull-request-available (was: ) > Execution fails when there are subqueries in

[jira] [Created] (SPARK-45585) Fix time format and redirection issues in SparkSubmit tests

2023-10-17 Thread Kent Yao (Jira)
Kent Yao created SPARK-45585: Summary: Fix time format and redirection issues in SparkSubmit tests Key: SPARK-45585 URL: https://issues.apache.org/jira/browse/SPARK-45585 Project: Spark Issue

[jira] [Updated] (SPARK-45584) Execution fails when there are subqueries in TakeOrderedAndProjectExec

2023-10-17 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-45584: - Description: When there are subqueries in TakeOrderedAndProjectExec, the query can throw this

[jira] [Created] (SPARK-45584) Execution fails when there are subqueries in TakeOrderedAndProjectExec

2023-10-17 Thread Allison Wang (Jira)
Allison Wang created SPARK-45584: Summary: Execution fails when there are subqueries in TakeOrderedAndProjectExec Key: SPARK-45584 URL: https://issues.apache.org/jira/browse/SPARK-45584 Project:

[jira] [Updated] (SPARK-45583) Spark SQL returning incorrect values for full outer join on keys with the same name.

2023-10-17 Thread Huw (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huw updated SPARK-45583: Description: {{The following query gives the wrong results.}}   {{WITH people as (}} {{  SELECT * FROM (VALUES 

[jira] [Created] (SPARK-45583) Spark SQL returning incorrect values for full outer join on keys with the same name.

2023-10-17 Thread Huw (Jira)
Huw created SPARK-45583: --- Summary: Spark SQL returning incorrect values for full outer join on keys with the same name. Key: SPARK-45583 URL: https://issues.apache.org/jira/browse/SPARK-45583 Project: Spark

[jira] [Updated] (SPARK-45583) Spark SQL returning incorrect values for full outer join on keys with the same name.

2023-10-17 Thread Huw (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huw updated SPARK-45583: Description: {{The following query gives the wrong results.}}   {{WITH people as (}} {{  SELECT * FROM (VALUES 

[jira] [Resolved] (SPARK-45546) Do not compile docs for snapshots deploy

2023-10-17 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-45546. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43378

[jira] [Assigned] (SPARK-45546) Do not compile docs for snapshots deploy

2023-10-17 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-45546: Assignee: Yang Jie > Do not compile docs for snapshots deploy >

[jira] [Updated] (SPARK-45546) Make publish-snapshot support package first then deploy

2023-10-17 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45546: - Summary: Make publish-snapshot support package first then deploy (was: Do not compile docs for

[jira] [Updated] (SPARK-45578) Remove InaccessibleObjectException usage by using trySetAccessible

2023-10-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45578: -- Parent: SPARK-43831 Issue Type: Sub-task (was: Improvement) > Remove

[jira] [Resolved] (SPARK-45578) Remove InaccessibleObjectException usage by using trySetAccessible

2023-10-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45578. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43406

[jira] [Assigned] (SPARK-45578) Remove InaccessibleObjectException usage by using trySetAccessible

2023-10-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45578: - Assignee: Dongjoon Hyun > Remove InaccessibleObjectException usage by using

[jira] [Commented] (SPARK-45582) Streaming aggregation in complete mode should not refer to store instance after commit

2023-10-17 Thread Anish Shrigondekar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17776442#comment-17776442 ] Anish Shrigondekar commented on SPARK-45582: [https://github.com/apache/spark/pull/43413]  

[jira] [Updated] (SPARK-45582) Streaming aggregation in complete mode should not refer to store instance after commit

2023-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45582: --- Labels: pull-request-available (was: ) > Streaming aggregation in complete mode should not

[jira] [Created] (SPARK-45582) Streaming aggregation in complete mode should not refer to store instance after commit

2023-10-17 Thread Anish Shrigondekar (Jira)
Anish Shrigondekar created SPARK-45582: -- Summary: Streaming aggregation in complete mode should not refer to store instance after commit Key: SPARK-45582 URL:

[jira] [Updated] (SPARK-42359) Support row skipping when reading CSV files

2023-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-42359: --- Labels: pull-request-available (was: ) > Support row skipping when reading CSV files >

[jira] [Updated] (SPARK-43171) Support dynamic changing unix user in Pod

2023-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-43171: --- Labels: pull-request-available (was: ) > Support dynamic changing unix user in Pod >

[jira] [Updated] (SPARK-45581) Make SQLSTATEs mandatory

2023-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45581: --- Labels: pull-request-available (was: ) > Make SQLSTATEs mandatory >

[jira] [Resolved] (SPARK-45577) Fix UserDefinedPythonTableFunctionAnalyzeRunner to pass folded values from named arguments

2023-10-17 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-45577. --- Fix Version/s: 4.0.0 Assignee: Takuya Ueshin Resolution: Fixed Issue

[jira] [Assigned] (SPARK-45566) Introduce Pandas-like testing utils for Pandas API on Spark

2023-10-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45566: Assignee: Haejoon Lee > Introduce Pandas-like testing utils for Pandas API on Spark >

[jira] [Resolved] (SPARK-45566) Introduce Pandas-like testing utils for Pandas API on Spark

2023-10-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45566. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43398

[jira] [Updated] (SPARK-45561) Convert TINYINT catalyst properly in MySQL Dialect

2023-10-17 Thread Michael Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Zhang updated SPARK-45561: -- Summary: Convert TINYINT catalyst properly in MySQL Dialect (was: Convert TINYINT catalyst

[jira] [Updated] (SPARK-45561) Convert TINYINT catalyst properly in MySQL and MsSQLServer JDBCv2 connector

2023-10-17 Thread Michael Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Zhang updated SPARK-45561: -- Description: MySQL dialect currently incorrectly converts catalyst types `TINYINT` to BYTE.

[jira] [Created] (SPARK-45581) Make SQLSTATEs mandatory

2023-10-17 Thread Serge Rielau (Jira)
Serge Rielau created SPARK-45581: Summary: Make SQLSTATEs mandatory Key: SPARK-45581 URL: https://issues.apache.org/jira/browse/SPARK-45581 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-45580) RewritePredicateSubquery unexpectedly changes the output schema of certain queries

2023-10-17 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17776401#comment-17776401 ] Bruce Robbins commented on SPARK-45580: --- I'll make a PR in the coming days. >

[jira] [Updated] (SPARK-45579) Executor hangs indefinitely due to decommissioner errors

2023-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45579: --- Labels: pull-request-available (was: ) > Executor hangs indefinitely due to decommissioner

[jira] [Updated] (SPARK-45580) RewritePredicateSubquery unexpectedly changes the output schema of certain queries

2023-10-17 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-45580: -- Description: A query can have an incorrect output schema because of a subquery. Assume this

[jira] [Created] (SPARK-45580) RewritePredicateSubquery unexpectedly changes the output schema of certain queries

2023-10-17 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-45580: - Summary: RewritePredicateSubquery unexpectedly changes the output schema of certain queries Key: SPARK-45580 URL: https://issues.apache.org/jira/browse/SPARK-45580

[jira] [Updated] (SPARK-45574) Add :: syntax as a shorthand for casting

2023-10-17 Thread Ivan Mitic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Mitic updated SPARK-45574: --- Labels: release-notes (was: ) > Add :: syntax as a shorthand for casting >

[jira] [Updated] (SPARK-45579) Executor hangs indefinitely due to decommissioner errors

2023-10-17 Thread Frank Yin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frank Yin updated SPARK-45579: -- Description: During Spark executor decommission, the fallback storage uploads can fail due to some

[jira] [Updated] (SPARK-45579) Executor hangs indefinitely due to decommissioner errors

2023-10-17 Thread Frank Yin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frank Yin updated SPARK-45579: -- Description: During Spark executor decommission, the fallback storage uploads can fail due to some

[jira] [Updated] (SPARK-45579) Executor hangs indefinitely due to decommissioner errors

2023-10-17 Thread Frank Yin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frank Yin updated SPARK-45579: -- Description: During Spark executor decommission, the fallback storage uploads can fail due to some

[jira] [Updated] (SPARK-45579) Executor hangs indefinitely due to decommissioner errors

2023-10-17 Thread Frank Yin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frank Yin updated SPARK-45579: -- Description: During Spark executor decommission, the fallback storage uploads can fail due to some

[jira] [Updated] (SPARK-45579) Executor hangs indefinitely due to decommissioner errors

2023-10-17 Thread Frank Yin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frank Yin updated SPARK-45579: -- Description: During Spark executor decommission, the fallback storage uploads can fail due to some

[jira] [Updated] (SPARK-45579) Executor hangs indefinitely due to decommissioner errors

2023-10-17 Thread Frank Yin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frank Yin updated SPARK-45579: -- Description: During Spark executor decommission, the fallback storage uploads can fail due to some

[jira] [Created] (SPARK-45579) Executor hangs indefinitely due to decommissioner errors

2023-10-17 Thread Frank Yin (Jira)
Frank Yin created SPARK-45579: - Summary: Executor hangs indefinitely due to decommissioner errors Key: SPARK-45579 URL: https://issues.apache.org/jira/browse/SPARK-45579 Project: Spark Issue

[jira] [Updated] (SPARK-45577) Fix UserDefinedPythonTableFunctionAnalyzeRunner to pass folded values from named arguments

2023-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45577: --- Labels: pull-request-available (was: ) > Fix UserDefinedPythonTableFunctionAnalyzeRunner

[jira] [Updated] (SPARK-45578) Remove InaccessibleObjectException usage by using trySetAccessible

2023-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45578: --- Labels: pull-request-available (was: ) > Remove InaccessibleObjectException usage by using

[jira] [Updated] (SPARK-45578) Remove InaccessibleObjectException usage by using trySetAccessible

2023-10-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45578: -- Summary: Remove InaccessibleObjectException usage by using trySetAccessible (was: Remove

[jira] [Created] (SPARK-45578) Remove InaccessibleObjectException usage

2023-10-17 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-45578: - Summary: Remove InaccessibleObjectException usage Key: SPARK-45578 URL: https://issues.apache.org/jira/browse/SPARK-45578 Project: Spark Issue Type:

[jira] [Created] (SPARK-45577) Fix UserDefinedPythonTableFunctionAnalyzeRunner to pass folded values from named arguments

2023-10-17 Thread Takuya Ueshin (Jira)
Takuya Ueshin created SPARK-45577: - Summary: Fix UserDefinedPythonTableFunctionAnalyzeRunner to pass folded values from named arguments Key: SPARK-45577 URL: https://issues.apache.org/jira/browse/SPARK-45577

[jira] [Updated] (SPARK-38723) Test the error class: CONCURRENT_QUERY

2023-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-38723: --- Labels: pull-request-available starter (was: starter) > Test the error class:

[jira] [Updated] (SPARK-45576) [CORE] Remove unnecessary debug logs in ReloadingX509TrustManagerSuite

2023-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45576: --- Labels: pull-request-available (was: ) > [CORE] Remove unnecessary debug logs in

[jira] [Created] (SPARK-45576) [CORE] Remove unnecessary debug logs in ReloadingX509TrustManagerSuite

2023-10-17 Thread Hasnain Lakhani (Jira)
Hasnain Lakhani created SPARK-45576: --- Summary: [CORE] Remove unnecessary debug logs in ReloadingX509TrustManagerSuite Key: SPARK-45576 URL: https://issues.apache.org/jira/browse/SPARK-45576

[jira] [Updated] (SPARK-45575) support time travel options for df read API

2023-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45575: --- Labels: pull-request-available (was: ) > support time travel options for df read API >

[jira] [Created] (SPARK-45575) support time travel options for df read API

2023-10-17 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-45575: --- Summary: support time travel options for df read API Key: SPARK-45575 URL: https://issues.apache.org/jira/browse/SPARK-45575 Project: Spark Issue Type: New

[jira] [Updated] (SPARK-45564) Simplify 'DataFrameStatFunctions.bloomFilter' function with 'BloomFilterAggregate' expression

2023-10-17 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-45564: - Priority: Minor (was: Major) > Simplify 'DataFrameStatFunctions.bloomFilter' function with >

[jira] [Resolved] (SPARK-45564) Simplify 'DataFrameStatFunctions.bloomFilter' function with 'BloomFilterAggregate' expression

2023-10-17 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-45564. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43391

[jira] [Assigned] (SPARK-45564) Simplify 'DataFrameStatFunctions.bloomFilter' function with 'BloomFilterAggregate' expression

2023-10-17 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-45564: Assignee: Ruifeng Zheng > Simplify 'DataFrameStatFunctions.bloomFilter' function with >

[jira] [Resolved] (SPARK-45568) WholeStageCodegenSparkSubmitSuite flakiness

2023-10-17 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-45568. -- Fix Version/s: 3.4.2 4.0.0 3.5.1 3.3.4

[jira] [Assigned] (SPARK-45568) WholeStageCodegenSparkSubmitSuite flakiness

2023-10-17 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-45568: Assignee: Kent Yao > WholeStageCodegenSparkSubmitSuite flakiness >

[jira] [Updated] (SPARK-45574) Add :: syntax as a shorthand for casting

2023-10-17 Thread Ivan Mitic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Mitic updated SPARK-45574: --- Shepherd: (was: Ivan Mitic) > Add :: syntax as a shorthand for casting >

[jira] [Updated] (SPARK-45574) Add :: syntax as a shorthand for casting

2023-10-17 Thread Ivan Mitic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Mitic updated SPARK-45574: --- Shepherd: Ivan Mitic > Add :: syntax as a shorthand for casting >

[jira] [Created] (SPARK-45574) Add :: syntax as a shorthand for casting

2023-10-17 Thread Ivan Mitic (Jira)
Ivan Mitic created SPARK-45574: -- Summary: Add :: syntax as a shorthand for casting Key: SPARK-45574 URL: https://issues.apache.org/jira/browse/SPARK-45574 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-45573) Assign name to _LEGACY_ERROR_TEMP_2153

2023-10-17 Thread Deng Ziming (Jira)
Deng Ziming created SPARK-45573: --- Summary: Assign name to _LEGACY_ERROR_TEMP_2153 Key: SPARK-45573 URL: https://issues.apache.org/jira/browse/SPARK-45573 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-45512) Fix compilation warnings related to other-nullary-override

2023-10-17 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-45512. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43332

[jira] [Updated] (SPARK-45512) Fix compilation warnings related to other-nullary-override

2023-10-17 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-45512: - Priority: Minor (was: Major) > Fix compilation warnings related to other-nullary-override >

[jira] [Assigned] (SPARK-45512) Fix compilation warnings related to other-nullary-override

2023-10-17 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-45512: Assignee: Yang Jie > Fix compilation warnings related to other-nullary-override >

[jira] [Updated] (SPARK-44667) Uninstall large ML libraries for non-ML jobs

2023-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44667: --- Labels: pull-request-available (was: ) > Uninstall large ML libraries for non-ML jobs >

[jira] [Updated] (SPARK-45571) Spark connect executor ignore jars in classpath

2023-10-17 Thread Liran Y (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liran Y updated SPARK-45571: Description: I am starting a spark connect server in k8s. While trying to access S3 I'm getting the

[jira] [Assigned] (SPARK-45572) Enable doctest of Frame.transpose

2023-10-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45572: Assignee: Ruifeng Zheng > Enable doctest of Frame.transpose >

[jira] [Resolved] (SPARK-45572) Enable doctest of Frame.transpose

2023-10-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45572. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43399

[jira] [Updated] (SPARK-45572) Enable doctest of Frame.transpose

2023-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45572: --- Labels: pull-request-available (was: ) > Enable doctest of Frame.transpose >

[jira] [Updated] (SPARK-45572) Enable doctest of Frame.transpose

2023-10-17 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-45572: -- Summary: Enable doctest of Frame.transpose (was: Enable doctest for Frame.transpose) >

[jira] [Resolved] (SPARK-45550) Remove deprecated APIs from Pandas API on Spark

2023-10-17 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-45550. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43384

[jira] [Created] (SPARK-45572) Enable doctest for Frame.transpose

2023-10-17 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-45572: - Summary: Enable doctest for Frame.transpose Key: SPARK-45572 URL: https://issues.apache.org/jira/browse/SPARK-45572 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-45550) Remove deprecated APIs from Pandas API on Spark

2023-10-17 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-45550: - Assignee: Haejoon Lee > Remove deprecated APIs from Pandas API on Spark >

[jira] [Resolved] (SPARK-45562) XML: Make 'rowTag' a required option

2023-10-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45562. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43389

[jira] [Assigned] (SPARK-45562) XML: Make 'rowTag' a required option

2023-10-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45562: Assignee: Sandip Agarwala > XML: Make 'rowTag' a required option >

[jira] [Created] (SPARK-45571) Spark connect executor ignore jars in classpath

2023-10-17 Thread Liran Y (Jira)
Liran Y created SPARK-45571: --- Summary: Spark connect executor ignore jars in classpath Key: SPARK-45571 URL: https://issues.apache.org/jira/browse/SPARK-45571 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-45567) Remove redundant if in org.apache.spark.sql.connect.execution.ExecuteGrpcResponseSender#run

2023-10-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45567: Assignee: Min Zhao > Remove redundant if in >

[jira] [Resolved] (SPARK-45567) Remove redundant if in org.apache.spark.sql.connect.execution.ExecuteGrpcResponseSender#run

2023-10-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45567. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43395

[jira] [Updated] (SPARK-45570) Spark job hangs due to task launch thread failed to create

2023-10-17 Thread lifulong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lifulong updated SPARK-45570: - Description: spark job hangs while web ui show there is one task in running stage keep running for

[jira] [Assigned] (SPARK-45565) Unnecessary JSON.stringify and JSON.parse loop for task list

2023-10-17 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-45565: Assignee: Kent Yao > Unnecessary JSON.stringify and JSON.parse loop for task list >

[jira] [Resolved] (SPARK-45565) Unnecessary JSON.stringify and JSON.parse loop for task list

2023-10-17 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-45565. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43392

[jira] [Updated] (SPARK-45478) codegen sum(decimal_column / 2) computes div twice

2023-10-17 Thread Zhizhen Hou (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhizhen Hou updated SPARK-45478: Description: After eliminates all common subexpression of `If`, it reduces computation time from

[jira] [Updated] (SPARK-45478) codegen sum(decimal_column / 2) computes div twice

2023-10-17 Thread Zhizhen Hou (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhizhen Hou updated SPARK-45478: Description: After eliminates all common subexpression of `If`, it reduces computation time from

[jira] [Updated] (SPARK-45566) Introduce Pandas-like testing utils for Pandas API on Spark

2023-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45566: --- Labels: pull-request-available (was: ) > Introduce Pandas-like testing utils for Pandas

[jira] [Assigned] (SPARK-45546) Do not compile docs for snapshots deploy

2023-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45546: -- Assignee: (was: Apache Spark) > Do not compile docs for snapshots deploy >

[jira] [Assigned] (SPARK-45546) Do not compile docs for snapshots deploy

2023-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45546: -- Assignee: Apache Spark > Do not compile docs for snapshots deploy >

[jira] [Assigned] (SPARK-45569) Assign name to _LEGACY_ERROR_TEMP_2152

2023-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45569: -- Assignee: Apache Spark (was: Deng Ziming) > Assign name to _LEGACY_ERROR_TEMP_2152

[jira] [Assigned] (SPARK-45569) Assign name to _LEGACY_ERROR_TEMP_2152

2023-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45569: -- Assignee: Deng Ziming (was: Apache Spark) > Assign name to _LEGACY_ERROR_TEMP_2152

[jira] [Assigned] (SPARK-45546) Do not compile docs for snapshots deploy

2023-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45546: -- Assignee: (was: Apache Spark) > Do not compile docs for snapshots deploy >

[jira] [Assigned] (SPARK-45569) Assign name to _LEGACY_ERROR_TEMP_2152

2023-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45569: -- Assignee: Deng Ziming (was: Apache Spark) > Assign name to _LEGACY_ERROR_TEMP_2152

[jira] [Assigned] (SPARK-45546) Do not compile docs for snapshots deploy

2023-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45546: -- Assignee: Apache Spark > Do not compile docs for snapshots deploy >

[jira] [Assigned] (SPARK-45569) Assign name to _LEGACY_ERROR_TEMP_2152

2023-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45569: -- Assignee: Apache Spark (was: Deng Ziming) > Assign name to _LEGACY_ERROR_TEMP_2152

[jira] [Assigned] (SPARK-45546) Do not compile docs for snapshots deploy

2023-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45546: -- Assignee: (was: Apache Spark) > Do not compile docs for snapshots deploy >

[jira] [Assigned] (SPARK-45524) Initial support for Python data source read API

2023-10-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-45524: -- Assignee: (was: Apache Spark) > Initial support for Python data source read API

  1   2   >