[jira] [Resolved] (SPARK-43926) Add array_agg, array_size, cardinality, count_min_sketch,mask,named_struct,json_* to Scala and Python

2023-06-29 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-43926. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41718

[jira] [Assigned] (SPARK-43926) Add array_agg, array_size, cardinality, count_min_sketch,mask,named_struct,json_* to Scala and Python

2023-06-29 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-43926: - Assignee: Tengfei Huang > Add array_agg, array_size, cardinality, >

[jira] [Updated] (SPARK-44259) Make `connect-jvm-client` module pass except arrow-related ones in Java 21

2023-06-29 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-44259: - Summary: Make `connect-jvm-client` module pass except arrow-related ones in Java 21 (was: Ignore all

[jira] [Commented] (SPARK-44223) Drop leveldb support

2023-06-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17738867#comment-17738867 ] Dongjoon Hyun commented on SPARK-44223: --- +1 > Drop leveldb support > > >

[jira] [Commented] (SPARK-44124) Upgrade AWS SDK to v2

2023-06-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17738866#comment-17738866 ] Dongjoon Hyun commented on SPARK-44124: --- Hi, [~cltlfcjin]. We want to align with Apache Hadoop. >

[jira] [Commented] (SPARK-44124) Upgrade AWS SDK to v2

2023-06-29 Thread Lantao Jin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17738865#comment-17738865 ] Lantao Jin commented on SPARK-44124: Hi [~dongjoon], this is Lantao from AWS, we are working on

[jira] [Commented] (SPARK-44259) Ignore all Arrow-based connect tests for Java 21

2023-06-29 Thread Snoot.io (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17738864#comment-17738864 ] Snoot.io commented on SPARK-44259: -- User 'LuciferYang' has created a pull request for this issue:

[jira] [Created] (SPARK-44260) Assign names to the error class _LEGACY_ERROR_TEMP_[1215-1245-2329] & Use checkError() to check Exception in *CharVarchar*Suite

2023-06-29 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-44260: --- Summary: Assign names to the error class _LEGACY_ERROR_TEMP_[1215-1245-2329] & Use checkError() to check Exception in *CharVarchar*Suite Key: SPARK-44260 URL:

[jira] [Created] (SPARK-44259) Ignore all Arrow-based connect tests for Java 21

2023-06-29 Thread Yang Jie (Jira)
Yang Jie created SPARK-44259: Summary: Ignore all Arrow-based connect tests for Java 21 Key: SPARK-44259 URL: https://issues.apache.org/jira/browse/SPARK-44259 Project: Spark Issue Type:

[jira] [Updated] (SPARK-43974) Upgrade buf to v1.23.0

2023-06-29 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-43974: Summary: Upgrade buf to v1.23.0 (was: Upgrade buf to v1.22.0) > Upgrade buf to v1.23.0 >

[jira] [Resolved] (SPARK-44090) Add a Java 21 build task in `build_and_test.yml`

2023-06-29 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-44090. -- Resolution: Duplicate > Add a Java 21 build task in `build_and_test.yml` >

[jira] [Created] (SPARK-44258) Move Metadata to sql/api

2023-06-29 Thread Rui Wang (Jira)
Rui Wang created SPARK-44258: Summary: Move Metadata to sql/api Key: SPARK-44258 URL: https://issues.apache.org/jira/browse/SPARK-44258 Project: Spark Issue Type: Sub-task Components:

[jira] [Commented] (SPARK-44257) Update some maven plugins & scalafmt to newest version

2023-06-29 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17738838#comment-17738838 ] BingKun Pan commented on SPARK-44257: - I work on it > Update some maven plugins & scalafmt to

[jira] [Created] (SPARK-44257) Update some maven plugins & scalafmt to newest version

2023-06-29 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-44257: --- Summary: Update some maven plugins & scalafmt to newest version Key: SPARK-44257 URL: https://issues.apache.org/jira/browse/SPARK-44257 Project: Spark Issue

[jira] [Created] (SPARK-44256) Upgrade rocksdbjni to 8.3.2

2023-06-29 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-44256: --- Summary: Upgrade rocksdbjni to 8.3.2 Key: SPARK-44256 URL: https://issues.apache.org/jira/browse/SPARK-44256 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-44150) Explicit Arrow casting for mismatched return type in Arrow Python UDF

2023-06-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44150: -- Fix Version/s: (was: 3.5.0) > Explicit Arrow casting for mismatched return type in Arrow

[jira] [Reopened] (SPARK-44150) Explicit Arrow casting for mismatched return type in Arrow Python UDF

2023-06-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-44150: --- Assignee: (was: Xinrong Meng) > Explicit Arrow casting for mismatched return type in

[jira] [Commented] (SPARK-44252) Add error class for the case when loading state from DFS fails

2023-06-29 Thread Lucy Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17738807#comment-17738807 ] Lucy Yao commented on SPARK-44252: -- I'm working on this > Add error class for the case when loading

[jira] [Resolved] (SPARK-44248) Kafka Source v2 should return preferred locations

2023-06-29 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-44248. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41790

[jira] [Assigned] (SPARK-44248) Kafka Source v2 should return preferred locations

2023-06-29 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-44248: Assignee: Siying Dong > Kafka Source v2 should return preferred locations >

[jira] [Created] (SPARK-44255) Relocate StorageLevel to common/utils

2023-06-29 Thread Rui Wang (Jira)
Rui Wang created SPARK-44255: Summary: Relocate StorageLevel to common/utils Key: SPARK-44255 URL: https://issues.apache.org/jira/browse/SPARK-44255 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-44255) Relocate StorageLevel to common/utils

2023-06-29 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated SPARK-44255: - Issue Type: Task (was: Bug) > Relocate StorageLevel to common/utils >

[jira] [Updated] (SPARK-44253) Potential memory leak when temp views created from DF created by structured streaming

2023-06-29 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-44253: --- Description: If the user registers a temporary view from a dataframe created by

[jira] [Updated] (SPARK-44253) Potential memory leak when temp views created from DF created by structured streaming

2023-06-29 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-44253: --- Description: If the user registers a temporary view from a dataframe created by

[jira] [Created] (SPARK-44254) Move QueryExecutionErrors to sql/api

2023-06-29 Thread Rui Wang (Jira)
Rui Wang created SPARK-44254: Summary: Move QueryExecutionErrors to sql/api Key: SPARK-44254 URL: https://issues.apache.org/jira/browse/SPARK-44254 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-44253) Potential memory leak when temp views created from DF created by structured streaming

2023-06-29 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-44253: --- Attachment: 2.png > Potential memory leak when temp views created from DF created

[jira] [Updated] (SPARK-44253) Potential memory leak when temp views created from DF created by structured streaming

2023-06-29 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-44253: --- Description: If the user registers a temporary view from a dataframe created by

[jira] [Created] (SPARK-44253) Potential memory leak when temp views created from DF created by structured streaming

2023-06-29 Thread Attila Zsolt Piros (Jira)
Attila Zsolt Piros created SPARK-44253: -- Summary: Potential memory leak when temp views created from DF created by structured streaming Key: SPARK-44253 URL: https://issues.apache.org/jira/browse/SPARK-44253

[jira] [Updated] (SPARK-44253) Potential memory leak when temp views created from DF created by structured streaming

2023-06-29 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-44253: --- Attachment: 1.png > Potential memory leak when temp views created from DF created

[jira] [Updated] (SPARK-44252) Add error class for the case when loading state from DFS fails

2023-06-29 Thread Lucy Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lucy Yao updated SPARK-44252: - Description: This is part of

[jira] [Created] (SPARK-44252) Add error class for the case when loading state from DFS fails

2023-06-29 Thread Lucy Yao (Jira)
Lucy Yao created SPARK-44252: Summary: Add error class for the case when loading state from DFS fails Key: SPARK-44252 URL: https://issues.apache.org/jira/browse/SPARK-44252 Project: Spark

[jira] [Commented] (SPARK-44251) Potential for incorrect results or NPE when full outer USING join has null key value

2023-06-29 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17738762#comment-17738762 ] Bruce Robbins commented on SPARK-44251: --- This is similar to, but not quite the same as

[jira] [Updated] (SPARK-44251) Potential for incorrect results or NPE when full outer USING join has null key value

2023-06-29 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-44251: -- Summary: Potential for incorrect results or NPE when full outer USING join has null key value

[jira] [Created] (SPARK-44251) Potentially incorrect results or NPE when full outer USING join has null key value

2023-06-29 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-44251: - Summary: Potentially incorrect results or NPE when full outer USING join has null key value Key: SPARK-44251 URL: https://issues.apache.org/jira/browse/SPARK-44251

[jira] [Created] (SPARK-44250) Implement classification evaluator

2023-06-29 Thread Weichen Xu (Jira)
Weichen Xu created SPARK-44250: -- Summary: Implement classification evaluator Key: SPARK-44250 URL: https://issues.apache.org/jira/browse/SPARK-44250 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-44250) Implement classification evaluator

2023-06-29 Thread Weichen Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu reassigned SPARK-44250: -- Assignee: Weichen Xu > Implement classification evaluator >

[jira] [Created] (SPARK-44249) Refactor PythonUDTFRunner to send its return type separately

2023-06-29 Thread Takuya Ueshin (Jira)
Takuya Ueshin created SPARK-44249: - Summary: Refactor PythonUDTFRunner to send its return type separately Key: SPARK-44249 URL: https://issues.apache.org/jira/browse/SPARK-44249 Project: Spark

[jira] [Assigned] (SPARK-44150) Explicit Arrow casting for mismatched return type in Arrow Python UDF

2023-06-29 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng reassigned SPARK-44150: Assignee: Xinrong Meng > Explicit Arrow casting for mismatched return type in Arrow

[jira] [Resolved] (SPARK-44150) Explicit Arrow casting for mismatched return type in Arrow Python UDF

2023-06-29 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-44150. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41503

[jira] [Created] (SPARK-44248) Kafka Source v2 should return preferred locations

2023-06-29 Thread Siying Dong (Jira)
Siying Dong created SPARK-44248: --- Summary: Kafka Source v2 should return preferred locations Key: SPARK-44248 URL: https://issues.apache.org/jira/browse/SPARK-44248 Project: Spark Issue Type:

[jira] [Comment Edited] (SPARK-40176) Enhance collapse window optimization to work in case partition or order by keys are expressions

2023-06-29 Thread Ayushi Agarwal (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17738718#comment-17738718 ] Ayushi Agarwal edited comment on SPARK-40176 at 6/29/23 6:10 PM: - This

[jira] [Commented] (SPARK-40176) Enhance collapse window optimization to work in case partition or order by keys are expressions

2023-06-29 Thread Ayushi Agarwal (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17738718#comment-17738718 ] Ayushi Agarwal commented on SPARK-40176: This solves this issue partially

[jira] [Updated] (SPARK-44247) Upgrade Arrow to 13.0.0

2023-06-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44247: -- Description: According to Apache Arrow release history, 13.0.0 is expected to be released on

[jira] [Updated] (SPARK-44247) Upgrade Arrow to 13.0.0

2023-06-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44247: -- Description: According to Apache Arrow release history, 13.0.0 is expected to be released on

[jira] [Updated] (SPARK-44247) Upgrade Arrow to 13.0.0

2023-06-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44247: -- Description: According to Apache Arrow release history, 13.0.0 is expected to be released on

[jira] [Created] (SPARK-44247) Upgrade Arrow to 13.0.0

2023-06-29 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-44247: - Summary: Upgrade Arrow to 13.0.0 Key: SPARK-44247 URL: https://issues.apache.org/jira/browse/SPARK-44247 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-44199) CacheManager refreshes the fileIndex unnecessarily

2023-06-29 Thread Ignite TC Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17738673#comment-17738673 ] Ignite TC Bot commented on SPARK-44199: --- User 'vihangk1' has created a pull request for this

[jira] [Commented] (SPARK-44165) Exception when reading parquet file with TIME fields

2023-06-29 Thread Ignite TC Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17738669#comment-17738669 ] Ignite TC Bot commented on SPARK-44165: --- User 'ramon-garcia' has created a pull request for this

[jira] [Commented] (SPARK-44131) Add call_function and deprecate call_udf for Scala API

2023-06-29 Thread Ignite TC Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17738672#comment-17738672 ] Ignite TC Bot commented on SPARK-44131: --- User 'beliefer' has created a pull request for this

[jira] [Commented] (SPARK-44200) Support TABLE argument parser rule for TableValuedFunction

2023-06-29 Thread Ignite TC Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17738671#comment-17738671 ] Ignite TC Bot commented on SPARK-44200: --- User 'ueshin' has created a pull request for this issue:

[jira] [Commented] (SPARK-44195) Add JobTag APIs to SparkR SparkContext

2023-06-29 Thread Ignite TC Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17738668#comment-17738668 ] Ignite TC Bot commented on SPARK-44195: --- User 'juliuszsompolski' has created a pull request for

[jira] [Commented] (SPARK-35564) Support subexpression elimination for non-common branches of conditional expressions

2023-06-29 Thread Ignite TC Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17738670#comment-17738670 ] Ignite TC Bot commented on SPARK-35564: --- User 'peter-toth' has created a pull request for this

[jira] [Assigned] (SPARK-43474) Add support to create DataFrame Reference in Spark connect

2023-06-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-43474: Assignee: Raghu Angadi > Add support to create DataFrame Reference in Spark connect >

[jira] [Resolved] (SPARK-43474) Add support to create DataFrame Reference in Spark connect

2023-06-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-43474. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41580

[jira] [Updated] (SPARK-44240) Setting the topKSortFallbackThreshold value may lead to inaccurate results

2023-06-29 Thread dzcxzl (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dzcxzl updated SPARK-44240: --- Description:   {code:java} set spark.sql.execution.topKSortFallbackThreshold=1; SELECT min(id) FROM (

[jira] [Updated] (SPARK-44240) Setting the topKSortFallbackThreshold value may lead to inaccurate results

2023-06-29 Thread dzcxzl (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dzcxzl updated SPARK-44240: --- Description:   {code:java} set spark.sql.execution.topKSortFallbackThreshold=1; SELECT min(id) FROM (

[jira] [Updated] (SPARK-44240) Setting the topKSortFallbackThreshold value may lead to inaccurate results

2023-06-29 Thread dzcxzl (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dzcxzl updated SPARK-44240: --- Description:   {code:java} set spark.sql.execution.topKSortFallbackThreshold=1; SELECT min(id) FROM (

[jira] [Updated] (SPARK-44240) Setting the topKSortFallbackThreshold value may lead to inaccurate results

2023-06-29 Thread dzcxzl (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dzcxzl updated SPARK-44240: --- Attachment: topKSortFallbackThresholdDesc.png > Setting the topKSortFallbackThreshold value may lead to

[jira] [Resolved] (SPARK-44227) Extract SchemaUtils from StructField

2023-06-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-44227. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41772

[jira] [Resolved] (SPARK-44208) assign clear error class names for some logic that directly uses exceptions

2023-06-29 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-44208. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41740

[jira] [Assigned] (SPARK-44208) assign clear error class names for some logic that directly uses exceptions

2023-06-29 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-44208: Assignee: BingKun Pan > assign clear error class names for some logic that directly uses

[jira] [Created] (SPARK-44246) Follow-ups for Jar/Classfile Isolation

2023-06-29 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-44246: Summary: Follow-ups for Jar/Classfile Isolation Key: SPARK-44246 URL: https://issues.apache.org/jira/browse/SPARK-44246 Project: Spark

[jira] [Updated] (SPARK-44146) Isolate Spark Connect session/artifacts

2023-06-29 Thread Venkata Sai Akhil Gudesa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venkata Sai Akhil Gudesa updated SPARK-44146: - Epic Link: SPARK-42554 > Isolate Spark Connect session/artifacts >

[jira] [Updated] (SPARK-44208) assign clear error class names for some logic that directly uses exceptions

2023-06-29 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-44208: Description: include: * ALL_PARTITION_COLUMNS_NOT_ALLOWED * INVALID_HIVE_COLUMN_NAME *

[jira] [Updated] (SPARK-44079) Json reader crashes when a different schema is present

2023-06-29 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-44079: - Fix Version/s: 3.4.2 > Json reader crashes when a different schema is present >

[jira] [Created] (SPARK-44245) pyspark.sql.dataframe doctests can behave differently

2023-06-29 Thread Alice Sayutina (Jira)
Alice Sayutina created SPARK-44245: -- Summary: pyspark.sql.dataframe doctests can behave differently Key: SPARK-44245 URL: https://issues.apache.org/jira/browse/SPARK-44245 Project: Spark

[jira] [Created] (SPARK-44244) Assign names to the error class _LEGACY_ERROR_TEMP_[2305-2309]

2023-06-29 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-44244: -- Summary: Assign names to the error class _LEGACY_ERROR_TEMP_[2305-2309] Key: SPARK-44244 URL: https://issues.apache.org/jira/browse/SPARK-44244 Project: Spark

[jira] [Assigned] (SPARK-44169) Assign names to the error class _LEGACY_ERROR_TEMP_[2300-2304]

2023-06-29 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-44169: Assignee: jiaan.geng > Assign names to the error class _LEGACY_ERROR_TEMP_[2300-2304] >

[jira] [Resolved] (SPARK-44169) Assign names to the error class _LEGACY_ERROR_TEMP_[2300-2304]

2023-06-29 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-44169. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41719

[jira] [Commented] (SPARK-44241) Set io.connectionTimeout/connectionCreationTimeout to zero or negative will cause executor incessantes cons/destructions

2023-06-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17738451#comment-17738451 ] ASF GitHub Bot commented on SPARK-44241: User 'yaooqinn' has created a pull request for this

[jira] [Updated] (SPARK-44243) Add a parameter to determine the locality of local shuffle reader

2023-06-29 Thread Wan Kun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wan Kun updated SPARK-44243: Summary: Add a parameter to determine the locality of local shuffle reader (was: Local shuffle reader

[jira] [Created] (SPARK-44243) Local shuffle reader should not respect SHUFFLE_REDUCE_LOCALITY_ENABLE

2023-06-29 Thread Wan Kun (Jira)
Wan Kun created SPARK-44243: --- Summary: Local shuffle reader should not respect SHUFFLE_REDUCE_LOCALITY_ENABLE Key: SPARK-44243 URL: https://issues.apache.org/jira/browse/SPARK-44243 Project: Spark

[jira] [Created] (SPARK-44242) Spark job submission failed because Xmx string is available on one parameter provided into spark.driver.extraJavaOptions

2023-06-29 Thread Nicolas Fraison (Jira)
Nicolas Fraison created SPARK-44242: --- Summary: Spark job submission failed because Xmx string is available on one parameter provided into spark.driver.extraJavaOptions Key: SPARK-44242 URL:

[jira] [Resolved] (SPARK-44235) Add --batch to gpg command

2023-06-29 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-44235. - Fix Version/s: 3.5.0 Resolution: Fixed https://github.com/apache/spark-docker/pull/51 >

[jira] [Created] (SPARK-44241) Set io.connectionTimeout/connectionCreationTimeout to zero or negative will cause executor incessantes cons/destructions

2023-06-29 Thread Kent Yao (Jira)
Kent Yao created SPARK-44241: Summary: Set io.connectionTimeout/connectionCreationTimeout to zero or negative will cause executor incessantes cons/destructions Key: SPARK-44241 URL:

[jira] [Updated] (SPARK-44079) Json reader crashes when a different schema is present

2023-06-29 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-44079: - Component/s: SQL (was: python) > Json reader crashes when a different schema is

[jira] [Resolved] (SPARK-44079) Json reader crashes when a different schema is present

2023-06-29 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-44079. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41662

[jira] [Assigned] (SPARK-44079) Json reader crashes when a different schema is present

2023-06-29 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-44079: Assignee: Jia Fan > Json reader crashes when a different schema is present >