[jira] [Assigned] (SPARK-42418) Updating PySpark documentation to support new users better

[ https://issues.apache.org/jira/browse/SPARK-42418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42418: Assignee: Apache Spark > Updating PySpark documentation to support new users better >

[jira] [Assigned] (SPARK-42418) Updating PySpark documentation to support new users better

[ https://issues.apache.org/jira/browse/SPARK-42418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42418: Assignee: (was: Apache Spark) > Updating PySpark documentation to support new users

[jira] [Commented] (SPARK-42418) Updating PySpark documentation to support new users better

[ https://issues.apache.org/jira/browse/SPARK-42418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687775#comment-17687775 ] Apache Spark commented on SPARK-42418: -- User 'allanf-db' has created a pull request for this issue:

[jira] [Commented] (SPARK-42193) dataframe API filter criteria throwing ParseException when reading a JDBC column name with special characters

[ https://issues.apache.org/jira/browse/SPARK-42193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687770#comment-17687770 ] Dongjoon Hyun commented on SPARK-42193: --- +1 for [~maxgekk]'s assessment. > dataframe API filter

[jira] [Updated] (SPARK-42193) dataframe API filter criteria throwing ParseException when reading a JDBC column name with special characters

[ https://issues.apache.org/jira/browse/SPARK-42193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-42193: - Component/s: SQL (was: Spark Core) > dataframe API filter criteria

[jira] [Resolved] (SPARK-42193) dataframe API filter criteria throwing ParseException when reading a JDBC column name with special characters

[ https://issues.apache.org/jira/browse/SPARK-42193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42193. -- Resolution: Cannot Reproduce > dataframe API filter criteria throwing ParseException when

[jira] [Commented] (SPARK-42227) Use approx_percentile function running slower in spark3 than spark2

[ https://issues.apache.org/jira/browse/SPARK-42227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687765#comment-17687765 ] Hyukjin Kwon commented on SPARK-42227: -- How much fast is it? > Use approx_percentile function

[jira] [Commented] (SPARK-42293) why executor memory used is shown greater than total available memory on spark ui

[ https://issues.apache.org/jira/browse/SPARK-42293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687763#comment-17687763 ] Hyukjin Kwon commented on SPARK-42293: -- [~handong] mind sharing a reproducer if you have? > why

[jira] [Commented] (SPARK-42419) Migrate `TypeError` into error framework for Spark Connect column API.

[ https://issues.apache.org/jira/browse/SPARK-42419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687764#comment-17687764 ] Apache Spark commented on SPARK-42419: -- User 'itholic' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42419) Migrate `TypeError` into error framework for Spark Connect column API.

[ https://issues.apache.org/jira/browse/SPARK-42419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42419: Assignee: Apache Spark > Migrate `TypeError` into error framework for Spark Connect

[jira] [Commented] (SPARK-42419) Migrate `TypeError` into error framework for Spark Connect column API.

[ https://issues.apache.org/jira/browse/SPARK-42419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687762#comment-17687762 ] Apache Spark commented on SPARK-42419: -- User 'itholic' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42419) Migrate `TypeError` into error framework for Spark Connect column API.

[ https://issues.apache.org/jira/browse/SPARK-42419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42419: Assignee: (was: Apache Spark) > Migrate `TypeError` into error framework for Spark

[jira] [Commented] (SPARK-42387) Avoid unnecessary parquet footer reads when no filters

[ https://issues.apache.org/jira/browse/SPARK-42387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687760#comment-17687760 ] Hyukjin Kwon commented on SPARK-42387: -- [~miracle] mind filling JIRA description please > Avoid

[jira] [Commented] (SPARK-42397) Inconsistent data produced by `FlatMapCoGroupsInPandas`

[ https://issues.apache.org/jira/browse/SPARK-42397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687759#comment-17687759 ] Hyukjin Kwon commented on SPARK-42397: -- It's probably related the order which Spark doesn't

[jira] [Updated] (SPARK-42399) CONV() silently overflows returning wrong results

[ https://issues.apache.org/jira/browse/SPARK-42399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-42399: - Component/s: SQL (was: Spark Core) > CONV() silently overflows returning

[jira] [Assigned] (SPARK-42401) Incorrect results or NPE when inserting null value into array using array_insert/array_append

[ https://issues.apache.org/jira/browse/SPARK-42401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42401: Assignee: Bruce Robbins > Incorrect results or NPE when inserting null value into array

[jira] [Resolved] (SPARK-42401) Incorrect results or NPE when inserting null value into array using array_insert/array_append

[ https://issues.apache.org/jira/browse/SPARK-42401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42401. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39970

[jira] [Created] (SPARK-42419) Migrate `TypeError` into error framework for Spark Connect column API.

Haejoon Lee created SPARK-42419: --- Summary: Migrate `TypeError` into error framework for Spark Connect column API. Key: SPARK-42419 URL: https://issues.apache.org/jira/browse/SPARK-42419 Project: Spark

[jira] [Commented] (SPARK-42258) pyspark.sql.functions should not expose typing.cast

[ https://issues.apache.org/jira/browse/SPARK-42258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687757#comment-17687757 ] Hyukjin Kwon commented on SPARK-42258: -- Good point. Are you interested in submitting a PR? >

[jira] [Updated] (SPARK-42407) `with as` executed again

[ https://issues.apache.org/jira/browse/SPARK-42407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-42407: - Priority: Major (was: Critical) > `with as` executed again > > >

[jira] [Commented] (SPARK-42193) dataframe API filter criteria throwing ParseException when reading a JDBC column name with special characters

[ https://issues.apache.org/jira/browse/SPARK-42193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687756#comment-17687756 ] Max Gekk commented on SPARK-42193: -- I haven't reproduced the issue on the recent master. Seems like it

[jira] [Assigned] (SPARK-42417) Upgrade `netty` to version 4.1.88.Final

[ https://issues.apache.org/jira/browse/SPARK-42417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42417: Assignee: (was: Apache Spark) > Upgrade `netty` to version 4.1.88.Final >

[jira] [Assigned] (SPARK-42415) The built-in dialects support OFFSET and paging query.

[ https://issues.apache.org/jira/browse/SPARK-42415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42415: Assignee: Apache Spark > The built-in dialects support OFFSET and paging query. >

[jira] [Commented] (SPARK-42415) The built-in dialects support OFFSET and paging query.

[ https://issues.apache.org/jira/browse/SPARK-42415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687753#comment-17687753 ] Apache Spark commented on SPARK-42415: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42415) The built-in dialects support OFFSET and paging query.

[ https://issues.apache.org/jira/browse/SPARK-42415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42415: Assignee: (was: Apache Spark) > The built-in dialects support OFFSET and paging

[jira] [Commented] (SPARK-42417) Upgrade `netty` to version 4.1.88.Final

[ https://issues.apache.org/jira/browse/SPARK-42417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687754#comment-17687754 ] Apache Spark commented on SPARK-42417: -- User 'panbingkun' has created a pull request for this

[jira] [Assigned] (SPARK-42417) Upgrade `netty` to version 4.1.88.Final

[ https://issues.apache.org/jira/browse/SPARK-42417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42417: Assignee: Apache Spark > Upgrade `netty` to version 4.1.88.Final >

[jira] [Created] (SPARK-42418) Updating PySpark documentation to support new users better

Allan Folting created SPARK-42418: - Summary: Updating PySpark documentation to support new users better Key: SPARK-42418 URL: https://issues.apache.org/jira/browse/SPARK-42418 Project: Spark

[jira] [Updated] (SPARK-42416) Dateset operations should not resolve the analyzed logical plan again

[ https://issues.apache.org/jira/browse/SPARK-42416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-42416: --- Summary: Dateset operations should not resolve the analyzed logical plan again (was:

[jira] [Created] (SPARK-42417) Upgrade `netty` to version 4.1.88.Final

BingKun Pan created SPARK-42417: --- Summary: Upgrade `netty` to version 4.1.88.Final Key: SPARK-42417 URL: https://issues.apache.org/jira/browse/SPARK-42417 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-42416) Dateset.show() should not resolve the analyzed logical plan again

[ https://issues.apache.org/jira/browse/SPARK-42416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42416: Assignee: Gengliang Wang (was: Apache Spark) > Dateset.show() should not resolve the

[jira] [Assigned] (SPARK-42416) Dateset.show() should not resolve the analyzed logical plan again

[ https://issues.apache.org/jira/browse/SPARK-42416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42416: Assignee: Apache Spark (was: Gengliang Wang) > Dateset.show() should not resolve the

[jira] [Commented] (SPARK-42416) Dateset.show() should not resolve the analyzed logical plan again

[ https://issues.apache.org/jira/browse/SPARK-42416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687747#comment-17687747 ] Apache Spark commented on SPARK-42416: -- User 'gengliangwang' has created a pull request for this

[jira] [Updated] (SPARK-14922) Alter Table Drop Partition Using Predicate-based Partition Spec

[ https://issues.apache.org/jira/browse/SPARK-14922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-14922: -- Target Version/s: (was: 3.5.0) > Alter Table Drop Partition Using Predicate-based Partition

[jira] [Updated] (SPARK-41053) Better Spark UI scalability and Driver stability for large applications

[ https://issues.apache.org/jira/browse/SPARK-41053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-41053: -- Fix Version/s: 3.4.0 > Better Spark UI scalability and Driver stability for large

[jira] [Commented] (SPARK-41053) Better Spark UI scalability and Driver stability for large applications

[ https://issues.apache.org/jira/browse/SPARK-41053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687745#comment-17687745 ] Dongjoon Hyun commented on SPARK-41053: --- Thank you for leading and completing this,

[jira] [Assigned] (SPARK-41053) Better Spark UI scalability and Driver stability for large applications

[ https://issues.apache.org/jira/browse/SPARK-41053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-41053: - Assignee: Gengliang Wang (was: Apache Spark) > Better Spark UI scalability and Driver

[jira] [Commented] (SPARK-34645) [K8S] Driver pod stuck in Running state after job completes

[ https://issues.apache.org/jira/browse/SPARK-34645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687744#comment-17687744 ] Dongjoon Hyun commented on SPARK-34645: --- Thank you for sharing your experience and several

[jira] [Commented] (SPARK-41775) Implement training functions as input

[ https://issues.apache.org/jira/browse/SPARK-41775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687743#comment-17687743 ] Apache Spark commented on SPARK-41775: -- User 'rithwik-db' has created a pull request for this

[jira] [Assigned] (SPARK-42323) Assign name to _LEGACY_ERROR_TEMP_2332

[ https://issues.apache.org/jira/browse/SPARK-42323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42323: Assignee: (was: Apache Spark) > Assign name to _LEGACY_ERROR_TEMP_2332 >

[jira] [Assigned] (SPARK-42323) Assign name to _LEGACY_ERROR_TEMP_2332

[ https://issues.apache.org/jira/browse/SPARK-42323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42323: Assignee: Apache Spark > Assign name to _LEGACY_ERROR_TEMP_2332 >

[jira] [Commented] (SPARK-42323) Assign name to _LEGACY_ERROR_TEMP_2332

[ https://issues.apache.org/jira/browse/SPARK-42323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687742#comment-17687742 ] Apache Spark commented on SPARK-42323: -- User 'itholic' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42416) Dateset.show() should not resolve the analyzed logical plan again

[ https://issues.apache.org/jira/browse/SPARK-42416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-42416: -- Assignee: Gengliang Wang > Dateset.show() should not resolve the analyzed logical

[jira] [Created] (SPARK-42416) Dateset.show() should not resolve the analyzed logical plan again

Gengliang Wang created SPARK-42416: -- Summary: Dateset.show() should not resolve the analyzed logical plan again Key: SPARK-42416 URL: https://issues.apache.org/jira/browse/SPARK-42416 Project: Spark

[jira] [Created] (SPARK-42415) The built-in dialects support OFFSET and paging query.

jiaan.geng created SPARK-42415: -- Summary: The built-in dialects support OFFSET and paging query. Key: SPARK-42415 URL: https://issues.apache.org/jira/browse/SPARK-42415 Project: Spark Issue

[jira] [Resolved] (SPARK-42269) Support complex return types in DDL strings

[ https://issues.apache.org/jira/browse/SPARK-42269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42269. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39964

[jira] [Assigned] (SPARK-42269) Support complex return types in DDL strings

[ https://issues.apache.org/jira/browse/SPARK-42269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42269: Assignee: Xinrong Meng > Support complex return types in DDL strings >

[jira] [Resolved] (SPARK-42034) QueryExecutionListener and Observation API, df.observe do not work with `foreach` action.

[ https://issues.apache.org/jira/browse/SPARK-42034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42034. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 39976

[jira] [Assigned] (SPARK-42034) QueryExecutionListener and Observation API, df.observe do not work with `foreach` action.

[ https://issues.apache.org/jira/browse/SPARK-42034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42034: Assignee: ming95 > QueryExecutionListener and Observation API, df.observe do not

[jira] [Resolved] (SPARK-42331) Fix metadata col can not been resolved

[ https://issues.apache.org/jira/browse/SPARK-42331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42331. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39870

[jira] [Assigned] (SPARK-42331) Fix metadata col can not been resolved

[ https://issues.apache.org/jira/browse/SPARK-42331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42331: --- Assignee: XiDuo You (was: Apache Spark) > Fix metadata col can not been resolved >

[jira] [Assigned] (SPARK-42331) Fix metadata col can not been resolved

[ https://issues.apache.org/jira/browse/SPARK-42331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42331: --- Assignee: Apache Spark > Fix metadata col can not been resolved >

[jira] [Created] (SPARK-42414) Make suggestion in error message smarter

Haejoon Lee created SPARK-42414: --- Summary: Make suggestion in error message smarter Key: SPARK-42414 URL: https://issues.apache.org/jira/browse/SPARK-42414 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-42391) Close Live AppStore in the finally block for test cases

[ https://issues.apache.org/jira/browse/SPARK-42391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42391: - Assignee: Yang Jie > Close Live AppStore in the finally block for test cases >

[jira] [Resolved] (SPARK-42391) Close Live AppStore in the finally block for test cases

[ https://issues.apache.org/jira/browse/SPARK-42391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42391. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 39961

[jira] [Commented] (SPARK-42410) Support Scala 2.12/2.13 tests in connect module

[ https://issues.apache.org/jira/browse/SPARK-42410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687679#comment-17687679 ] Apache Spark commented on SPARK-42410: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-42263) Implement `spark.catalog.registerFunction`

[ https://issues.apache.org/jira/browse/SPARK-42263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42263: Assignee: (was: Apache Spark) > Implement `spark.catalog.registerFunction` >

[jira] [Assigned] (SPARK-42412) Initial prototype implementation for PySparkML

[ https://issues.apache.org/jira/browse/SPARK-42412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42412: Assignee: Apache Spark (was: Weichen Xu) > Initial prototype implementation for

[jira] [Assigned] (SPARK-42412) Initial prototype implementation for PySparkML

[ https://issues.apache.org/jira/browse/SPARK-42412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42412: Assignee: Weichen Xu (was: Apache Spark) > Initial prototype implementation for

[jira] [Commented] (SPARK-42263) Implement `spark.catalog.registerFunction`

[ https://issues.apache.org/jira/browse/SPARK-42263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687678#comment-17687678 ] Apache Spark commented on SPARK-42263: -- User 'xinrong-meng' has created a pull request for this

[jira] [Assigned] (SPARK-42263) Implement `spark.catalog.registerFunction`

[ https://issues.apache.org/jira/browse/SPARK-42263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42263: Assignee: Apache Spark > Implement `spark.catalog.registerFunction` >

[jira] [Commented] (SPARK-42412) Initial prototype implementation for PySparkML

[ https://issues.apache.org/jira/browse/SPARK-42412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687677#comment-17687677 ] Apache Spark commented on SPARK-42412: -- User 'WeichenXu123' has created a pull request for this

[jira] [Resolved] (SPARK-42413) Upgrade zstd-jni from 1.5.2-5 to 1.5.4-1

[ https://issues.apache.org/jira/browse/SPARK-42413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan resolved SPARK-42413. - Resolution: Duplicate > Upgrade zstd-jni from 1.5.2-5 to 1.5.4-1 >

[jira] [Closed] (SPARK-42413) Upgrade zstd-jni from 1.5.2-5 to 1.5.4-1

[ https://issues.apache.org/jira/browse/SPARK-42413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan closed SPARK-42413. --- Duplicate > Upgrade zstd-jni from 1.5.2-5 to 1.5.4-1 > > >

[jira] [Created] (SPARK-42413) Upgrade zstd-jni from 1.5.2-5 to 1.5.4-1

BingKun Pan created SPARK-42413: --- Summary: Upgrade zstd-jni from 1.5.2-5 to 1.5.4-1 Key: SPARK-42413 URL: https://issues.apache.org/jira/browse/SPARK-42413 Project: Spark Issue Type:

[jira] [Commented] (SPARK-42411) Better support for Istio service mesh while running Spark on Kubernetes

[ https://issues.apache.org/jira/browse/SPARK-42411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687664#comment-17687664 ] Holden Karau commented on SPARK-42411: -- The other option is something around

[jira] [Created] (SPARK-42412) Initial prototype implementation for PySparkML

Weichen Xu created SPARK-42412: -- Summary: Initial prototype implementation for PySparkML Key: SPARK-42412 URL: https://issues.apache.org/jira/browse/SPARK-42412 Project: Spark Issue Type:

[jira] [Updated] (SPARK-42263) Implement `spark.catalog.registerFunction`

[ https://issues.apache.org/jira/browse/SPARK-42263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-42263: - Parent: SPARK-41661 Issue Type: Sub-task (was: Improvement) > Implement

[jira] [Assigned] (SPARK-42412) Initial prototype implementation for PySparkML

[ https://issues.apache.org/jira/browse/SPARK-42412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu reassigned SPARK-42412: -- Assignee: Weichen Xu > Initial prototype implementation for PySparkML >

[jira] [Updated] (SPARK-42411) Better support for Istio service mesh while running Spark on Kubernetes

[ https://issues.apache.org/jira/browse/SPARK-42411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Puneet updated SPARK-42411: --- Description: h3. Support for Strict MTLS In strict MTLS Peer Authentication Istio requires each pod to be

[jira] [Resolved] (SPARK-42410) Support Scala 2.12/2.13 tests in connect module

[ https://issues.apache.org/jira/browse/SPARK-42410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42410. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39982

[jira] [Assigned] (SPARK-42410) Support Scala 2.12/2.13 tests in connect module

[ https://issues.apache.org/jira/browse/SPARK-42410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42410: - Assignee: Dongjoon Hyun > Support Scala 2.12/2.13 tests in connect module >

[jira] [Updated] (SPARK-42411) Better support for Spark on Kubernetes while using Istio service mesh

[ https://issues.apache.org/jira/browse/SPARK-42411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Puneet updated SPARK-42411: --- Summary: Better support for Spark on Kubernetes while using Istio service mesh (was: Add support for istio

[jira] [Updated] (SPARK-42411) Better support for Istio service mesh while running Spark on Kubernetes

[ https://issues.apache.org/jira/browse/SPARK-42411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Puneet updated SPARK-42411: --- Summary: Better support for Istio service mesh while running Spark on Kubernetes (was: Better support for

[jira] [Created] (SPARK-42411) Add support for istio in strict MTLS PeerAuthentication

Puneet created SPARK-42411: -- Summary: Add support for istio in strict MTLS PeerAuthentication Key: SPARK-42411 URL: https://issues.apache.org/jira/browse/SPARK-42411 Project: Spark Issue Type: New

[jira] [Assigned] (SPARK-41963) Different exception message in DataFrame.unpivot

[ https://issues.apache.org/jira/browse/SPARK-41963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41963: Assignee: Takuya Ueshin (was: Hyukjin Kwon) > Different exception message in

[jira] [Commented] (SPARK-41715) Catch specific exceptions for both Spark Connect and PySpark

[ https://issues.apache.org/jira/browse/SPARK-41715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687655#comment-17687655 ] Apache Spark commented on SPARK-41715: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-41963) Different exception message in DataFrame.unpivot

[ https://issues.apache.org/jira/browse/SPARK-41963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41963: Assignee: Hyukjin Kwon > Different exception message in DataFrame.unpivot >

[jira] [Resolved] (SPARK-41963) Different exception message in DataFrame.unpivot

[ https://issues.apache.org/jira/browse/SPARK-41963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41963. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39960

[jira] [Commented] (SPARK-41715) Catch specific exceptions for both Spark Connect and PySpark

[ https://issues.apache.org/jira/browse/SPARK-41715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687653#comment-17687653 ] Apache Spark commented on SPARK-41715: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-40453) Improve error handling for GRPC server

[ https://issues.apache.org/jira/browse/SPARK-40453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687651#comment-17687651 ] Apache Spark commented on SPARK-40453: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-41715) Catch specific exceptions for both Spark Connect and PySpark

[ https://issues.apache.org/jira/browse/SPARK-41715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687652#comment-17687652 ] Apache Spark commented on SPARK-41715: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-40453) Improve error handling for GRPC server

[ https://issues.apache.org/jira/browse/SPARK-40453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687650#comment-17687650 ] Apache Spark commented on SPARK-40453: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-42410) Support Scala 2.12/2.13 tests in connect module

[ https://issues.apache.org/jira/browse/SPARK-42410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687643#comment-17687643 ] Apache Spark commented on SPARK-42410: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-42410) Support Scala 2.12/2.13 tests in connect module

[ https://issues.apache.org/jira/browse/SPARK-42410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42410: Assignee: Apache Spark > Support Scala 2.12/2.13 tests in connect module >

[jira] [Assigned] (SPARK-42410) Support Scala 2.12/2.13 tests in connect module

[ https://issues.apache.org/jira/browse/SPARK-42410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42410: Assignee: (was: Apache Spark) > Support Scala 2.12/2.13 tests in connect module >

[jira] [Commented] (SPARK-42410) Support Scala 2.12/2.13 tests in connect module

[ https://issues.apache.org/jira/browse/SPARK-42410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687642#comment-17687642 ] Apache Spark commented on SPARK-42410: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-42410) Support Scala 2.12/2.13 tests in connect module

Dongjoon Hyun created SPARK-42410: - Summary: Support Scala 2.12/2.13 tests in connect module Key: SPARK-42410 URL: https://issues.apache.org/jira/browse/SPARK-42410 Project: Spark Issue

[jira] [Assigned] (SPARK-42405) Better documentation of array_insert function

[ https://issues.apache.org/jira/browse/SPARK-42405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42405: Assignee: (was: Apache Spark) > Better documentation of array_insert function >

[jira] [Commented] (SPARK-42405) Better documentation of array_insert function

[ https://issues.apache.org/jira/browse/SPARK-42405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687637#comment-17687637 ] Apache Spark commented on SPARK-42405: -- User 'Daniel-Davies' has created a pull request for this

[jira] [Assigned] (SPARK-42405) Better documentation of array_insert function

[ https://issues.apache.org/jira/browse/SPARK-42405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42405: Assignee: Apache Spark > Better documentation of array_insert function >

[jira] [Assigned] (SPARK-42409) Upgrade ZSTD-JNI to 1.5.4-1

[ https://issues.apache.org/jira/browse/SPARK-42409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42409: - Assignee: Yang Jie > Upgrade ZSTD-JNI to 1.5.4-1 > --- > >

[jira] [Resolved] (SPARK-42409) Upgrade ZSTD-JNI to 1.5.4-1

[ https://issues.apache.org/jira/browse/SPARK-42409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42409. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 39981

[jira] [Updated] (SPARK-42401) Incorrect results or NPE when inserting null value into array using array_insert/array_append

[ https://issues.apache.org/jira/browse/SPARK-42401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-42401: -- Summary: Incorrect results or NPE when inserting null value into array using

[jira] [Resolved] (SPARK-42400) Code clean up in org.apache.spark.storage

[ https://issues.apache.org/jira/browse/SPARK-42400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-42400. -- Fix Version/s: 3.5.0 Assignee: Khalid Mammadov Resolution: Fixed Resolved by

[jira] [Updated] (SPARK-42400) Code clean up in org.apache.spark.storage

[ https://issues.apache.org/jira/browse/SPARK-42400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-42400: - Priority: Trivial (was: Major) > Code clean up in org.apache.spark.storage >

[jira] [Resolved] (SPARK-42312) Assign name to _LEGACY_ERROR_TEMP_0042

[ https://issues.apache.org/jira/browse/SPARK-42312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-42312. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39951

[jira] [Assigned] (SPARK-42312) Assign name to _LEGACY_ERROR_TEMP_0042

[ https://issues.apache.org/jira/browse/SPARK-42312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-42312: Assignee: Haejoon Lee > Assign name to _LEGACY_ERROR_TEMP_0042 >

[jira] [Commented] (SPARK-40678) JSON conversion of ArrayType is not properly supported in Spark 3.2/2.13

[ https://issues.apache.org/jira/browse/SPARK-40678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17687573#comment-17687573 ] Wei Guo commented on SPARK-40678: - Fixed by PR 38154 https://github.com/apache/spark/pull/38154 > JSON

[jira] [Assigned] (SPARK-42409) Upgrade ZSTD-JNI to 1.5.4-1

[ https://issues.apache.org/jira/browse/SPARK-42409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42409: Assignee: (was: Apache Spark) > Upgrade ZSTD-JNI to 1.5.4-1 >

  1   2   >