[jira] [Updated] (SPARK-46857) Log appId in case of worker loss

2024-01-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46857: -- Summary: Log appId in case of worker loss (was: Log appId in case of worker lost) > Log

[jira] [Updated] (SPARK-46857) Make `Master` log `appId` in case of worker loss

2024-01-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46857: -- Summary: Make `Master` log `appId` in case of worker loss (was: Log appId in case of worker

[jira] [Created] (SPARK-46857) Log appId in case of worker lost

2024-01-24 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-46857: - Summary: Log appId in case of worker lost Key: SPARK-46857 URL: https://issues.apache.org/jira/browse/SPARK-46857 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-46818) Improve error messages for range with non-foldable input

2024-01-24 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-46818. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44857

[jira] [Assigned] (SPARK-46818) Improve error messages for range with non-foldable input

2024-01-24 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-46818: Assignee: Allison Wang > Improve error messages for range with non-foldable input >

[jira] [Updated] (SPARK-46856) Apply approximate equality in ewm tests

2024-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46856: --- Labels: pull-request-available (was: ) > Apply approximate equality in ewm tests >

[jira] [Updated] (SPARK-46855) Add `sketch` to the dependencies of the `catalyst` module in `module.py`

2024-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46855: --- Labels: pull-request-available (was: ) > Add `sketch` to the dependencies of the

[jira] [Comment Edited] (SPARK-46830) Introducing collation concept into Spark

2024-01-24 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17810713#comment-17810713 ] Jungtaek Lim edited comment on SPARK-46830 at 1/25/24 7:01 AM: --- drive-by

[jira] [Commented] (SPARK-46830) Introducing collation concept into Spark

2024-01-24 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17810713#comment-17810713 ] Jungtaek Lim commented on SPARK-46830: -- drive-by comment: you'd like to check the ACL of design doc

[jira] [Updated] (SPARK-46855) Add `sketch` to the dependencies of the `catalyst` module in `module.py`

2024-01-24 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-46855: - Summary: Add `sketch` to the dependencies of the `catalyst` module in `module.py` (was: Add `sketch`

[jira] [Updated] (SPARK-46855) Add `sketch` to the dependencies of the `catalys` module in `module.py`

2024-01-24 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-46855: - Summary: Add `sketch` to the dependencies of the `catalys` module in `module.py` (was: Add `sketch` to

[jira] [Created] (SPARK-46855) Add `sketch` to the dependencies of the `core` module in `module.py`

2024-01-24 Thread Yang Jie (Jira)
Yang Jie created SPARK-46855: Summary: Add `sketch` to the dependencies of the `core` module in `module.py` Key: SPARK-46855 URL: https://issues.apache.org/jira/browse/SPARK-46855 Project: Spark

[jira] [Resolved] (SPARK-46829) Remove createExecutorEnv from SparkEnv

2024-01-24 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46829. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44870

[jira] [Assigned] (SPARK-46829) Remove createExecutorEnv from SparkEnv

2024-01-24 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-46829: Assignee: xiaoping.huang > Remove createExecutorEnv from SparkEnv >

[jira] [Resolved] (SPARK-46816) Base implementation for new operator and state API changes

2024-01-24 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-46816. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43961

[jira] [Assigned] (SPARK-46816) Base implementation for new operator and state API changes

2024-01-24 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-46816: Assignee: Anish Shrigondekar > Base implementation for new operator and state API

[jira] [Resolved] (SPARK-46828) Remove the invalid assertion of remote mode for spark sql shell

2024-01-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46828. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44868

[jira] [Updated] (SPARK-46815) Structured Streaming - Arbitrary State API v2

2024-01-24 Thread Anish Shrigondekar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anish Shrigondekar updated SPARK-46815: --- Description: We are planning to introduce a new operator forĀ [Spark Structured

[jira] [Assigned] (SPARK-46787) `bloomFilter` function should throw `AnalysisException`

2024-01-24 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-46787: Assignee: Ruifeng Zheng > `bloomFilter` function should throw `AnalysisException` >

[jira] [Resolved] (SPARK-46787) `bloomFilter` function should throw `AnalysisException`

2024-01-24 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-46787. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44821

[jira] [Updated] (SPARK-46850) Convert `_LEGACY_ERROR_TEMP_2102 ` to `UNSUPPORTED_DATATYPE`

2024-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46850: --- Labels: pull-request-available (was: ) > Convert `_LEGACY_ERROR_TEMP_2102 ` to

[jira] [Created] (SPARK-46850) Convert `_LEGACY_ERROR_TEMP_2102 ` to `UNSUPPORTED_DATATYPE`

2024-01-24 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-46850: --- Summary: Convert `_LEGACY_ERROR_TEMP_2102 ` to `UNSUPPORTED_DATATYPE` Key: SPARK-46850 URL: https://issues.apache.org/jira/browse/SPARK-46850 Project: Spark

[jira] [Updated] (SPARK-46849) Run optimizer on CREATE TABLE column defaults

2024-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46849: --- Labels: pull-request-available (was: ) > Run optimizer on CREATE TABLE column defaults >

[jira] [Created] (SPARK-46849) Run optimizer on CREATE TABLE column defaults

2024-01-24 Thread Daniel (Jira)
Daniel created SPARK-46849: -- Summary: Run optimizer on CREATE TABLE column defaults Key: SPARK-46849 URL: https://issues.apache.org/jira/browse/SPARK-46849 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-46848) XML: Add support to partial results

2024-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46848: --- Labels: pull-request-available (was: ) > XML: Add support to partial results >

[jira] [Created] (SPARK-46848) XML: Add support to partial results

2024-01-24 Thread Shujing Yang (Jira)
Shujing Yang created SPARK-46848: Summary: XML: Add support to partial results Key: SPARK-46848 URL: https://issues.apache.org/jira/browse/SPARK-46848 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-46846) Make `WorkerResourceInfo` extend `Serializable` explicitly

2024-01-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46846. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44873

[jira] [Assigned] (SPARK-46846) Make `WorkerResourceInfo` extend `Serializable` explicitly

2024-01-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46846: - Assignee: Dongjoon Hyun > Make `WorkerResourceInfo` extend `Serializable` explicitly >

[jira] [Resolved] (SPARK-46792) Refactor ChannelBuilder system

2024-01-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46792. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44832

[jira] [Assigned] (SPARK-46792) Refactor ChannelBuilder system

2024-01-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46792: Assignee: Alice Sayutina > Refactor ChannelBuilder system >

[jira] [Updated] (SPARK-46846) Make `WorkerResourceInfo` extend `Serializable` explicitly

2024-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46846: --- Labels: pull-request-available (was: ) > Make `WorkerResourceInfo` extend `Serializable`

[jira] [Created] (SPARK-46846) Make `WorkerResourceInfo` extend `Serializable` explicitly

2024-01-24 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-46846: - Summary: Make `WorkerResourceInfo` extend `Serializable` explicitly Key: SPARK-46846 URL: https://issues.apache.org/jira/browse/SPARK-46846 Project: Spark

[jira] [Created] (SPARK-46845) Collation casting and hierarchy rules

2024-01-24 Thread Aleksandar Tomic (Jira)
Aleksandar Tomic created SPARK-46845: Summary: Collation casting and hierarchy rules Key: SPARK-46845 URL: https://issues.apache.org/jira/browse/SPARK-46845 Project: Spark Issue Type:

[jira] [Created] (SPARK-46844) Char/Varchar integration

2024-01-24 Thread Aleksandar Tomic (Jira)
Aleksandar Tomic created SPARK-46844: Summary: Char/Varchar integration Key: SPARK-46844 URL: https://issues.apache.org/jira/browse/SPARK-46844 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-46843) Collation session level settings

2024-01-24 Thread Aleksandar Tomic (Jira)
Aleksandar Tomic created SPARK-46843: Summary: Collation session level settings Key: SPARK-46843 URL: https://issues.apache.org/jira/browse/SPARK-46843 Project: Spark Issue Type: New

[jira] [Created] (SPARK-46842) Collate in list and map

2024-01-24 Thread Aleksandar Tomic (Jira)
Aleksandar Tomic created SPARK-46842: Summary: Collate in list and map Key: SPARK-46842 URL: https://issues.apache.org/jira/browse/SPARK-46842 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-46841) Language support for collations

2024-01-24 Thread Aleksandar Tomic (Jira)
Aleksandar Tomic created SPARK-46841: Summary: Language support for collations Key: SPARK-46841 URL: https://issues.apache.org/jira/browse/SPARK-46841 Project: Spark Issue Type: New

[jira] [Created] (SPARK-46840) Collation benchmarking

2024-01-24 Thread Aleksandar Tomic (Jira)
Aleksandar Tomic created SPARK-46840: Summary: Collation benchmarking Key: SPARK-46840 URL: https://issues.apache.org/jira/browse/SPARK-46840 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-46839) Collation integration with Parquet

2024-01-24 Thread Aleksandar Tomic (Jira)
Aleksandar Tomic created SPARK-46839: Summary: Collation integration with Parquet Key: SPARK-46839 URL: https://issues.apache.org/jira/browse/SPARK-46839 Project: Spark Issue Type: New

[jira] [Created] (SPARK-46838) Integration with Delta

2024-01-24 Thread Aleksandar Tomic (Jira)
Aleksandar Tomic created SPARK-46838: Summary: Integration with Delta Key: SPARK-46838 URL: https://issues.apache.org/jira/browse/SPARK-46838 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-46837) String function support (parent)

2024-01-24 Thread Aleksandar Tomic (Jira)
Aleksandar Tomic created SPARK-46837: Summary: String function support (parent) Key: SPARK-46837 URL: https://issues.apache.org/jira/browse/SPARK-46837 Project: Spark Issue Type: New

[jira] [Created] (SPARK-46836) Collation hierarchy support

2024-01-24 Thread Aleksandar Tomic (Jira)
Aleksandar Tomic created SPARK-46836: Summary: Collation hierarchy support Key: SPARK-46836 URL: https://issues.apache.org/jira/browse/SPARK-46836 Project: Spark Issue Type: Task

[jira] [Created] (SPARK-46835) Join support for strings with collation

2024-01-24 Thread Aleksandar Tomic (Jira)
Aleksandar Tomic created SPARK-46835: Summary: Join support for strings with collation Key: SPARK-46835 URL: https://issues.apache.org/jira/browse/SPARK-46835 Project: Spark Issue Type:

[jira] [Created] (SPARK-46834) Aggregate support for strings with collation

2024-01-24 Thread Aleksandar Tomic (Jira)
Aleksandar Tomic created SPARK-46834: Summary: Aggregate support for strings with collation Key: SPARK-46834 URL: https://issues.apache.org/jira/browse/SPARK-46834 Project: Spark Issue

[jira] [Updated] (SPARK-46833) Using ICU library for collation tracking

2024-01-24 Thread Aleksandar Tomic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aleksandar Tomic updated SPARK-46833: - Epic Link: SPARK-46830 > Using ICU library for collation tracking >

[jira] [Created] (SPARK-46832) Collation support in UTF8Strings

2024-01-24 Thread Aleksandar Tomic (Jira)
Aleksandar Tomic created SPARK-46832: Summary: Collation support in UTF8Strings Key: SPARK-46832 URL: https://issues.apache.org/jira/browse/SPARK-46832 Project: Spark Issue Type: Task

[jira] [Created] (SPARK-46833) Using ICU library for collation tracking

2024-01-24 Thread Aleksandar Tomic (Jira)
Aleksandar Tomic created SPARK-46833: Summary: Using ICU library for collation tracking Key: SPARK-46833 URL: https://issues.apache.org/jira/browse/SPARK-46833 Project: Spark Issue Type:

[jira] [Created] (SPARK-46831) Extend StringType and PhysicalStringType with collation id

2024-01-24 Thread Aleksandar Tomic (Jira)
Aleksandar Tomic created SPARK-46831: Summary: Extend StringType and PhysicalStringType with collation id Key: SPARK-46831 URL: https://issues.apache.org/jira/browse/SPARK-46831 Project: Spark

[jira] [Created] (SPARK-46830) Introducing collation concept into Spark

2024-01-24 Thread Aleksandar Tomic (Jira)
Aleksandar Tomic created SPARK-46830: Summary: Introducing collation concept into Spark Key: SPARK-46830 URL: https://issues.apache.org/jira/browse/SPARK-46830 Project: Spark Issue Type:

[jira] [Commented] (SPARK-31794) Incorrect distribution with repartitionByRange and repartition column expression

2024-01-24 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17810476#comment-17810476 ] Sean R. Owen commented on SPARK-31794: -- Not that it helps, but I observe the same behavior, and it

[jira] [Resolved] (SPARK-46827) Make RocksDBPersistenceEngine to support a symbolic link

2024-01-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46827. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44867

[jira] [Assigned] (SPARK-46796) RocksDB versionID Mismatch in SST files

2024-01-24 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-46796: Assignee: Bhuwan Sahni > RocksDB versionID Mismatch in SST files >

[jira] [Resolved] (SPARK-46796) RocksDB versionID Mismatch in SST files

2024-01-24 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-46796. -- Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-46826) Reset grpcio installation version of `Python linter dependencies for branch-3.4/branch-3.5`

2024-01-24 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-46826. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44866

[jira] [Assigned] (SPARK-46826) Reset grpcio installation version of `Python linter dependencies for branch-3.4/branch-3.5`

2024-01-24 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-46826: Assignee: Yang Jie > Reset grpcio installation version of `Python linter dependencies for >

[jira] [Updated] (SPARK-46829) Remove createExecutorEnv from SparkEnv

2024-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46829: --- Labels: pull-request-available (was: ) > Remove createExecutorEnv from SparkEnv >

[jira] [Created] (SPARK-46829) Remove createExecutorEnv from SparkEnv

2024-01-24 Thread xiaoping.huang (Jira)
xiaoping.huang created SPARK-46829: -- Summary: Remove createExecutorEnv from SparkEnv Key: SPARK-46829 URL: https://issues.apache.org/jira/browse/SPARK-46829 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-46654) df.show() of pyspark displayed different results between Regular Spark and Spark Connect

2024-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46654: -- Assignee: Apache Spark > df.show() of pyspark displayed different results between

[jira] [Assigned] (SPARK-46620) Introduce a basic fallback mechanism for frame methods

2024-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46620: -- Assignee: (was: Apache Spark) > Introduce a basic fallback mechanism for frame

[jira] [Assigned] (SPARK-46620) Introduce a basic fallback mechanism for frame methods

2024-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46620: -- Assignee: Apache Spark > Introduce a basic fallback mechanism for frame methods >

[jira] [Assigned] (SPARK-46654) df.show() of pyspark displayed different results between Regular Spark and Spark Connect

2024-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46654: -- Assignee: (was: Apache Spark) > df.show() of pyspark displayed different results

[jira] [Updated] (SPARK-46620) Introduce a basic fallback mechanism for frame methods

2024-01-24 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-46620: -- Summary: Introduce a basic fallback mechanism for frame methods (was: Implement

[jira] [Assigned] (SPARK-46654) df.show() of pyspark displayed different results between Regular Spark and Spark Connect

2024-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46654: -- Assignee: (was: Apache Spark) > df.show() of pyspark displayed different results

[jira] [Assigned] (SPARK-46654) df.show() of pyspark displayed different results between Regular Spark and Spark Connect

2024-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46654: -- Assignee: Apache Spark > df.show() of pyspark displayed different results between

[jira] [Created] (SPARK-46828) Remove the invalid assertion of remote mode for spark sql shell

2024-01-24 Thread Kent Yao (Jira)
Kent Yao created SPARK-46828: Summary: Remove the invalid assertion of remote mode for spark sql shell Key: SPARK-46828 URL: https://issues.apache.org/jira/browse/SPARK-46828 Project: Spark

[jira] [Assigned] (SPARK-46826) Reset grpcio installation version of `Python linter dependencies for branch-3.4/branch-3.5`

2024-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46826: -- Assignee: Apache Spark > Reset grpcio installation version of `Python linter

[jira] [Assigned] (SPARK-46826) Reset grpcio installation version of `Python linter dependencies for branch-3.4/branch-3.5`

2024-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46826: -- Assignee: (was: Apache Spark) > Reset grpcio installation version of `Python

[jira] [Assigned] (SPARK-46823) LocalDataToArrowConversion should check the nullability

2024-01-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46823: - Assignee: Ruifeng Zheng > LocalDataToArrowConversion should check the nullability >

[jira] [Resolved] (SPARK-46823) LocalDataToArrowConversion should check the nullability

2024-01-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46823. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44861

[jira] [Assigned] (SPARK-46827) Make RocksDBPersistenceEngine to support a symbolic link

2024-01-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46827: - Assignee: Dongjoon Hyun > Make RocksDBPersistenceEngine to support a symbolic link >

[jira] [Updated] (SPARK-46827) Make RocksDBPersistenceEngine to support a symbolic link

2024-01-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46827: -- Summary: Make RocksDBPersistenceEngine to support a symbolic link (was: Fix

[jira] [Updated] (SPARK-46827) Fix RocksDBPersistenceEngine to support a symbolic link

2024-01-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46827: --- Labels: pull-request-available (was: ) > Fix RocksDBPersistenceEngine to support a

[jira] [Created] (SPARK-46827) Fix RocksDBPersistenceEngine to support a symbolic link

2024-01-24 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-46827: - Summary: Fix RocksDBPersistenceEngine to support a symbolic link Key: SPARK-46827 URL: https://issues.apache.org/jira/browse/SPARK-46827 Project: Spark