[jira] [Updated] (SPARK-34600) Support user defined types in Pandas UDF

[ https://issues.apache.org/jira/browse/SPARK-34600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated SPARK-34600: -- Description: Because Pandas UDF uses pyarrow to passing data, it does not currently support

[jira] [Commented] (SPARK-34600) Support user defined types in Pandas UDF

[ https://issues.apache.org/jira/browse/SPARK-34600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17295054#comment-17295054 ] Lei (Eddy) Xu commented on SPARK-34600: --- Hi, Here I've worked on a PR to support returning UDT

[jira] [Assigned] (SPARK-34600) Support user defined types in Pandas UDF

[ https://issues.apache.org/jira/browse/SPARK-34600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34600: Assignee: (was: Apache Spark) > Support user defined types in Pandas UDF >

[jira] [Commented] (SPARK-34600) Support user defined types in Pandas UDF

[ https://issues.apache.org/jira/browse/SPARK-34600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17295049#comment-17295049 ] Apache Spark commented on SPARK-34600: -- User 'eddyxu' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34600) Support user defined types in Pandas UDF

[ https://issues.apache.org/jira/browse/SPARK-34600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34600: Assignee: Apache Spark > Support user defined types in Pandas UDF >

[jira] [Closed] (SPARK-25464) Dropping database can remove the hive warehouse directory contents

[ https://issues.apache.org/jira/browse/SPARK-25464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushanta Sen closed SPARK-25464. > Dropping database can remove the hive warehouse directory contents >

[jira] [Closed] (SPARK-24278) Create table if not exists is throwing table already exists exception

[ https://issues.apache.org/jira/browse/SPARK-24278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushanta Sen closed SPARK-24278. > Create table if not exists is throwing table already exists exception >

[jira] [Resolved] (SPARK-34599) INSERT INTO OVERWRITE doesn't support partition columns containing dot for DSv2

[ https://issues.apache.org/jira/browse/SPARK-34599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34599. - Fix Version/s: 3.1.2 3.2.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-34599) INSERT INTO OVERWRITE doesn't support partition columns containing dot for DSv2

[ https://issues.apache.org/jira/browse/SPARK-34599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34599: --- Assignee: Shixiong Zhu > INSERT INTO OVERWRITE doesn't support partition columns

[jira] [Updated] (SPARK-34615) Support java.time.Period as an external type of the year-month interval type

[ https://issues.apache.org/jira/browse/SPARK-34615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34615: --- Description: Allow parallelization/collection of java.time.Period values, and convert the values to

[jira] [Created] (SPARK-34615) Support java.time.Period as an external type of the year-month interval type

Maxim Gekk created SPARK-34615: -- Summary: Support java.time.Period as an external type of the year-month interval type Key: SPARK-34615 URL: https://issues.apache.org/jira/browse/SPARK-34615 Project:

[jira] [Commented] (SPARK-34614) ANSI mode: Casting String to Boolean should throw exception on parse error

[ https://issues.apache.org/jira/browse/SPARK-34614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17295005#comment-17295005 ] Apache Spark commented on SPARK-34614: -- User 'gengliangwang' has created a pull request for this

[jira] [Commented] (SPARK-34614) ANSI mode: Casting String to Boolean should throw exception on parse error

[ https://issues.apache.org/jira/browse/SPARK-34614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17295004#comment-17295004 ] Apache Spark commented on SPARK-34614: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-34614) ANSI mode: Casting String to Boolean should throw exception on parse error

[ https://issues.apache.org/jira/browse/SPARK-34614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34614: Assignee: Gengliang Wang (was: Apache Spark) > ANSI mode: Casting String to Boolean

[jira] [Assigned] (SPARK-34614) ANSI mode: Casting String to Boolean should throw exception on parse error

[ https://issues.apache.org/jira/browse/SPARK-34614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34614: Assignee: Apache Spark (was: Gengliang Wang) > ANSI mode: Casting String to Boolean

[jira] [Created] (SPARK-34614) ANSI mode: Casting String to Boolean should throw exception on parse error

Gengliang Wang created SPARK-34614: -- Summary: ANSI mode: Casting String to Boolean should throw exception on parse error Key: SPARK-34614 URL: https://issues.apache.org/jira/browse/SPARK-34614

[jira] [Resolved] (SPARK-34577) Cannot drop/add columns from/to a dataset of v2 `DESCRIBE NAMESPACE`

[ https://issues.apache.org/jira/browse/SPARK-34577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34577. - Fix Version/s: 3.1.2 3.2.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-34577) Cannot drop/add columns from/to a dataset of v2 `DESCRIBE NAMESPACE`

[ https://issues.apache.org/jira/browse/SPARK-34577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34577: --- Assignee: angerszhu > Cannot drop/add columns from/to a dataset of v2 `DESCRIBE NAMESPACE`

[jira] [Updated] (SPARK-34601) Do not delete shuffle file on executor lost event when using remote shuffle service

[ https://issues.apache.org/jira/browse/SPARK-34601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34601: - Fix Version/s: (was: 3.2.0) > Do not delete shuffle file on executor lost event when using

[jira] [Updated] (SPARK-34601) Do not delete shuffle file on executor lost event when using remote shuffle service

[ https://issues.apache.org/jira/browse/SPARK-34601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34601: - Target Version/s: (was: 3.2.0) > Do not delete shuffle file on executor lost event when using

[jira] [Commented] (SPARK-34607) NewInstance.resolved should not throw malformed class name error

[ https://issues.apache.org/jira/browse/SPARK-34607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17294987#comment-17294987 ] Apache Spark commented on SPARK-34607: -- User 'maropu' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34607) NewInstance.resolved should not throw malformed class name error

[ https://issues.apache.org/jira/browse/SPARK-34607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34607: Assignee: Apache Spark > NewInstance.resolved should not throw malformed class name

[jira] [Assigned] (SPARK-34607) NewInstance.resolved should not throw malformed class name error

[ https://issues.apache.org/jira/browse/SPARK-34607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34607: Assignee: (was: Apache Spark) > NewInstance.resolved should not throw malformed

[jira] [Commented] (SPARK-34607) NewInstance.resolved should not throw malformed class name error

[ https://issues.apache.org/jira/browse/SPARK-34607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17294986#comment-17294986 ] Apache Spark commented on SPARK-34607: -- User 'maropu' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34613) Fix view does not capture disable hint config

[ https://issues.apache.org/jira/browse/SPARK-34613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34613: Assignee: (was: Apache Spark) > Fix view does not capture disable hint config >

[jira] [Assigned] (SPARK-34613) Fix view does not capture disable hint config

[ https://issues.apache.org/jira/browse/SPARK-34613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34613: Assignee: Apache Spark > Fix view does not capture disable hint config >

[jira] [Commented] (SPARK-34613) Fix view does not capture disable hint config

[ https://issues.apache.org/jira/browse/SPARK-34613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17294975#comment-17294975 ] Apache Spark commented on SPARK-34613: -- User 'ulysses-you' has created a pull request for this

[jira] [Created] (SPARK-34613) Fix view does not capture disable hint config

ulysses you created SPARK-34613: --- Summary: Fix view does not capture disable hint config Key: SPARK-34613 URL: https://issues.apache.org/jira/browse/SPARK-34613 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-33602) Group exception messages in execution/datasources

[ https://issues.apache.org/jira/browse/SPARK-33602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33602: Assignee: (was: Apache Spark) > Group exception messages in execution/datasources >

[jira] [Assigned] (SPARK-33602) Group exception messages in execution/datasources

[ https://issues.apache.org/jira/browse/SPARK-33602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33602: Assignee: Apache Spark > Group exception messages in execution/datasources >

[jira] [Commented] (SPARK-33602) Group exception messages in execution/datasources

[ https://issues.apache.org/jira/browse/SPARK-33602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17294963#comment-17294963 ] Apache Spark commented on SPARK-33602: -- User 'beliefer' has created a pull request for this issue:

[jira] [Resolved] (SPARK-34584) When insert into a partition table with a illegal partition value, DSV2 behavior different as others

[ https://issues.apache.org/jira/browse/SPARK-34584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34584. -- Fix Version/s: 3.1.2 3.2.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-34584) When insert into a partition table with a illegal partition value, DSV2 behavior different as others

[ https://issues.apache.org/jira/browse/SPARK-34584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-34584: Assignee: Wenchen Fan > When insert into a partition table with a illegal partition

[jira] [Commented] (SPARK-30476) NullPointerException when Insert data to hive mongo external table by spark-sql

[ https://issues.apache.org/jira/browse/SPARK-30476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17294942#comment-17294942 ] Hyukjin Kwon commented on SPARK-30476: -- [~bro-Xiong], please file a new JIRA and open a PR (to

[jira] [Commented] (SPARK-34588) Support int64 buffer lengths in Java for pyspark Pandas UDF as buffer expanding

[ https://issues.apache.org/jira/browse/SPARK-34588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17294939#comment-17294939 ] Hyukjin Kwon commented on SPARK-34588: -- Yeah, it's released. Yes, it would be great if we can

[jira] [Commented] (SPARK-34607) NewInstance.resolved should not throw malformed class name error

[ https://issues.apache.org/jira/browse/SPARK-34607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17294930#comment-17294930 ] Hyukjin Kwon commented on SPARK-34607: -- Thank you [~maropu]. > NewInstance.resolved should not

[jira] [Created] (SPARK-34612) Whether to expose outputDeterministicLevel so custom RDDs can set deterministic level

L. C. Hsieh created SPARK-34612: --- Summary: Whether to expose outputDeterministicLevel so custom RDDs can set deterministic level Key: SPARK-34612 URL: https://issues.apache.org/jira/browse/SPARK-34612

[jira] [Updated] (SPARK-34601) Do not delete shuffle file on executor lost event when using remote shuffle service

[ https://issues.apache.org/jira/browse/SPARK-34601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BoYang updated SPARK-34601: --- Description: There are multiple work going on with disaggregated/remote shuffle service (e.g. [LinkedIn

[jira] [Created] (SPARK-34611) Fix grammar issues in sql-migration-guide

hopefulnick created SPARK-34611: --- Summary: Fix grammar issues in sql-migration-guide Key: SPARK-34611 URL: https://issues.apache.org/jira/browse/SPARK-34611 Project: Spark Issue Type:

[jira] [Updated] (SPARK-34610) Fix Python UDF used in GroupedAggPandasUDFTests.

[ https://issues.apache.org/jira/browse/SPARK-34610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34610: - Fix Version/s: 3.0.3 3.1.2 3.2.0 > Fix Python UDF used in

[jira] [Resolved] (SPARK-34610) Fix Python UDF used in GroupedAggPandasUDFTests.

[ https://issues.apache.org/jira/browse/SPARK-34610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34610. -- Assignee: Takuya Ueshin Resolution: Fixed Fixed in

[jira] [Resolved] (SPARK-34604) Flaky test: TaskContextTestsWithWorkerReuse.test_task_context_correct_with_python_worker_reuse

[ https://issues.apache.org/jira/browse/SPARK-34604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34604. -- Fix Version/s: 3.1.2 3.0.3 3.2.0 Resolution:

[jira] [Commented] (SPARK-34610) Fix Python UDF used in GroupedAggPandasUDFTests.

[ https://issues.apache.org/jira/browse/SPARK-34610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17294884#comment-17294884 ] Apache Spark commented on SPARK-34610: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34610) Fix Python UDF used in GroupedAggPandasUDFTests.

[ https://issues.apache.org/jira/browse/SPARK-34610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34610: Assignee: Apache Spark > Fix Python UDF used in GroupedAggPandasUDFTests. >

[jira] [Commented] (SPARK-34610) Fix Python UDF used in GroupedAggPandasUDFTests.

[ https://issues.apache.org/jira/browse/SPARK-34610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17294882#comment-17294882 ] Apache Spark commented on SPARK-34610: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34610) Fix Python UDF used in GroupedAggPandasUDFTests.

[ https://issues.apache.org/jira/browse/SPARK-34610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34610: Assignee: (was: Apache Spark) > Fix Python UDF used in GroupedAggPandasUDFTests. >

[jira] [Created] (SPARK-34610) Fix Python UDF used in GroupedAggPandasUDFTests.

Takuya Ueshin created SPARK-34610: - Summary: Fix Python UDF used in GroupedAggPandasUDFTests. Key: SPARK-34610 URL: https://issues.apache.org/jira/browse/SPARK-34610 Project: Spark Issue

[jira] [Commented] (SPARK-34463) toPandas failed with error: buffer source array is read-only when Arrow with self-destruct is enabled

[ https://issues.apache.org/jira/browse/SPARK-34463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17294838#comment-17294838 ] David Li commented on SPARK-34463: -- I've checked that the master build of Pandas fixes this specific

[jira] [Commented] (SPARK-34605) Support java.time.Duration as an external type of the day-time interval type

[ https://issues.apache.org/jira/browse/SPARK-34605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17294821#comment-17294821 ] Apache Spark commented on SPARK-34605: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34605) Support java.time.Duration as an external type of the day-time interval type

[ https://issues.apache.org/jira/browse/SPARK-34605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34605: Assignee: (was: Apache Spark) > Support java.time.Duration as an external type of

[jira] [Assigned] (SPARK-34605) Support java.time.Duration as an external type of the day-time interval type

[ https://issues.apache.org/jira/browse/SPARK-34605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34605: Assignee: Apache Spark > Support java.time.Duration as an external type of the day-time

[jira] [Commented] (SPARK-34605) Support java.time.Duration as an external type of the day-time interval type

[ https://issues.apache.org/jira/browse/SPARK-34605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17294820#comment-17294820 ] Apache Spark commented on SPARK-34605: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-29721) Spark SQL reads unnecessary nested fields after using explode

[ https://issues.apache.org/jira/browse/SPARK-29721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17294794#comment-17294794 ] L. C. Hsieh commented on SPARK-29721: - Agree with Dongjoon. Looks like another type of pruning case.

[jira] [Commented] (SPARK-34511) Current Security vulnerabilities in spark libraries

[ https://issues.apache.org/jira/browse/SPARK-34511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17294753#comment-17294753 ] Dongjoon Hyun commented on SPARK-34511: --- Thanks for updating! For Hadoop 3.2.0, we upgraded it to

[jira] [Commented] (SPARK-34511) Current Security vulnerabilities in spark libraries

[ https://issues.apache.org/jira/browse/SPARK-34511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17294749#comment-17294749 ] eoin commented on SPARK-34511: -- [~dongjoon] Thanks for looking at this, yes not using 2.7.4 now I have

[jira] [Commented] (SPARK-29721) Spark SQL reads unnecessary nested fields after using explode

[ https://issues.apache.org/jira/browse/SPARK-29721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17294747#comment-17294747 ] Dongjoon Hyun commented on SPARK-29721: --- Thanks, [~yuryn] . That sounds like another typo of

[jira] [Updated] (SPARK-34511) Current Security vulnerabilities in spark libraries

[ https://issues.apache.org/jira/browse/SPARK-34511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] eoin updated SPARK-34511: - Description: The following libraries have the following vulnerabilities that will fail Nexus security scans.

[jira] [Commented] (SPARK-34511) Current Security vulnerabilities in spark libraries

[ https://issues.apache.org/jira/browse/SPARK-34511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17294733#comment-17294733 ] Dongjoon Hyun commented on SPARK-34511: --- BTW, Apache Spark 3.1's the default Hadoop is 3.2.0. -

[jira] [Commented] (SPARK-34511) Current Security vulnerabilities in spark libraries

[ https://issues.apache.org/jira/browse/SPARK-34511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17294731#comment-17294731 ] Dongjoon Hyun commented on SPARK-34511: --- Thank you so much for updating this report based on the

[jira] [Updated] (SPARK-34511) Current Security vulnerabilities in spark libraries

[ https://issues.apache.org/jira/browse/SPARK-34511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] eoin updated SPARK-34511: - Description: The following libraries have the following vulnerabilities that will fail Nexus security scans.

[jira] [Updated] (SPARK-34511) Current Security vulnerabilities in spark libraries

[ https://issues.apache.org/jira/browse/SPARK-34511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] eoin updated SPARK-34511: - Affects Version/s: (was: 3.0.1) 3.1.1 > Current Security vulnerabilities in spark

[jira] [Updated] (SPARK-34511) Current Security vulnerabilities in spark libraries

[ https://issues.apache.org/jira/browse/SPARK-34511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] eoin updated SPARK-34511: - Description: The following libraries have the following vulnerabilities that will fail Nexus security scans.

[jira] [Updated] (SPARK-30228) Update zstd-jni to 1.4.4-3

[ https://issues.apache.org/jira/browse/SPARK-30228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30228: -- Labels: correctness releasenotes (was: correctness) > Update zstd-jni to 1.4.4-3 >

[jira] [Updated] (SPARK-30228) Update zstd-jni to 1.4.4-3

[ https://issues.apache.org/jira/browse/SPARK-30228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30228: -- Priority: Blocker (was: Major) > Update zstd-jni to 1.4.4-3 > -- > >

[jira] [Commented] (SPARK-30228) Update zstd-jni to 1.4.4-3

[ https://issues.apache.org/jira/browse/SPARK-30228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17294684#comment-17294684 ] Dongjoon Hyun commented on SPARK-30228: --- This patch is backported to branch-2.4 as a correctness

[jira] [Updated] (SPARK-30228) Update zstd-jni to 1.4.4-3

[ https://issues.apache.org/jira/browse/SPARK-30228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30228: -- Issue Type: Bug (was: Improvement) > Update zstd-jni to 1.4.4-3 > --

[jira] [Updated] (SPARK-30228) Update zstd-jni to 1.4.4-3

[ https://issues.apache.org/jira/browse/SPARK-30228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30228: -- Labels: correctness (was: ) > Update zstd-jni to 1.4.4-3 > -- > >

[jira] [Commented] (SPARK-34594) OrcColumnarBatchReader uncaught exception

[ https://issues.apache.org/jira/browse/SPARK-34594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17294681#comment-17294681 ] Dongjoon Hyun commented on SPARK-34594: --- What do you mean the issue? {quote}This issue occured

[jira] [Resolved] (SPARK-34590) Allow JDWP debug for tests

[ https://issues.apache.org/jira/browse/SPARK-34590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34590. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31706

[jira] [Assigned] (SPARK-34609) unify resolveExpressionBottomUp and resolveExpressionTopDown

[ https://issues.apache.org/jira/browse/SPARK-34609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34609: Assignee: (was: Apache Spark) > unify resolveExpressionBottomUp and

[jira] [Assigned] (SPARK-34609) unify resolveExpressionBottomUp and resolveExpressionTopDown

[ https://issues.apache.org/jira/browse/SPARK-34609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34609: Assignee: Apache Spark > unify resolveExpressionBottomUp and resolveExpressionTopDown >

[jira] [Commented] (SPARK-34609) unify resolveExpressionBottomUp and resolveExpressionTopDown

[ https://issues.apache.org/jira/browse/SPARK-34609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17294626#comment-17294626 ] Apache Spark commented on SPARK-34609: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34609) unify resolveExpressionBottomUp and resolveExpressionTopDown

[ https://issues.apache.org/jira/browse/SPARK-34609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34609: Assignee: Apache Spark > unify resolveExpressionBottomUp and resolveExpressionTopDown >

[jira] [Created] (SPARK-34609) unify resolveExpressionBottomUp and resolveExpressionTopDown

Wenchen Fan created SPARK-34609: --- Summary: unify resolveExpressionBottomUp and resolveExpressionTopDown Key: SPARK-34609 URL: https://issues.apache.org/jira/browse/SPARK-34609 Project: Spark

[jira] [Commented] (SPARK-34576) Cannot drop/add columns from/to a dataset of v2 `DESCRIBE COLUMN`

[ https://issues.apache.org/jira/browse/SPARK-34576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17294581#comment-17294581 ] Apache Spark commented on SPARK-34576: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-34576) Cannot drop/add columns from/to a dataset of v2 `DESCRIBE COLUMN`

[ https://issues.apache.org/jira/browse/SPARK-34576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17294580#comment-17294580 ] Apache Spark commented on SPARK-34576: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-34607) NewInstance.resolved should not throw malformed class name error

[ https://issues.apache.org/jira/browse/SPARK-34607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17294566#comment-17294566 ] Takeshi Yamamuro commented on SPARK-34607: -- okay, I'll dig into this tomorrow. >

[jira] [Resolved] (SPARK-34555) Resolve metadata output from DataFrame

[ https://issues.apache.org/jira/browse/SPARK-34555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34555. - Fix Version/s: 3.1.2 3.2.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-34555) Resolve metadata output from DataFrame

[ https://issues.apache.org/jira/browse/SPARK-34555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34555: --- Assignee: Karen Feng > Resolve metadata output from DataFrame >

[jira] [Assigned] (SPARK-34584) When insert into a partition table with a illegal partition value, DSV2 behavior different as others

[ https://issues.apache.org/jira/browse/SPARK-34584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34584: Assignee: (was: Apache Spark) > When insert into a partition table with a illegal

[jira] [Commented] (SPARK-34584) When insert into a partition table with a illegal partition value, DSV2 behavior different as others

[ https://issues.apache.org/jira/browse/SPARK-34584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17294546#comment-17294546 ] Apache Spark commented on SPARK-34584: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34584) When insert into a partition table with a illegal partition value, DSV2 behavior different as others

[ https://issues.apache.org/jira/browse/SPARK-34584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34584: Assignee: Apache Spark > When insert into a partition table with a illegal partition

[jira] [Commented] (SPARK-34584) When insert into a partition table with a illegal partition value, DSV2 behavior different as others

[ https://issues.apache.org/jira/browse/SPARK-34584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17294545#comment-17294545 ] Apache Spark commented on SPARK-34584: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Commented] (SPARK-34608) Remove unused output in AddJarCommand

[ https://issues.apache.org/jira/browse/SPARK-34608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17294517#comment-17294517 ] Apache Spark commented on SPARK-34608: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-34608) Remove unused output in AddJarCommand

[ https://issues.apache.org/jira/browse/SPARK-34608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34608: Assignee: (was: Apache Spark) > Remove unused output in AddJarCommand >

[jira] [Commented] (SPARK-34608) Remove unused output in AddJarCommand

[ https://issues.apache.org/jira/browse/SPARK-34608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17294516#comment-17294516 ] Apache Spark commented on SPARK-34608: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-34608) Remove unused output in AddJarCommand

[ https://issues.apache.org/jira/browse/SPARK-34608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34608: Assignee: Apache Spark > Remove unused output in AddJarCommand >

[jira] [Created] (SPARK-34608) Remove unused output in AddJarCommand

angerszhu created SPARK-34608: - Summary: Remove unused output in AddJarCommand Key: SPARK-34608 URL: https://issues.apache.org/jira/browse/SPARK-34608 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-34607) NewInstance.resolved should not throw malformed class name error

[ https://issues.apache.org/jira/browse/SPARK-34607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17294509#comment-17294509 ] Hyukjin Kwon commented on SPARK-34607: -- cc [~kiszk], [~maropu] and [~viirya] in case you're

[jira] [Updated] (SPARK-34607) NewInstance.resolved should not throw malformed class name error

[ https://issues.apache.org/jira/browse/SPARK-34607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kris Mok updated SPARK-34607: - Description: I'd like to seek for community help on fixing this issue: Related to SPARK-34596, one of

[jira] [Updated] (SPARK-34607) NewInstance.resolved should not throw malformed class name error

[ https://issues.apache.org/jira/browse/SPARK-34607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kris Mok updated SPARK-34607: - Description: I'd like to seek for community help on fixing this issue: Related to SPARK-34596, one of

[jira] [Created] (SPARK-34607) NewInstance.resolved should not throw malformed class name error

Kris Mok created SPARK-34607: Summary: NewInstance.resolved should not throw malformed class name error Key: SPARK-34607 URL: https://issues.apache.org/jira/browse/SPARK-34607 Project: Spark

[jira] [Commented] (SPARK-34222) Enhance Boolean Simplification Rule

[ https://issues.apache.org/jira/browse/SPARK-34222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17294490#comment-17294490 ] Apache Spark commented on SPARK-34222: -- User 'gengliangwang' has created a pull request for this

[jira] [Commented] (SPARK-34222) Enhance Boolean Simplification Rule

[ https://issues.apache.org/jira/browse/SPARK-34222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17294488#comment-17294488 ] Apache Spark commented on SPARK-34222: -- User 'gengliangwang' has created a pull request for this

[jira] [Updated] (SPARK-33864) How can we submit or initiate multiple spark application with single or few JVM

[ https://issues.apache.org/jira/browse/SPARK-33864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramesha Bhatta updated SPARK-33864: --- Description: How can we have single JVM or few JVM process submit multiple application to

[jira] [Updated] (SPARK-33864) How can we submit or initiate multiple spark application with single or few JVM

[ https://issues.apache.org/jira/browse/SPARK-33864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramesha Bhatta updated SPARK-33864: --- Summary: How can we submit or initiate multiple spark application with single or few JVM

[jira] [Updated] (SPARK-33864) How can we submit or initiate multiple application with single or few JVM

[ https://issues.apache.org/jira/browse/SPARK-33864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramesha Bhatta updated SPARK-33864: --- Description: How can we have single JVM or few JVM process submit multiple application to

[jira] [Updated] (SPARK-33864) How can we submit or initiate multiple application with single or few JVM

[ https://issues.apache.org/jira/browse/SPARK-33864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramesha Bhatta updated SPARK-33864: --- Summary: How can we submit or initiate multiple application with single or few JVM (was:

[jira] [Updated] (SPARK-34603) Support ADD ARCHIVE and LIST ARCHIVES command

[ https://issues.apache.org/jira/browse/SPARK-34603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34603: --- Summary: Support ADD ARCHIVE and LIST ARCHIVES command (was: Support ADD ARCHIVE and LIST

[jira] [Commented] (SPARK-34595) DPP support RLIKE

[ https://issues.apache.org/jira/browse/SPARK-34595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1729#comment-1729 ] Apache Spark commented on SPARK-34595: -- User 'chaojun-zhang' has created a pull request for this

  1   2   >