[jira] [Resolved] (SPARK-43719) Handle missing row.excludedInStages field

[ https://issues.apache.org/jira/browse/SPARK-43719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-43719. --- Fix Version/s: 3.3.3 3.5.0 3.4.1 Resolution:

[jira] [Assigned] (SPARK-43719) Handle missing row.excludedInStages field

[ https://issues.apache.org/jira/browse/SPARK-43719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-43719: - Assignee: Dongjoon Hyun > Handle missing row.excludedInStages field >

[jira] [Updated] (SPARK-43719) Handle missing row.excludedInStages field

[ https://issues.apache.org/jira/browse/SPARK-43719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-43719: -- Affects Version/s: 3.3.2 > Handle missing row.excludedInStages field >

[jira] [Resolved] (SPARK-43718) References to a specific side's key in a USING join can have wrong nullability

[ https://issues.apache.org/jira/browse/SPARK-43718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-43718. --- Fix Version/s: 3.3.3 3.5.0 3.4.1 Resolution:

[jira] [Assigned] (SPARK-43718) References to a specific side's key in a USING join can have wrong nullability

[ https://issues.apache.org/jira/browse/SPARK-43718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-43718: - Assignee: Bruce Robbins > References to a specific side's key in a USING join can have

[jira] [Resolved] (SPARK-43590) Make `CheckConnectJvmClientCompatibility` to compare client and protobuf

[ https://issues.apache.org/jira/browse/SPARK-43590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-43590. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41235

[jira] [Assigned] (SPARK-43590) Make `CheckConnectJvmClientCompatibility` to compare client and protobuf

[ https://issues.apache.org/jira/browse/SPARK-43590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-43590: Assignee: Yang Jie > Make `CheckConnectJvmClientCompatibility` to compare client and protobuf >

[jira] [Commented] (SPARK-43739) Upgrade commons-io to 2.12.0

[ https://issues.apache.org/jira/browse/SPARK-43739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17725200#comment-17725200 ] Snoot.io commented on SPARK-43739: -- User 'panbingkun' has created a pull request for this issue:

[jira] [Commented] (SPARK-43603) Rebalance pyspark.pandas.DataFrame Unit Tests

[ https://issues.apache.org/jira/browse/SPARK-43603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17725198#comment-17725198 ] Snoot.io commented on SPARK-43603: -- User 'zhengruifeng' has created a pull request for this issue:

[jira] [Commented] (SPARK-43384) Make `df.show` print a nice string for MapType

[ https://issues.apache.org/jira/browse/SPARK-43384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17725195#comment-17725195 ] Snoot.io commented on SPARK-43384: -- User 'Yikf' has created a pull request for this issue:

[jira] [Commented] (SPARK-43719) Handle missing row.excludedInStages field

[ https://issues.apache.org/jira/browse/SPARK-43719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17725193#comment-17725193 ] Snoot.io commented on SPARK-43719: -- User 'dongjoon-hyun' has created a pull request for this issue:

[jira] [Commented] (SPARK-43738) Upgrade dropwizard metrics 4.2.18

[ https://issues.apache.org/jira/browse/SPARK-43738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17725191#comment-17725191 ] Snoot.io commented on SPARK-43738: -- User 'panbingkun' has created a pull request for this issue:

[jira] [Created] (SPARK-43740) Hide unsupported session methods from auto-completion

Ruifeng Zheng created SPARK-43740: - Summary: Hide unsupported session methods from auto-completion Key: SPARK-43740 URL: https://issues.apache.org/jira/browse/SPARK-43740 Project: Spark

[jira] [Commented] (SPARK-43586) There will be many invalid tasks when `Range.numSlices` > `Range.numElements`

[ https://issues.apache.org/jira/browse/SPARK-43586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17725185#comment-17725185 ] Snoot.io commented on SPARK-43586: -- User 'LuciferYang' has created a pull request for this issue:

[jira] [Commented] (SPARK-42958) Refactor `CheckConnectJvmClientCompatibility` to compare client and avro

[ https://issues.apache.org/jira/browse/SPARK-42958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17725184#comment-17725184 ] Snoot.io commented on SPARK-42958: -- User 'LuciferYang' has created a pull request for this issue:

[jira] [Commented] (SPARK-43590) Make `CheckConnectJvmClientCompatibility` to compare client and protobuf

[ https://issues.apache.org/jira/browse/SPARK-43590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17725183#comment-17725183 ] Snoot.io commented on SPARK-43590: -- User 'LuciferYang' has created a pull request for this issue:

[jira] [Commented] (SPARK-43612) Python: Artifact transfer from Scala/JVM client to Server

[ https://issues.apache.org/jira/browse/SPARK-43612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17725182#comment-17725182 ] Snoot.io commented on SPARK-43612: -- User 'HyukjinKwon' has created a pull request for this issue:

[jira] [Commented] (SPARK-43625) Document the difference between `Drop(column)` and `Drop(columnName)`

[ https://issues.apache.org/jira/browse/SPARK-43625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17725181#comment-17725181 ] Snoot.io commented on SPARK-43625: -- User 'zhengruifeng' has created a pull request for this issue:

[jira] [Resolved] (SPARK-43612) Python: Artifact transfer from Scala/JVM client to Server

[ https://issues.apache.org/jira/browse/SPARK-43612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-43612. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41250

[jira] [Assigned] (SPARK-43612) Python: Artifact transfer from Scala/JVM client to Server

[ https://issues.apache.org/jira/browse/SPARK-43612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-43612: Assignee: Hyukjin Kwon > Python: Artifact transfer from Scala/JVM client to Server >

[jira] [Commented] (SPARK-43540) Add working directory into classpath on the driver in K8S cluster mode

[ https://issues.apache.org/jira/browse/SPARK-43540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17725178#comment-17725178 ] Snoot.io commented on SPARK-43540: -- User 'turboFei' has created a pull request for this issue:

[jira] [Commented] (SPARK-43625) Document the difference between `Drop(column)` and `Drop(columnName)`

[ https://issues.apache.org/jira/browse/SPARK-43625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17725179#comment-17725179 ] Snoot.io commented on SPARK-43625: -- User 'zhengruifeng' has created a pull request for this issue:

[jira] [Commented] (SPARK-43737) Upgrade zstd-jni to 1.5.5-3

[ https://issues.apache.org/jira/browse/SPARK-43737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17725177#comment-17725177 ] Snoot.io commented on SPARK-43737: -- User 'panbingkun' has created a pull request for this issue:

[jira] [Updated] (SPARK-43625) Document the difference between `Drop(column)` and `Drop(columnName)`

[ https://issues.apache.org/jira/browse/SPARK-43625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43625: -- Component/s: (was: SQL) Documentation > Document the difference between

[jira] [Commented] (SPARK-43651) Assign a name to the error class _LEGACY_ERROR_TEMP_2403

[ https://issues.apache.org/jira/browse/SPARK-43651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17725168#comment-17725168 ] Snoot.io commented on SPARK-43651: -- User 'beliefer' has created a pull request for this issue:

[jira] [Commented] (SPARK-43651) Assign a name to the error class _LEGACY_ERROR_TEMP_2403

[ https://issues.apache.org/jira/browse/SPARK-43651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17725167#comment-17725167 ] Snoot.io commented on SPARK-43651: -- User 'beliefer' has created a pull request for this issue:

[jira] [Commented] (SPARK-43649) Assign a name to the error class _LEGACY_ERROR_TEMP_2401

[ https://issues.apache.org/jira/browse/SPARK-43649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17725166#comment-17725166 ] Snoot.io commented on SPARK-43649: -- User 'beliefer' has created a pull request for this issue:

[jira] [Commented] (SPARK-43650) Assign a name to the error class _LEGACY_ERROR_TEMP_2402

[ https://issues.apache.org/jira/browse/SPARK-43650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17725165#comment-17725165 ] Snoot.io commented on SPARK-43650: -- User 'beliefer' has created a pull request for this issue:

[jira] [Commented] (SPARK-41532) DF operations that involve multiple data frames should fail if sessions don't match

[ https://issues.apache.org/jira/browse/SPARK-41532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17725164#comment-17725164 ] Snoot.io commented on SPARK-41532: -- User 'Hisoka-X' has created a pull request for this issue:

[jira] [Commented] (SPARK-43649) Assign a name to the error class _LEGACY_ERROR_TEMP_2401

[ https://issues.apache.org/jira/browse/SPARK-43649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17725163#comment-17725163 ] Snoot.io commented on SPARK-43649: -- User 'beliefer' has created a pull request for this issue:

[jira] [Commented] (SPARK-43604) Refactor `INVALID_SQL_SYNTAX` for avoiding to embed error's text in source code

[ https://issues.apache.org/jira/browse/SPARK-43604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17725162#comment-17725162 ] Snoot.io commented on SPARK-43604: -- User 'panbingkun' has created a pull request for this issue:

[jira] [Updated] (SPARK-43739) Upgrade commons-io to 2.12.0

[ https://issues.apache.org/jira/browse/SPARK-43739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-43739: Summary: Upgrade commons-io to 2.12.0 (was: Upgrade commons-io & commons-crypto to newest

[jira] [Updated] (SPARK-43739) Upgrade commons-io & commons-crypto to newest version

[ https://issues.apache.org/jira/browse/SPARK-43739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-43739: Summary: Upgrade commons-io & commons-crypto to newest version (was: Upgrade 'commons-io' &

[jira] [Updated] (SPARK-43739) Upgrade 'commons-io' & 'commons-crypto' to newest version

[ https://issues.apache.org/jira/browse/SPARK-43739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-43739: Summary: Upgrade 'commons-io' & 'commons-crypto' to newest version (was: Upgrade `commons-io` &

[jira] [Created] (SPARK-43739) Upgrade `commons-io` & `commons-crypto` to newest version

BingKun Pan created SPARK-43739: --- Summary: Upgrade `commons-io` & `commons-crypto` to newest version Key: SPARK-43739 URL: https://issues.apache.org/jira/browse/SPARK-43739 Project: Spark

[jira] [Created] (SPARK-43738) Upgrade dropwizard metrics 4.2.18

BingKun Pan created SPARK-43738: --- Summary: Upgrade dropwizard metrics 4.2.18 Key: SPARK-43738 URL: https://issues.apache.org/jira/browse/SPARK-43738 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-42996) Assign JIRA tickets and add comments for all failing tests.

[ https://issues.apache.org/jira/browse/SPARK-42996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-42996. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41255

[jira] [Assigned] (SPARK-42996) Assign JIRA tickets and add comments for all failing tests.

[ https://issues.apache.org/jira/browse/SPARK-42996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-42996: - Assignee: Haejoon Lee > Assign JIRA tickets and add comments for all failing tests. >

[jira] [Created] (SPARK-43737) Upgrade zstd-jni to 1.5.5-3

BingKun Pan created SPARK-43737: --- Summary: Upgrade zstd-jni to 1.5.5-3 Key: SPARK-43737 URL: https://issues.apache.org/jira/browse/SPARK-43737 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-43514) Unexpected NullPointerException or IllegalArgumentException inside UDFs of ML features caused by certain SQL functions

[ https://issues.apache.org/jira/browse/SPARK-43514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17725144#comment-17725144 ] Ritika Maheshwari commented on SPARK-43514: --- Unable to reproduce the error on 3.4.0 See the

[jira] [Updated] (SPARK-43514) Unexpected NullPointerException or IllegalArgumentException inside UDFs of ML features caused by certain SQL functions

[ https://issues.apache.org/jira/browse/SPARK-43514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ritika Maheshwari updated SPARK-43514: -- Attachment: Screen Shot 2023-05-22 at 5.39.55 PM.png > Unexpected

[jira] [Commented] (SPARK-43718) References to a specific side's key in a USING join can have wrong nullability

[ https://issues.apache.org/jira/browse/SPARK-43718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17725143#comment-17725143 ] Bruce Robbins commented on SPARK-43718: --- PR here: https://github.com/apache/spark/pull/41267 >

[jira] [Updated] (SPARK-43546) Complete parity tests of Pandas UDF

[ https://issues.apache.org/jira/browse/SPARK-43546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-43546: - Summary: Complete parity tests of Pandas UDF (was: Complete Pandas UDF parity tests) >

[jira] [Created] (SPARK-43735) Enable SeriesDateTimeTests.test_weekday for pandas 2.0.0.

Haejoon Lee created SPARK-43735: --- Summary: Enable SeriesDateTimeTests.test_weekday for pandas 2.0.0. Key: SPARK-43735 URL: https://issues.apache.org/jira/browse/SPARK-43735 Project: Spark

[jira] [Created] (SPARK-43733) Enable SeriesDateTimeTests.test_second for pandas 2.0.0.

Haejoon Lee created SPARK-43733: --- Summary: Enable SeriesDateTimeTests.test_second for pandas 2.0.0. Key: SPARK-43733 URL: https://issues.apache.org/jira/browse/SPARK-43733 Project: Spark Issue

[jira] [Created] (SPARK-43736) Enable SeriesDateTimeTests.test_year for pandas 2.0.0.

Haejoon Lee created SPARK-43736: --- Summary: Enable SeriesDateTimeTests.test_year for pandas 2.0.0. Key: SPARK-43736 URL: https://issues.apache.org/jira/browse/SPARK-43736 Project: Spark Issue

[jira] [Created] (SPARK-43734) Expression "(v)" within a window function doesn't raise a AnalysisException

Xinrong Meng created SPARK-43734: Summary: Expression "(v)" within a window function doesn't raise a AnalysisException Key: SPARK-43734 URL: https://issues.apache.org/jira/browse/SPARK-43734 Project:

[jira] [Created] (SPARK-43731) Enable SeriesDateTimeTests.test_month for pandas 2.0.0.

Haejoon Lee created SPARK-43731: --- Summary: Enable SeriesDateTimeTests.test_month for pandas 2.0.0. Key: SPARK-43731 URL: https://issues.apache.org/jira/browse/SPARK-43731 Project: Spark Issue

[jira] [Created] (SPARK-43732) Enable SeriesDateTimeTests.test_quarter for pandas 2.0.0.

Haejoon Lee created SPARK-43732: --- Summary: Enable SeriesDateTimeTests.test_quarter for pandas 2.0.0. Key: SPARK-43732 URL: https://issues.apache.org/jira/browse/SPARK-43732 Project: Spark

[jira] [Created] (SPARK-43729) Enable SeriesDateTimeTests.test_microsecond for pandas 2.0.0.

Haejoon Lee created SPARK-43729: --- Summary: Enable SeriesDateTimeTests.test_microsecond for pandas 2.0.0. Key: SPARK-43729 URL: https://issues.apache.org/jira/browse/SPARK-43729 Project: Spark

[jira] [Created] (SPARK-43728) Enable SeriesDateTimeTests.test_hour for pandas 2.0.0.

Haejoon Lee created SPARK-43728: --- Summary: Enable SeriesDateTimeTests.test_hour for pandas 2.0.0. Key: SPARK-43728 URL: https://issues.apache.org/jira/browse/SPARK-43728 Project: Spark Issue

[jira] [Created] (SPARK-43730) Enable SeriesDateTimeTests.test_minute for pandas 2.0.0.

Haejoon Lee created SPARK-43730: --- Summary: Enable SeriesDateTimeTests.test_minute for pandas 2.0.0. Key: SPARK-43730 URL: https://issues.apache.org/jira/browse/SPARK-43730 Project: Spark Issue

[jira] [Created] (SPARK-43727) Parity returnType check in Spark Connect

Xinrong Meng created SPARK-43727: Summary: Parity returnType check in Spark Connect Key: SPARK-43727 URL: https://issues.apache.org/jira/browse/SPARK-43727 Project: Spark Issue Type:

[jira] [Created] (SPARK-43726) Enable SeriesDateTimeTests.test_daysinmonth for pandas 2.0.0.

Haejoon Lee created SPARK-43726: --- Summary: Enable SeriesDateTimeTests.test_daysinmonth for pandas 2.0.0. Key: SPARK-43726 URL: https://issues.apache.org/jira/browse/SPARK-43726 Project: Spark

[jira] [Created] (SPARK-43725) Enable SeriesDateTimeTests.test_days_in_month for pandas 2.0.0.

Haejoon Lee created SPARK-43725: --- Summary: Enable SeriesDateTimeTests.test_days_in_month for pandas 2.0.0. Key: SPARK-43725 URL: https://issues.apache.org/jira/browse/SPARK-43725 Project: Spark

[jira] [Created] (SPARK-43724) Enable SeriesDateTimeTests.test_dayofyear for pandas 2.0.0.

Haejoon Lee created SPARK-43724: --- Summary: Enable SeriesDateTimeTests.test_dayofyear for pandas 2.0.0. Key: SPARK-43724 URL: https://issues.apache.org/jira/browse/SPARK-43724 Project: Spark

[jira] [Created] (SPARK-43723) Enable SeriesDateTimeTests.test_dayofweek for pandas 2.0.0.

Haejoon Lee created SPARK-43723: --- Summary: Enable SeriesDateTimeTests.test_dayofweek for pandas 2.0.0. Key: SPARK-43723 URL: https://issues.apache.org/jira/browse/SPARK-43723 Project: Spark

[jira] [Updated] (SPARK-43722) Enable SeriesDateTimeTests.test_day for pandas 2.0.0.

[ https://issues.apache.org/jira/browse/SPARK-43722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43722: Summary: Enable SeriesDateTimeTests.test_day for pandas 2.0.0. (was: Enable SeriesTests.test_day

[jira] [Created] (SPARK-43721) Enable DataFramePlotMatplotlibTests.test_kde_plot for pandas 2.0.0.

Haejoon Lee created SPARK-43721: --- Summary: Enable DataFramePlotMatplotlibTests.test_kde_plot for pandas 2.0.0. Key: SPARK-43721 URL: https://issues.apache.org/jira/browse/SPARK-43721 Project: Spark

[jira] [Created] (SPARK-43722) Enable SeriesTests.test_day for pandas 2.0.0.

Haejoon Lee created SPARK-43722: --- Summary: Enable SeriesTests.test_day for pandas 2.0.0. Key: SPARK-43722 URL: https://issues.apache.org/jira/browse/SPARK-43722 Project: Spark Issue Type:

[jira] [Created] (SPARK-43720) Enable DataFramePlotMatplotlibTests.test_hist_plot for pandas 2.0.0.

Haejoon Lee created SPARK-43720: --- Summary: Enable DataFramePlotMatplotlibTests.test_hist_plot for pandas 2.0.0. Key: SPARK-43720 URL: https://issues.apache.org/jira/browse/SPARK-43720 Project: Spark

[jira] [Assigned] (SPARK-43715) Add spark DataFrame binary file reader / writer

[ https://issues.apache.org/jira/browse/SPARK-43715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu reassigned SPARK-43715: -- Assignee: Weichen Xu > Add spark DataFrame binary file reader / writer >

[jira] [Updated] (SPARK-43538) Spark Homebrew Formulae currently depends on non-officially-supported Java 20

[ https://issues.apache.org/jira/browse/SPARK-43538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-43538: Issue Type: Bug (was: Request) > Spark Homebrew Formulae currently depends on

[jira] [Resolved] (SPARK-43538) Spark Homebrew Formulae currently depends on non-officially-supported Java 20

[ https://issues.apache.org/jira/browse/SPARK-43538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-43538. - Fix Version/s: 3.4.0 Assignee: Yuming Wang Resolution: Fixed Issue resolved by

[jira] [Created] (SPARK-43719) Handle missing row.excludedInStages field

Dongjoon Hyun created SPARK-43719: - Summary: Handle missing row.excludedInStages field Key: SPARK-43719 URL: https://issues.apache.org/jira/browse/SPARK-43719 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-40500) Use `pd.items` instead of `pd.iteritems`

[ https://issues.apache.org/jira/browse/SPARK-40500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17725129#comment-17725129 ] Saiwing Yeung commented on SPARK-40500: --- This would also be useful for me. If it's useful I can

[jira] [Updated] (SPARK-43718) References to a specific side's key in a USING join can have wrong nullability

[ https://issues.apache.org/jira/browse/SPARK-43718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-43718: -- Description: Assume this data: {noformat} create or replace temp view t1 as values (1), (2),

[jira] [Updated] (SPARK-43718) References to a specific side's key in a USING join can have wrong nullability

[ https://issues.apache.org/jira/browse/SPARK-43718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-43718: -- Affects Version/s: 3.3.2 > References to a specific side's key in a USING join can have wrong

[jira] [Updated] (SPARK-43718) References to a specific side's key in a USING join can have wrong nullability

[ https://issues.apache.org/jira/browse/SPARK-43718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-43718: -- Affects Version/s: 3.4.0 > References to a specific side's key in a USING join can have wrong

[jira] [Commented] (SPARK-43718) References to a specific side's key in a USING join can have wrong nullability

[ https://issues.apache.org/jira/browse/SPARK-43718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17725122#comment-17725122 ] Bruce Robbins commented on SPARK-43718: --- I think I have a handle on this. I will submit in a PR in

[jira] [Updated] (SPARK-43716) Revert scala-maven-plugin to 4.8.0

[ https://issues.apache.org/jira/browse/SPARK-43716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-43716: -- Summary: Revert scala-maven-plugin to 4.8.0 (was: Revert scala-maven-plugin upgrade) >

[jira] [Commented] (SPARK-42809) Upgrade scala-maven-plugin from 4.8.0 to 4.8.1

[ https://issues.apache.org/jira/browse/SPARK-42809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17725121#comment-17725121 ] Dongjoon Hyun commented on SPARK-42809: --- This is logically reverted via SPARK-43716 > Upgrade

[jira] [Resolved] (SPARK-43716) Revert scala-maven-plugin upgrade

[ https://issues.apache.org/jira/browse/SPARK-43716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-43716. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41261

[jira] [Assigned] (SPARK-43716) Revert scala-maven-plugin upgrade

[ https://issues.apache.org/jira/browse/SPARK-43716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-43716: - Assignee: Bjørn Jørgensen > Revert scala-maven-plugin upgrade >

[jira] [Updated] (SPARK-43718) References to a specific side's key in a USING join can have wrong nullability

[ https://issues.apache.org/jira/browse/SPARK-43718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-43718: -- Labels: correctness (was: ) > References to a specific side's key in a USING join can have

[jira] [Updated] (SPARK-43718) References to a specific side's key in a USING join can have wrong nullability

[ https://issues.apache.org/jira/browse/SPARK-43718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-43718: -- Description: Assume this data: {noformat} create or replace temp view t1 as values (1), (2),

[jira] [Resolved] (SPARK-43591) Assign a name to the error class _LEGACY_ERROR_TEMP_0013

[ https://issues.apache.org/jira/browse/SPARK-43591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-43591. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41236

[jira] [Updated] (SPARK-43718) References to a specific side's key in a USING join can have wrong nullability

[ https://issues.apache.org/jira/browse/SPARK-43718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-43718: -- Description: Assume this data: {noformat} create or replace temp view t1 as values (1), (2),

[jira] [Assigned] (SPARK-43591) Assign a name to the error class _LEGACY_ERROR_TEMP_0013

[ https://issues.apache.org/jira/browse/SPARK-43591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-43591: Assignee: BingKun Pan > Assign a name to the error class _LEGACY_ERROR_TEMP_0013 >

[jira] [Updated] (SPARK-43583) When encryption is enabled on the External Shuffle Service, then processing of push meta requests throws NPE

[ https://issues.apache.org/jira/browse/SPARK-43583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-43583: -- Affects Version/s: 3.4.0 3.3.2 3.2.4

[jira] [Created] (SPARK-43718) References to a specific side's key in a USING join can have wrong nullability

Bruce Robbins created SPARK-43718: - Summary: References to a specific side's key in a USING join can have wrong nullability Key: SPARK-43718 URL: https://issues.apache.org/jira/browse/SPARK-43718

[jira] [Assigned] (SPARK-43583) When encryption is enabled on the External Shuffle Service, then processing of push meta requests throws NPE

[ https://issues.apache.org/jira/browse/SPARK-43583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-43583: - Assignee: Chandni Singh > When encryption is enabled on the External Shuffle Service,

[jira] [Resolved] (SPARK-43583) When encryption is enabled on the External Shuffle Service, then processing of push meta requests throws NPE

[ https://issues.apache.org/jira/browse/SPARK-43583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-43583. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41225

[jira] [Resolved] (SPARK-43487) Wrong error message used for `ambiguousRelationAliasNameInNestedCTEError`

[ https://issues.apache.org/jira/browse/SPARK-43487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-43487. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41155

[jira] [Assigned] (SPARK-43487) Wrong error message used for `ambiguousRelationAliasNameInNestedCTEError`

[ https://issues.apache.org/jira/browse/SPARK-43487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-43487: Assignee: Johan Lasperas > Wrong error message used for

[jira] [Resolved] (SPARK-43290) Support IV and AAD optional parameters for aes_encrypt

[ https://issues.apache.org/jira/browse/SPARK-43290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-43290. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40970

[jira] [Assigned] (SPARK-43290) Support IV and AAD optional parameters for aes_encrypt

[ https://issues.apache.org/jira/browse/SPARK-43290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-43290: Assignee: Steve Weis > Support IV and AAD optional parameters for aes_encrypt >

[jira] [Resolved] (SPARK-43597) Assign a name to the error class _LEGACY_ERROR_TEMP_0017

[ https://issues.apache.org/jira/browse/SPARK-43597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-43597. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41241

[jira] [Assigned] (SPARK-43597) Assign a name to the error class _LEGACY_ERROR_TEMP_0017

[ https://issues.apache.org/jira/browse/SPARK-43597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-43597: Assignee: BingKun Pan > Assign a name to the error class _LEGACY_ERROR_TEMP_0017 >

[jira] [Created] (SPARK-43717) Scala Client Dataset#reduce failed to handle null partitions for scala primitive types

Zhen Li created SPARK-43717: --- Summary: Scala Client Dataset#reduce failed to handle null partitions for scala primitive types Key: SPARK-43717 URL: https://issues.apache.org/jira/browse/SPARK-43717

[jira] [Commented] (SPARK-43333) Name union type members after types

[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17725055#comment-17725055 ] Siying Dong commented on SPARK-4: - https://github.com/apache/spark/pull/41263/ > Name union

[jira] [Created] (SPARK-43716) Revert scala-maven-plugin upgrade

Bjørn Jørgensen created SPARK-43716: --- Summary: Revert scala-maven-plugin upgrade Key: SPARK-43716 URL: https://issues.apache.org/jira/browse/SPARK-43716 Project: Spark Issue Type:

[jira] [Commented] (SPARK-42981) Add direct arrow serialization

[ https://issues.apache.org/jira/browse/SPARK-42981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17724993#comment-17724993 ] Herman van Hövell commented on SPARK-42981: --- Nope, I need to pick this up again. Will do so in

[jira] [Updated] (SPARK-43647) Maven test failed in ClientE2ETestSuite/CatalogSuite/StreamingQuerySuite without -Phive

[ https://issues.apache.org/jira/browse/SPARK-43647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-43647: - Description:   {code:java} build/mvn clean install -DskipTests build/mvn test -pl

[jira] [Commented] (SPARK-43338) Support modify the SESSION_CATALOG_NAME value

[ https://issues.apache.org/jira/browse/SPARK-43338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17724942#comment-17724942 ] melin commented on SPARK-43338: --- kyuubi verified it:

[jira] [Commented] (SPARK-43338) Support modify the SESSION_CATALOG_NAME value

[ https://issues.apache.org/jira/browse/SPARK-43338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17724939#comment-17724939 ] Jia Fan commented on SPARK-43338: - `Assign each hms a unique catalogname only so that the meta tableId

[jira] [Commented] (SPARK-37351) Supports write data flow control

[ https://issues.apache.org/jira/browse/SPARK-37351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17724934#comment-17724934 ] Jia Fan commented on SPARK-37351: - Do you want data flow control on micro-batch or batch mode?  This is

[jira] [Commented] (SPARK-43338) Support modify the SESSION_CATALOG_NAME value

[ https://issues.apache.org/jira/browse/SPARK-43338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17724933#comment-17724933 ] melin commented on SPARK-43338: --- I don't need to access multiple hms in the same sparksession, I only need

[jira] [Updated] (SPARK-43715) Add spark DataFrame binary file reader / writer

[ https://issues.apache.org/jira/browse/SPARK-43715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-43715: --- Description: In new distributed spark ML module (designed to support spark connect and support

[jira] [Updated] (SPARK-43715) Add spark DataFrame binary file reader / writer

[ https://issues.apache.org/jira/browse/SPARK-43715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-43715: --- Description: In new distributed spark ML module (designed to support spark connect and support

  1   2   3   >