[jira] [Updated] (SPARK-46303) Remove unused code in `pyspark.pandas.tests.series.* `

[ https://issues.apache.org/jira/browse/SPARK-46303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46303: --- Labels: pull-request-available (was: ) > Remove unused code in

[jira] [Created] (SPARK-46303) Remove unused code in `pyspark.pandas.tests.series.* `

Ruifeng Zheng created SPARK-46303: - Summary: Remove unused code in `pyspark.pandas.tests.series.* ` Key: SPARK-46303 URL: https://issues.apache.org/jira/browse/SPARK-46303 Project: Spark

[jira] [Updated] (SPARK-46302) Fix maven daily testing

[ https://issues.apache.org/jira/browse/SPARK-46302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46302: --- Labels: pull-request-available (was: ) > Fix maven daily testing > ---

[jira] [Created] (SPARK-46302) Fix maven daily testing

BingKun Pan created SPARK-46302: --- Summary: Fix maven daily testing Key: SPARK-46302 URL: https://issues.apache.org/jira/browse/SPARK-46302 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-46300) Test missing test coverage for Column (pyspark.sql.column)

[ https://issues.apache.org/jira/browse/SPARK-46300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46300. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44228

[jira] [Assigned] (SPARK-46300) Test missing test coverage for Column (pyspark.sql.column)

[ https://issues.apache.org/jira/browse/SPARK-46300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46300: Assignee: Hyukjin Kwon > Test missing test coverage for Column (pyspark.sql.column) >

[jira] [Assigned] (SPARK-46298) Test catalog error classes (pyspark.sql.catalog)

[ https://issues.apache.org/jira/browse/SPARK-46298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46298: Assignee: Hyukjin Kwon > Test catalog error classes (pyspark.sql.catalog) >

[jira] [Resolved] (SPARK-46298) Test catalog error classes (pyspark.sql.catalog)

[ https://issues.apache.org/jira/browse/SPARK-46298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46298. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44226

[jira] [Updated] (SPARK-46058) [CORE] Add separate flag for privateKeyPassword

[ https://issues.apache.org/jira/browse/SPARK-46058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-46058: Labels: pull-request-available (was: pull-request-available releasenotes) >

[jira] [Updated] (SPARK-46058) [CORE] Add separate flag for privateKeyPassword

[ https://issues.apache.org/jira/browse/SPARK-46058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-46058: Labels: pull-request-available releasenotes (was: pull-request-available) >

[jira] [Assigned] (SPARK-46301) Support `spark.worker.(initial|max)RegistrationRetries`

[ https://issues.apache.org/jira/browse/SPARK-46301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46301: - Assignee: Dongjoon Hyun > Support `spark.worker.(initial|max)RegistrationRetries` >

[jira] [Resolved] (SPARK-46296) Test captured errors (pyspark.errors.exceptions.captured)

[ https://issues.apache.org/jira/browse/SPARK-46296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46296. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44224

[jira] [Created] (SPARK-46301) Support `spark.worker.(initial|max)RegistrationRetries`

Dongjoon Hyun created SPARK-46301: - Summary: Support `spark.worker.(initial|max)RegistrationRetries` Key: SPARK-46301 URL: https://issues.apache.org/jira/browse/SPARK-46301 Project: Spark

[jira] [Updated] (SPARK-46301) Support `spark.worker.(initial|max)RegistrationRetries`

[ https://issues.apache.org/jira/browse/SPARK-46301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46301: --- Labels: pull-request-available (was: ) > Support

[jira] [Assigned] (SPARK-46296) Test captured errors (pyspark.errors.exceptions.captured)

[ https://issues.apache.org/jira/browse/SPARK-46296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46296: Assignee: Hyukjin Kwon > Test captured errors (pyspark.errors.exceptions.captured) >

[jira] [Updated] (SPARK-46300) Test missing test coverage for Column (pyspark.sql.column)

[ https://issues.apache.org/jira/browse/SPARK-46300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46300: --- Labels: pull-request-available (was: ) > Test missing test coverage for Column

[jira] [Created] (SPARK-46300) Test missing test coverage for Column (pyspark.sql.column)

Hyukjin Kwon created SPARK-46300: Summary: Test missing test coverage for Column (pyspark.sql.column) Key: SPARK-46300 URL: https://issues.apache.org/jira/browse/SPARK-46300 Project: Spark

[jira] [Updated] (SPARK-46299) Make `spark.deploy.recovery*` documentation up-to-date

[ https://issues.apache.org/jira/browse/SPARK-46299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46299: -- Summary: Make `spark.deploy.recovery*` documentation up-to-date (was: Make

[jira] [Updated] (SPARK-45580) Subquery changes the output schema of the outer query

[ https://issues.apache.org/jira/browse/SPARK-45580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45580: -- Fix Version/s: 3.3.4 > Subquery changes the output schema of the outer query >

[jira] [Updated] (SPARK-45580) Subquery changes the output schema of the outer query

[ https://issues.apache.org/jira/browse/SPARK-45580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45580: -- Fix Version/s: 3.4.3 > Subquery changes the output schema of the outer query >

[jira] [Resolved] (SPARK-46299) Make `spark.deploy.recovery*` up-to-date

[ https://issues.apache.org/jira/browse/SPARK-46299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46299. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44227

[jira] [Created] (SPARK-46299) Make `spark.deploy.recovery*` up-to-date

Dongjoon Hyun created SPARK-46299: - Summary: Make `spark.deploy.recovery*` up-to-date Key: SPARK-46299 URL: https://issues.apache.org/jira/browse/SPARK-46299 Project: Spark Issue Type:

[jira] [Updated] (SPARK-46299) Make `spark.deploy.recovery*` up-to-date

[ https://issues.apache.org/jira/browse/SPARK-46299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46299: --- Labels: pull-request-available (was: ) > Make `spark.deploy.recovery*` up-to-date >

[jira] [Updated] (SPARK-46298) Test catalog error classes (pyspark.sql.catalog)

[ https://issues.apache.org/jira/browse/SPARK-46298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46298: --- Labels: pull-request-available (was: ) > Test catalog error classes (pyspark.sql.catalog)

[jira] [Assigned] (SPARK-46297) Exclude generated files from the code coverage report

[ https://issues.apache.org/jira/browse/SPARK-46297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46297: Assignee: Hyukjin Kwon > Exclude generated files from the code coverage report >

[jira] [Resolved] (SPARK-46297) Exclude generated files from the code coverage report

[ https://issues.apache.org/jira/browse/SPARK-46297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46297. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44225

[jira] [Created] (SPARK-46298) Test catalog error classes (pyspark.sql.catalog)

Hyukjin Kwon created SPARK-46298: Summary: Test catalog error classes (pyspark.sql.catalog) Key: SPARK-46298 URL: https://issues.apache.org/jira/browse/SPARK-46298 Project: Spark Issue Type:

[jira] [Updated] (SPARK-46296) Test captured errors (pyspark.errors.exceptions.captured)

[ https://issues.apache.org/jira/browse/SPARK-46296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46296: - Summary: Test captured errors (pyspark.errors.exceptions.captured) (was: Test captured errors

[jira] [Updated] (SPARK-46297) Exclude generated files from the code coverage report

[ https://issues.apache.org/jira/browse/SPARK-46297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46297: --- Labels: pull-request-available (was: ) > Exclude generated files from the code coverage

[jira] [Created] (SPARK-46297) Exclude generated files from the code coverage report

Hyukjin Kwon created SPARK-46297: Summary: Exclude generated files from the code coverage report Key: SPARK-46297 URL: https://issues.apache.org/jira/browse/SPARK-46297 Project: Spark Issue

[jira] [Updated] (SPARK-46296) Test captured errors of TestResult (pyspark.errors.exceptions.captured)

[ https://issues.apache.org/jira/browse/SPARK-46296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46296: --- Labels: pull-request-available (was: ) > Test captured errors of TestResult

[jira] [Created] (SPARK-46296) Test captured errors of TestResult (pyspark.errors.exceptions.captured)

Hyukjin Kwon created SPARK-46296: Summary: Test captured errors of TestResult (pyspark.errors.exceptions.captured) Key: SPARK-46296 URL: https://issues.apache.org/jira/browse/SPARK-46296 Project:

[jira] [Resolved] (SPARK-46058) [CORE] Add separate flag for privateKeyPassword

[ https://issues.apache.org/jira/browse/SPARK-46058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-46058. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request

[jira] [Assigned] (SPARK-46058) [CORE] Add separate flag for privateKeyPassword

[ https://issues.apache.org/jira/browse/SPARK-46058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-46058: --- Assignee: Hasnain Lakhani > [CORE] Add separate flag for

[jira] [Assigned] (SPARK-46292) Show a summary of workers in MasterPage

[ https://issues.apache.org/jira/browse/SPARK-46292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46292: - Assignee: Dongjoon Hyun > Show a summary of workers in MasterPage >

[jira] [Resolved] (SPARK-46292) Show a summary of workers in MasterPage

[ https://issues.apache.org/jira/browse/SPARK-46292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46292. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44218

[jira] [Assigned] (SPARK-46290) Change saveMode to overwrite for DataSourceWriter constructor

[ https://issues.apache.org/jira/browse/SPARK-46290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46290: Assignee: Allison Wang > Change saveMode to overwrite for DataSourceWriter constructor >

[jira] [Resolved] (SPARK-46290) Change saveMode to overwrite for DataSourceWriter constructor

[ https://issues.apache.org/jira/browse/SPARK-46290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46290. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44216

[jira] [Updated] (SPARK-46295) TPCDS q39a and a39b have correctness issues with broadcast hash join and shuffled hash join

[ https://issues.apache.org/jira/browse/SPARK-46295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuyuki Tanimura updated SPARK-46295: -- Affects Version/s: 3.4.2 (was: 3.4.1) > TPCDS q39a and

[jira] [Updated] (SPARK-46295) TPCDS q39a and a39b have correctness issues with broadcast hash join and shuffled hash join

[ https://issues.apache.org/jira/browse/SPARK-46295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuyuki Tanimura updated SPARK-46295: -- Labels: correctness (was: ) > TPCDS q39a and a39b have correctness issues with

[jira] [Updated] (SPARK-46294) Clean up initValue vs zeroValue semantics in SQLMetrics

[ https://issues.apache.org/jira/browse/SPARK-46294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46294: --- Labels: pull-request-available (was: ) > Clean up initValue vs zeroValue semantics in

[jira] [Created] (SPARK-46295) TPCDS q39a and a39b have correctness issues with broadcast hash join and shuffled hash join

Kazuyuki Tanimura created SPARK-46295: - Summary: TPCDS q39a and a39b have correctness issues with broadcast hash join and shuffled hash join Key: SPARK-46295 URL:

[jira] [Created] (SPARK-46294) Clean up initValue vs zeroValue semantics in SQLMetrics

Davin Tjong created SPARK-46294: --- Summary: Clean up initValue vs zeroValue semantics in SQLMetrics Key: SPARK-46294 URL: https://issues.apache.org/jira/browse/SPARK-46294 Project: Spark Issue

[jira] [Updated] (SPARK-46294) Clean up initValue vs zeroValue semantics in SQLMetrics

[ https://issues.apache.org/jira/browse/SPARK-46294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davin Tjong updated SPARK-46294: Component/s: SQL (was: Spark Core) > Clean up initValue vs zeroValue

[jira] [Updated] (SPARK-44976) Preserve full principal user name on executor side

[ https://issues.apache.org/jira/browse/SPARK-44976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44976: --- Labels: pull-request-available (was: ) > Preserve full principal user name on executor

[jira] [Updated] (SPARK-46293) Add protobuf to required dependency for Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-46293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46293: --- Labels: pull-request-available (was: ) > Add protobuf to required dependency for Spark

[jira] [Created] (SPARK-46293) Add protobuf to required dependency for Spark Connect

Haejoon Lee created SPARK-46293: --- Summary: Add protobuf to required dependency for Spark Connect Key: SPARK-46293 URL: https://issues.apache.org/jira/browse/SPARK-46293 Project: Spark Issue

[jira] [Updated] (SPARK-45580) Subquery changes the output schema of the outer query

[ https://issues.apache.org/jira/browse/SPARK-45580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45580: -- Fix Version/s: 3.5.1 > Subquery changes the output schema of the outer query >

[jira] [Assigned] (SPARK-46274) Range operator computeStats() proper long conversions

[ https://issues.apache.org/jira/browse/SPARK-46274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46274: --- Assignee: Kelvin Jiang > Range operator computeStats() proper long conversions >

[jira] [Resolved] (SPARK-46274) Range operator computeStats() proper long conversions

[ https://issues.apache.org/jira/browse/SPARK-46274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46274. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Created] (SPARK-46292) Show a summary of workers in MasterPage

Dongjoon Hyun created SPARK-46292: - Summary: Show a summary of workers in MasterPage Key: SPARK-46292 URL: https://issues.apache.org/jira/browse/SPARK-46292 Project: Spark Issue Type:

[jira] [Updated] (SPARK-46292) Show a summary of workers in MasterPage

[ https://issues.apache.org/jira/browse/SPARK-46292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46292: --- Labels: pull-request-available (was: ) > Show a summary of workers in MasterPage >

[jira] [Updated] (SPARK-46290) Change saveMode to overwrite for DataSourceWriter constructor

[ https://issues.apache.org/jira/browse/SPARK-46290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46290: --- Labels: pull-request-available (was: ) > Change saveMode to overwrite for DataSourceWriter

[jira] [Updated] (SPARK-46291) Koalas Testing Migration

[ https://issues.apache.org/jira/browse/SPARK-46291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-46291: - Description: Test migration from Koalas to Spark repository, including setting up the testing

[jira] [Updated] (SPARK-46291) Koalas Testing Migration

[ https://issues.apache.org/jira/browse/SPARK-46291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-46291: - Summary: Koalas Testing Migration (was: Testing migration) > Koalas Testing Migration >

[jira] [Assigned] (SPARK-46291) Testing migration

[ https://issues.apache.org/jira/browse/SPARK-46291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng reassigned SPARK-46291: Assignee: Xinrong Meng > Testing migration > - > > Key:

[jira] [Resolved] (SPARK-46291) Testing migration

[ https://issues.apache.org/jira/browse/SPARK-46291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-46291. -- Resolution: Done > Testing migration > - > > Key: SPARK-46291

[jira] [Updated] (SPARK-34999) Consolidate PySpark testing utils

[ https://issues.apache.org/jira/browse/SPARK-34999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-34999: - Parent Issue: SPARK-46291 (was: SPARK-34849) > Consolidate PySpark testing utils >

[jira] [Updated] (SPARK-35012) Port Koalas DataFrame related unit tests into PySpark

[ https://issues.apache.org/jira/browse/SPARK-35012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-35012: - Parent Issue: SPARK-46291 (was: SPARK-34849) > Port Koalas DataFrame related unit tests into

[jira] [Updated] (SPARK-35300) Standardize module name in install.rst

[ https://issues.apache.org/jira/browse/SPARK-35300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-35300: - Parent Issue: SPARK-46291 (was: SPARK-34849) > Standardize module name in install.rst >

[jira] [Updated] (SPARK-35034) Port Koalas miscellaneous unit tests into PySpark

[ https://issues.apache.org/jira/browse/SPARK-35034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-35034: - Parent Issue: SPARK-46291 (was: SPARK-34849) > Port Koalas miscellaneous unit tests into

[jira] [Updated] (SPARK-35035) Port Koalas internal implementation unit tests into PySpark

[ https://issues.apache.org/jira/browse/SPARK-35035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-35035: - Parent Issue: SPARK-46291 (was: SPARK-34849) > Port Koalas internal implementation unit tests

[jira] [Updated] (SPARK-35040) Remove Spark-version related codes from test codes.

[ https://issues.apache.org/jira/browse/SPARK-35040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-35040: - Parent Issue: SPARK-46291 (was: SPARK-34849) > Remove Spark-version related codes from test

[jira] [Updated] (SPARK-35098) Revisit pandas-on-Spark test cases that are disabled because of pandas nondeterministic return values

[ https://issues.apache.org/jira/browse/SPARK-35098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-35098: - Parent Issue: SPARK-46291 (was: SPARK-34849) > Revisit pandas-on-Spark test cases that are

[jira] [Updated] (SPARK-35033) Port Koalas plot unit tests into PySpark

[ https://issues.apache.org/jira/browse/SPARK-35033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-35033: - Parent Issue: SPARK-46291 (was: SPARK-34849) > Port Koalas plot unit tests into PySpark >

[jira] [Updated] (SPARK-35032) Port Koalas Index unit tests into PySpark

[ https://issues.apache.org/jira/browse/SPARK-35032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-35032: - Parent Issue: SPARK-46291 (was: SPARK-34849) > Port Koalas Index unit tests into PySpark >

[jira] [Updated] (SPARK-35031) Port Koalas operations on different frames tests into PySpark

[ https://issues.apache.org/jira/browse/SPARK-35031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-35031: - Parent Issue: SPARK-46291 (was: SPARK-34849) > Port Koalas operations on different frames

[jira] [Updated] (SPARK-34996) Port Koalas Series related unit tests into PySpark

[ https://issues.apache.org/jira/browse/SPARK-34996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-34996: - Parent Issue: SPARK-46291 (was: SPARK-34849) > Port Koalas Series related unit tests into

[jira] [Updated] (SPARK-34887) Port/integrate Koalas dependencies into PySpark

[ https://issues.apache.org/jira/browse/SPARK-34887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-34887: - Parent Issue: SPARK-46291 (was: SPARK-34849) > Port/integrate Koalas dependencies into PySpark

[jira] [Updated] (SPARK-34886) Port/integrate Koalas DataFrame unit test into PySpark

[ https://issues.apache.org/jira/browse/SPARK-34886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-34886: - Parent Issue: SPARK-46291 (was: SPARK-34849) > Port/integrate Koalas DataFrame unit test into

[jira] [Created] (SPARK-46291) Testing migration

Xinrong Meng created SPARK-46291: Summary: Testing migration Key: SPARK-46291 URL: https://issues.apache.org/jira/browse/SPARK-46291 Project: Spark Issue Type: Umbrella Components:

[jira] [Updated] (SPARK-46275) Protobuf: Permissive mode should return null rather than struct with null fields

[ https://issues.apache.org/jira/browse/SPARK-46275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46275: --- Labels: pull-request-available (was: ) > Protobuf: Permissive mode should return null

[jira] [Resolved] (SPARK-45580) Subquery changes the output schema of the outer query

[ https://issues.apache.org/jira/browse/SPARK-45580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45580. --- Fix Version/s: 4.0.0 Resolution: Fixed > Subquery changes the output schema of the

[jira] [Assigned] (SPARK-46230) Migrate RetriesExceeded into PySpark error.

[ https://issues.apache.org/jira/browse/SPARK-46230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46230: - Assignee: Haejoon Lee > Migrate RetriesExceeded into PySpark error. >

[jira] [Resolved] (SPARK-46230) Migrate RetriesExceeded into PySpark error.

[ https://issues.apache.org/jira/browse/SPARK-46230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46230. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44147

[jira] [Resolved] (SPARK-46270) Use java14 instanceof expressions to replace the java8 instanceof statement

[ https://issues.apache.org/jira/browse/SPARK-46270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46270. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44187

[jira] [Created] (SPARK-46290) Change saveMode to overwrite for DataSourceWriter constructor

Allison Wang created SPARK-46290: Summary: Change saveMode to overwrite for DataSourceWriter constructor Key: SPARK-46290 URL: https://issues.apache.org/jira/browse/SPARK-46290 Project: Spark

[jira] [Assigned] (SPARK-45580) Subquery changes the output schema of the outer query

[ https://issues.apache.org/jira/browse/SPARK-45580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45580: - Assignee: Bruce Robbins > Subquery changes the output schema of the outer query >

[jira] [Updated] (SPARK-45580) Subquery changes the output schema of the outer query

[ https://issues.apache.org/jira/browse/SPARK-45580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45580: -- Target Version/s: 3.3.4 > Subquery changes the output schema of the outer query >

[jira] [Updated] (SPARK-45580) Subquery changes the output schema of the outer query

[ https://issues.apache.org/jira/browse/SPARK-45580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45580: -- Labels: correctness pull-request-available (was: pull-request-available) > Subquery changes

[jira] [Updated] (SPARK-45580) Subquery changes the output schema of the outer query

[ https://issues.apache.org/jira/browse/SPARK-45580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45580: -- Priority: Blocker (was: Major) > Subquery changes the output schema of the outer query >

[jira] [Commented] (SPARK-45580) Subquery changes the output schema of the outer query

[ https://issues.apache.org/jira/browse/SPARK-45580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17793889#comment-17793889 ] Dongjoon Hyun commented on SPARK-45580: --- I raised this issue to the blocker for Apache Spark

[jira] [Commented] (SPARK-45580) Subquery changes the output schema of the outer query

[ https://issues.apache.org/jira/browse/SPARK-45580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17793888#comment-17793888 ] Dongjoon Hyun commented on SPARK-45580: --- Thank you, [~bersprockets]. > Subquery changes the

[jira] [Resolved] (SPARK-46283) Avoid testing the `streaming-kinesis-asl` module in the daily tests of branch-3.x.

[ https://issues.apache.org/jira/browse/SPARK-46283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46283. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44204

[jira] [Resolved] (SPARK-46286) Document spark.io.compression.zstd.bufferPool.enabled

[ https://issues.apache.org/jira/browse/SPARK-46286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46286. --- Fix Version/s: 3.3.4 3.4.3 3.5.1

[jira] [Assigned] (SPARK-46286) Document spark.io.compression.zstd.bufferPool.enabled

[ https://issues.apache.org/jira/browse/SPARK-46286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46286: - Assignee: Kent Yao > Document spark.io.compression.zstd.bufferPool.enabled >

[jira] [Resolved] (SPARK-46287) DataFrame.isEmpty should work with all datatypes

[ https://issues.apache.org/jira/browse/SPARK-46287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46287. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44209

[jira] [Assigned] (SPARK-46288) Remove unused code in `pyspark.pandas.tests.frame.*`

[ https://issues.apache.org/jira/browse/SPARK-46288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46288: - Assignee: Ruifeng Zheng > Remove unused code in `pyspark.pandas.tests.frame.*` >

[jira] [Resolved] (SPARK-46288) Remove unused code in `pyspark.pandas.tests.frame.*`

[ https://issues.apache.org/jira/browse/SPARK-46288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46288. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44212

[jira] [Updated] (SPARK-46273) Support INSERT INTO/OVERWRITE using DSv2 sources

[ https://issues.apache.org/jira/browse/SPARK-46273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46273: --- Labels: pull-request-available (was: ) > Support INSERT INTO/OVERWRITE using DSv2 sources

[jira] [Updated] (SPARK-46289) Exception when ordering by UDT in interpreted mode

[ https://issues.apache.org/jira/browse/SPARK-46289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-46289: -- Affects Version/s: 3.3.3 > Exception when ordering by UDT in interpreted mode >

[jira] [Created] (SPARK-46289) Exception when ordering by UDT in interpreted mode

Bruce Robbins created SPARK-46289: - Summary: Exception when ordering by UDT in interpreted mode Key: SPARK-46289 URL: https://issues.apache.org/jira/browse/SPARK-46289 Project: Spark Issue

[jira] [Assigned] (SPARK-46173) Skipping trimAll call in stringToDate functions to avoid needless string copy

[ https://issues.apache.org/jira/browse/SPARK-46173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46173: --- Assignee: Aleksandar Tomic > Skipping trimAll call in stringToDate functions to avoid

[jira] [Resolved] (SPARK-46173) Skipping trimAll call in stringToDate functions to avoid needless string copy

[ https://issues.apache.org/jira/browse/SPARK-46173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46173. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44110

[jira] [Assigned] (SPARK-45888) Apply error class framework to state data source & state metadata data source

[ https://issues.apache.org/jira/browse/SPARK-45888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-45888: Assignee: Jungtaek Lim > Apply error class framework to state data source & state

[jira] [Resolved] (SPARK-45888) Apply error class framework to state data source & state metadata data source

[ https://issues.apache.org/jira/browse/SPARK-45888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-45888. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44025

[jira] [Updated] (SPARK-46288) Remove unused code in `pyspark.pandas.tests.frame.*`

[ https://issues.apache.org/jira/browse/SPARK-46288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46288: --- Labels: pull-request-available (was: ) > Remove unused code in

[jira] [Created] (SPARK-46288) Remove unused code in `pyspark.pandas.tests.frame.*`

Ruifeng Zheng created SPARK-46288: - Summary: Remove unused code in `pyspark.pandas.tests.frame.*` Key: SPARK-46288 URL: https://issues.apache.org/jira/browse/SPARK-46288 Project: Spark Issue

[jira] [Updated] (SPARK-45720) Upgrade AWS SDK to v2 for Spark Kinesis connector

[ https://issues.apache.org/jira/browse/SPARK-45720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45720: --- Labels: pull-request-available (was: ) > Upgrade AWS SDK to v2 for Spark Kinesis connector

[jira] [Updated] (SPARK-46287) DataFrame.isEmpty should work with all datatypes

[ https://issues.apache.org/jira/browse/SPARK-46287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46287: --- Labels: pull-request-available (was: ) > DataFrame.isEmpty should work with all datatypes

  1   2   >