[jira] [Resolved] (SPARK-47140) Upgrade codecov/codecov-action from v2 to v4 in GitHub Actions

2024-02-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47140. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45227

[jira] [Resolved] (SPARK-47142) Use `spark.jars.ivy` instead `spark.driver.extraJavaOptions` in `DepsTestsSuite`

2024-02-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47142. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45229

[jira] [Updated] (SPARK-47143) Improve `ArtifactSuite` to use unique `MavenCoordinate`s

2024-02-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47143: -- Summary: Improve `ArtifactSuite` to use unique `MavenCoordinate`s (was: Fix `ArtifactSuite`

[jira] [Updated] (SPARK-47143) Fix `ArtifactSuite` to use unique `MavenCoordinate`s

2024-02-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47143: -- Summary: Fix `ArtifactSuite` to use unique `MavenCoordinate`s (was: Fix `ArtifactSuite` to

[jira] [Assigned] (SPARK-47142) Use `spark.jars.ivy` instead `spark.driver.extraJavaOptions` in `DepsTestsSuite`

2024-02-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47142: - Assignee: Dongjoon Hyun > Use `spark.jars.ivy` instead `spark.driver.extraJavaOptions`

[jira] [Updated] (SPARK-47142) Use `spark.jars.ivy` instead `spark.driver.extraJavaOptions` in `DepsTestsSuite`

2024-02-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47142: --- Labels: pull-request-available (was: ) > Use `spark.jars.ivy` instead

[jira] [Created] (SPARK-47142) Use `spark.jars.ivy` instead `spark.driver.extraJavaOptions` in `DepsTestsSuite`

2024-02-22 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47142: - Summary: Use `spark.jars.ivy` instead `spark.driver.extraJavaOptions` in `DepsTestsSuite` Key: SPARK-47142 URL: https://issues.apache.org/jira/browse/SPARK-47142

[jira] [Resolved] (SPARK-47137) Add getAll to spark.conf for feature parity with Scala

2024-02-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47137. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45222

[jira] [Assigned] (SPARK-47137) Add getAll to spark.conf for feature parity with Scala

2024-02-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47137: - Assignee: Takuya Ueshin > Add getAll to spark.conf for feature parity with Scala >

[jira] [Updated] (SPARK-47141) Support shuffle migration to external storage

2024-02-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47141: --- Labels: pull-request-available (was: ) > Support shuffle migration to external storage >

[jira] [Created] (SPARK-47141) Support shuffle migration to external storage

2024-02-22 Thread mahesh kumar behera (Jira)
mahesh kumar behera created SPARK-47141: --- Summary: Support shuffle migration to external storage Key: SPARK-47141 URL: https://issues.apache.org/jira/browse/SPARK-47141 Project: Spark

[jira] [Assigned] (SPARK-47130) Use listStatus to bypass block location info when cleaning driver logs

2024-02-22 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-47130: Assignee: Kent Yao > Use listStatus to bypass block location info when cleaning driver logs >

[jira] [Resolved] (SPARK-47130) Use listStatus to bypass block location info when cleaning driver logs

2024-02-22 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-47130. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45215

[jira] [Created] (SPARK-47140) Upgrade codecov/codecov-action from v2 to v4 in GitHub Actions

2024-02-22 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-47140: Summary: Upgrade codecov/codecov-action from v2 to v4 in GitHub Actions Key: SPARK-47140 URL: https://issues.apache.org/jira/browse/SPARK-47140 Project: Spark

[jira] [Created] (SPARK-47139) Upgrade Python version used in coverage report

2024-02-22 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-47139: Summary: Upgrade Python version used in coverage report Key: SPARK-47139 URL: https://issues.apache.org/jira/browse/SPARK-47139 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-47123) JDBCRDD does not correctly handle errors in getQueryOutputSchema

2024-02-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47123. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45209

[jira] [Assigned] (SPARK-47123) JDBCRDD does not correctly handle errors in getQueryOutputSchema

2024-02-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47123: Assignee: Pablo Langa Blanco > JDBCRDD does not correctly handle errors in

[jira] [Reopened] (SPARK-47115) Use larger memory for Maven builds

2024-02-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-47115: -- Assignee: (was: Hyukjin Kwon) > Use larger memory for Maven builds >

[jira] [Updated] (SPARK-47115) Use larger memory for Maven builds

2024-02-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47115: - Fix Version/s: (was: 4.0.0) > Use larger memory for Maven builds >

[jira] [Resolved] (SPARK-47115) Use larger memory for Maven builds

2024-02-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47115. -- Resolution: Invalid it doesn't help. reverted > Use larger memory for Maven builds >

[jira] [Resolved] (SPARK-47136) Fix `MavenUtilsSuite` to use `MavenUtils.resolveMavenCoordinates` properly

2024-02-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47136. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45220

[jira] [Assigned] (SPARK-47136) Fix `MavenUtilsSuite` to use `MavenUtils.resolveMavenCoordinates` properly

2024-02-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47136: - Assignee: Dongjoon Hyun > Fix `MavenUtilsSuite` to use

[jira] [Comment Edited] (SPARK-47134) Unexpected nulls when casting decimal values in specific cases

2024-02-22 Thread Dylan Walker (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819834#comment-17819834 ] Dylan Walker edited comment on SPARK-47134 at 2/22/24 10:32 PM:

[jira] [Commented] (SPARK-47134) Unexpected nulls when casting decimal values in specific cases

2024-02-22 Thread Dylan Walker (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819834#comment-17819834 ] Dylan Walker commented on SPARK-47134: -- [~bersprockets] Hmm, it's possible I may have made too

[jira] [Updated] (SPARK-47137) Add getAll to spark.conf for feature parity with Scala

2024-02-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47137: --- Labels: pull-request-available (was: ) > Add getAll to spark.conf for feature parity with

[jira] [Updated] (SPARK-47135) Implement error classes for Kafka data loss exceptions

2024-02-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47135: --- Labels: pull-request-available (was: ) > Implement error classes for Kafka data loss

[jira] [Comment Edited] (SPARK-46762) Spark Connect 3.5 Classloading issue with external jar

2024-02-22 Thread nirav patel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819830#comment-17819830 ] nirav patel edited comment on SPARK-46762 at 2/22/24 10:13 PM: --- I did some

[jira] [Comment Edited] (SPARK-46762) Spark Connect 3.5 Classloading issue with external jar

2024-02-22 Thread nirav patel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819830#comment-17819830 ] nirav patel edited comment on SPARK-46762 at 2/22/24 10:11 PM: --- I did some

[jira] [Updated] (SPARK-46762) Spark Connect 3.5 Classloading issue with external jar

2024-02-22 Thread nirav patel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nirav patel updated SPARK-46762: Attachment: Screenshot 2024-02-22 at 2.04.49 PM.png Screenshot 2024-02-22 at

[jira] [Commented] (SPARK-46762) Spark Connect 3.5 Classloading issue with external jar

2024-02-22 Thread nirav patel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819830#comment-17819830 ] nirav patel commented on SPARK-46762: - I did some more digging into executor classloading and heap

[jira] [Updated] (SPARK-47137) Add getAll to spark.conf for feature parity with Scala

2024-02-22 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-47137: -- Summary: Add getAll to spark.conf for feature parity with Scala (was: Add getAll for

[jira] [Updated] (SPARK-47137) Add getAll for spark.conf for feature parity with Scala

2024-02-22 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-47137: -- Summary: Add getAll for spark.conf for feature parity with Scala (was: Add getAll for

[jira] [Created] (SPARK-47137) Add getAll for pyspark.sql.conf for feature parity with Scala

2024-02-22 Thread Takuya Ueshin (Jira)
Takuya Ueshin created SPARK-47137: - Summary: Add getAll for pyspark.sql.conf for feature parity with Scala Key: SPARK-47137 URL: https://issues.apache.org/jira/browse/SPARK-47137 Project: Spark

[jira] [Updated] (SPARK-47136) Fix `MavenUtilsSuite` to use `MavenUtils.resolveMavenCoordinates` properly

2024-02-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47136: -- Summary: Fix `MavenUtilsSuite` to use `MavenUtils.resolveMavenCoordinates` properly (was:

[jira] [Updated] (SPARK-47136) Use `ivyPath` param of `MavenUtils.loadIvySettings` in `MavenUtilsSuite`

2024-02-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47136: -- Component/s: Tests > Use `ivyPath` param of `MavenUtils.loadIvySettings` in `MavenUtilsSuite`

[jira] [Updated] (SPARK-47136) Use `ivyPath` param of `MavenUtils.loadIvySettings` in `MavenUtilsSuite`

2024-02-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47136: --- Labels: pull-request-available (was: ) > Use `ivyPath` param of

[jira] [Updated] (SPARK-47136) Use `ivyPath` param of `MavenUtils.loadIvySettings` in `MavenUtilsSuite`

2024-02-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47136: -- Summary: Use `ivyPath` param of `MavenUtils.loadIvySettings` in `MavenUtilsSuite` (was: Use

[jira] [Created] (SPARK-47136) Use `ivyPath` parameter of `MavenUtils.loadIvySettings` in `MavenUtilsSuite`

2024-02-22 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-47136: - Summary: Use `ivyPath` parameter of `MavenUtils.loadIvySettings` in `MavenUtilsSuite` Key: SPARK-47136 URL: https://issues.apache.org/jira/browse/SPARK-47136

[jira] [Resolved] (SPARK-47069) Introduce `spark.profile.show/dump` for SparkSession-based profiling

2024-02-22 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-47069. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45129

[jira] [Commented] (SPARK-47134) Unexpected nulls when casting decimal values in specific cases

2024-02-22 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819789#comment-17819789 ] Bruce Robbins commented on SPARK-47134: --- Oddly, I cannot reproduce on either 3.4.1 or 3.5.0.

[jira] [Comment Edited] (SPARK-47132) Mistake in Docstring for Pyspark's Dataframe.head()

2024-02-22 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819779#comment-17819779 ] Xinrong Meng edited comment on SPARK-47132 at 2/22/24 7:21 PM: ---

[jira] [Commented] (SPARK-47132) Mistake in Docstring for Pyspark's Dataframe.head()

2024-02-22 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819779#comment-17819779 ] Xinrong Meng commented on SPARK-47132: -- [~wunderalbert] would you double check if you set up your

[jira] [Commented] (SPARK-47132) Mistake in Docstring for Pyspark's Dataframe.head()

2024-02-22 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819780#comment-17819780 ] Xinrong Meng commented on SPARK-47132: -- Resolved by https://github.com/apache/spark/pull/45197. >

[jira] [Updated] (SPARK-47132) Mistake in Docstring for Pyspark's Dataframe.head()

2024-02-22 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-47132: - Attachment: image-2024-02-22-11-18-02-429.png > Mistake in Docstring for Pyspark's

[jira] [Updated] (SPARK-47132) Mistake in Docstring for Pyspark's Dataframe.head()

2024-02-22 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-47132: - Issue Type: Documentation (was: Bug) > Mistake in Docstring for Pyspark's Dataframe.head() >

[jira] [Updated] (SPARK-47132) Mistake in Docstring for Pyspark's Dataframe.head()

2024-02-22 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-47132: - Affects Version/s: 4.0.0 (was: 3.5.0) > Mistake in Docstring for

[jira] [Commented] (SPARK-47132) Mistake in Docstring for Pyspark's Dataframe.head()

2024-02-22 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819777#comment-17819777 ] Xinrong Meng commented on SPARK-47132: -- I modified the ticket to Documentation (from Bug) and 4.0.0

[jira] [Commented] (SPARK-47135) Implement error classes for Kafka data loss exceptions

2024-02-22 Thread B. Micheal Okutubo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819771#comment-17819771 ] B. Micheal Okutubo commented on SPARK-47135: I'm working on this. Will send PR soon. >

[jira] [Created] (SPARK-47135) Implement error classes for Kafka data loss exceptions

2024-02-22 Thread B. Micheal Okutubo (Jira)
B. Micheal Okutubo created SPARK-47135: -- Summary: Implement error classes for Kafka data loss exceptions Key: SPARK-47135 URL: https://issues.apache.org/jira/browse/SPARK-47135 Project: Spark

[jira] [Updated] (SPARK-47001) Pushdown Verification in Optimizer.scala should support changed data types

2024-02-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47001: --- Labels: pull-request-available (was: ) > Pushdown Verification in Optimizer.scala should

[jira] [Updated] (SPARK-47133) java.lang.NullPointerException: Missing SslContextFactory when accessing Worker WebUI from Master as reverse proxy with SSL enabled

2024-02-22 Thread Filippo Monari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Filippo Monari updated SPARK-47133: --- Environment: * We are running Spark in stand-alone mode, on Kubernetes. * The containers

[jira] [Updated] (SPARK-47134) Unexpected nulls when casting decimal values in specific cases

2024-02-22 Thread Dylan Walker (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dylan Walker updated SPARK-47134: - Attachment: 321queryplan.txt > Unexpected nulls when casting decimal values in specific cases >

[jira] [Updated] (SPARK-47134) Unexpected nulls when casting decimal values in specific cases

2024-02-22 Thread Dylan Walker (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dylan Walker updated SPARK-47134: - Attachment: 341queryplan.txt > Unexpected nulls when casting decimal values in specific cases >

[jira] [Updated] (SPARK-47134) Unexpected nulls when casting decimal values in specific cases

2024-02-22 Thread Dylan Walker (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dylan Walker updated SPARK-47134: - Description: In specific cases, casting decimal values can result in `null` values where no

[jira] [Updated] (SPARK-47134) Unexpected nulls when casting decimal values in specific cases

2024-02-22 Thread Dylan Walker (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dylan Walker updated SPARK-47134: - Description: In specific cases, casting decimal values can result in `null` values where no

[jira] [Updated] (SPARK-47133) java.lang.NullPointerException: Missing SslContextFactory when accessing Worker WebUI from Master as reverse proxy with SSL enabled

2024-02-22 Thread Filippo Monari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Filippo Monari updated SPARK-47133: --- Summary: java.lang.NullPointerException: Missing SslContextFactory when accessing Worker

[jira] [Updated] (SPARK-47133) java.lang.NullPointerException: Missing SslContextFactory when accessing Worker WebUI from Master as reverse proxy

2024-02-22 Thread Filippo Monari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Filippo Monari updated SPARK-47133: --- Description: Hi,   We are encountering the error described here below. If SSL/TLS is

[jira] [Updated] (SPARK-47134) Unexpected nulls when casting decimal values in specific cases

2024-02-22 Thread Dylan Walker (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dylan Walker updated SPARK-47134: - Description: In specific cases, casting decimal values can result in `null` values where no

[jira] [Updated] (SPARK-47134) Unexpected nulls when casting decimal values in specific cases

2024-02-22 Thread Dylan Walker (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dylan Walker updated SPARK-47134: - Description: In specific cases, casting decimal values can result in `null` values where no

[jira] [Updated] (SPARK-47133) java.lang.NullPointerException: Missing SslContextFactory when accessing Worker WebUI from Master as reverse proxy

2024-02-22 Thread Filippo Monari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Filippo Monari updated SPARK-47133: --- Description: Hi,   We are encountering the error described here below. If SSL/TLS is

[jira] [Created] (SPARK-47134) Unexpected nulls when casting decimal values in specific cases

2024-02-22 Thread Dylan Walker (Jira)
Dylan Walker created SPARK-47134: Summary: Unexpected nulls when casting decimal values in specific cases Key: SPARK-47134 URL: https://issues.apache.org/jira/browse/SPARK-47134 Project: Spark

[jira] [Created] (SPARK-47133) java.lang.NullPointerException: Missing SslContextFactory when accessing Worker WebUI from Master as reverse proxy

2024-02-22 Thread Filippo Monari (Jira)
Filippo Monari created SPARK-47133: -- Summary: java.lang.NullPointerException: Missing SslContextFactory when accessing Worker WebUI from Master as reverse proxy Key: SPARK-47133 URL:

[jira] [Updated] (SPARK-47133) java.lang.NullPointerException: Missing SslContextFactory when accessing Worker WebUI from Master as reverse proxy

2024-02-22 Thread Filippo Monari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Filippo Monari updated SPARK-47133: --- Description: Hi, we are encountering the error described here below. If SSL/TLS is

[jira] [Assigned] (SPARK-43259) Assign a name to the error class _LEGACY_ERROR_TEMP_2024

2024-02-22 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-43259: Assignee: Mihailo Milosevic > Assign a name to the error class _LEGACY_ERROR_TEMP_2024 >

[jira] [Resolved] (SPARK-43259) Assign a name to the error class _LEGACY_ERROR_TEMP_2024

2024-02-22 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-43259. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45095

[jira] [Updated] (SPARK-47131) contains, startswith, endswith

2024-02-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47131: --- Labels: pull-request-available (was: ) > contains, startswith, endswith >

[jira] [Updated] (SPARK-47102) Add COLLATION_ENABLED config flag

2024-02-22 Thread Mihailo Milosevic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihailo Milosevic updated SPARK-47102: -- Description: *What changes were proposed in this pull request?* This PR adds

[jira] [Updated] (SPARK-47102) Add COLLATION_ENABLED config flag

2024-02-22 Thread Mihailo Milosevic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihailo Milosevic updated SPARK-47102: -- Description: ### What changes were proposed in this pull request? This PR adds

[jira] [Updated] (SPARK-47102) Add COLLATION_ENABLED config flag

2024-02-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47102: --- Labels: pull-request-available (was: ) > Add COLLATION_ENABLED config flag >

[jira] [Created] (SPARK-47132) Mistake in Docstring for Pyspark's Dataframe.head()

2024-02-22 Thread Albert Ziegler (Jira)
Albert Ziegler created SPARK-47132: -- Summary: Mistake in Docstring for Pyspark's Dataframe.head() Key: SPARK-47132 URL: https://issues.apache.org/jira/browse/SPARK-47132 Project: Spark

[jira] [Created] (SPARK-47131) contains, startswith, endswith

2024-02-22 Thread Jira
Uroš Bojanić created SPARK-47131: Summary: contains, startswith, endswith Key: SPARK-47131 URL: https://issues.apache.org/jira/browse/SPARK-47131 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-46975) Support dedicated fallback methods

2024-02-22 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-46975: -- Summary: Support dedicated fallback methods (was: Move to_{hdf, feather, stata} to the

[jira] [Assigned] (SPARK-42328) Assign name to _LEGACY_ERROR_TEMP_1175

2024-02-22 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-42328: Assignee: Nikola Mandic > Assign name to _LEGACY_ERROR_TEMP_1175 >

[jira] [Resolved] (SPARK-42328) Assign name to _LEGACY_ERROR_TEMP_1175

2024-02-22 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-42328. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45183

[jira] [Updated] (SPARK-47130) Use listStatus to bypass block location info when cleaning driver logs

2024-02-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47130: --- Labels: pull-request-available (was: ) > Use listStatus to bypass block location info when

[jira] [Updated] (SPARK-47129) Make ResolveRelations cache connect plan properly

2024-02-22 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-47129: -- Summary: Make ResolveRelations cache connect plan properly (was: Make ResolveRelations

[jira] [Created] (SPARK-47130) Use listStatus to bypass block location info when cleaning driver logs

2024-02-22 Thread Kent Yao (Jira)
Kent Yao created SPARK-47130: Summary: Use listStatus to bypass block location info when cleaning driver logs Key: SPARK-47130 URL: https://issues.apache.org/jira/browse/SPARK-47130 Project: Spark

[jira] [Updated] (SPARK-47129) Make ResolveRelations handle planId properly

2024-02-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47129: --- Labels: pull-request-available (was: ) > Make ResolveRelations handle planId properly >

[jira] [Updated] (SPARK-47128) Improve `spark.sql.hive.metastore.sharedPrefixes` default value

2024-02-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47128: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Improve