[
https://issues.apache.org/jira/browse/SPARK-47140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-47140.
--
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 45227
[
https://issues.apache.org/jira/browse/SPARK-47142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-47142.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 45229
[
https://issues.apache.org/jira/browse/SPARK-47143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-47143:
--
Summary: Improve `ArtifactSuite` to use unique `MavenCoordinate`s (was:
Fix `ArtifactSuite`
[
https://issues.apache.org/jira/browse/SPARK-47143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-47143:
--
Summary: Fix `ArtifactSuite` to use unique `MavenCoordinate`s (was: Fix
`ArtifactSuite` to
[
https://issues.apache.org/jira/browse/SPARK-47142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-47142:
-
Assignee: Dongjoon Hyun
> Use `spark.jars.ivy` instead `spark.driver.extraJavaOptions`
[
https://issues.apache.org/jira/browse/SPARK-47142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-47142:
---
Labels: pull-request-available (was: )
> Use `spark.jars.ivy` instead
Dongjoon Hyun created SPARK-47142:
-
Summary: Use `spark.jars.ivy` instead
`spark.driver.extraJavaOptions` in `DepsTestsSuite`
Key: SPARK-47142
URL: https://issues.apache.org/jira/browse/SPARK-47142
[
https://issues.apache.org/jira/browse/SPARK-47137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-47137.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 45222
[
https://issues.apache.org/jira/browse/SPARK-47137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-47137:
-
Assignee: Takuya Ueshin
> Add getAll to spark.conf for feature parity with Scala
>
[
https://issues.apache.org/jira/browse/SPARK-47141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-47141:
---
Labels: pull-request-available (was: )
> Support shuffle migration to external storage
>
mahesh kumar behera created SPARK-47141:
---
Summary: Support shuffle migration to external storage
Key: SPARK-47141
URL: https://issues.apache.org/jira/browse/SPARK-47141
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-47130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kent Yao reassigned SPARK-47130:
Assignee: Kent Yao
> Use listStatus to bypass block location info when cleaning driver logs
>
[
https://issues.apache.org/jira/browse/SPARK-47130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kent Yao resolved SPARK-47130.
--
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 45215
Hyukjin Kwon created SPARK-47140:
Summary: Upgrade codecov/codecov-action from v2 to v4 in GitHub
Actions
Key: SPARK-47140
URL: https://issues.apache.org/jira/browse/SPARK-47140
Project: Spark
Hyukjin Kwon created SPARK-47139:
Summary: Upgrade Python version used in coverage report
Key: SPARK-47139
URL: https://issues.apache.org/jira/browse/SPARK-47139
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-47123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-47123.
--
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 45209
[
https://issues.apache.org/jira/browse/SPARK-47123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-47123:
Assignee: Pablo Langa Blanco
> JDBCRDD does not correctly handle errors in
[
https://issues.apache.org/jira/browse/SPARK-47115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reopened SPARK-47115:
--
Assignee: (was: Hyukjin Kwon)
> Use larger memory for Maven builds
>
[
https://issues.apache.org/jira/browse/SPARK-47115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-47115:
-
Fix Version/s: (was: 4.0.0)
> Use larger memory for Maven builds
>
[
https://issues.apache.org/jira/browse/SPARK-47115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-47115.
--
Resolution: Invalid
it doesn't help. reverted
> Use larger memory for Maven builds
>
[
https://issues.apache.org/jira/browse/SPARK-47136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-47136.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 45220
[
https://issues.apache.org/jira/browse/SPARK-47136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-47136:
-
Assignee: Dongjoon Hyun
> Fix `MavenUtilsSuite` to use
[
https://issues.apache.org/jira/browse/SPARK-47134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819834#comment-17819834
]
Dylan Walker edited comment on SPARK-47134 at 2/22/24 10:32 PM:
[
https://issues.apache.org/jira/browse/SPARK-47134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819834#comment-17819834
]
Dylan Walker commented on SPARK-47134:
--
[~bersprockets]
Hmm, it's possible I may have made too
[
https://issues.apache.org/jira/browse/SPARK-47137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-47137:
---
Labels: pull-request-available (was: )
> Add getAll to spark.conf for feature parity with
[
https://issues.apache.org/jira/browse/SPARK-47135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-47135:
---
Labels: pull-request-available (was: )
> Implement error classes for Kafka data loss
[
https://issues.apache.org/jira/browse/SPARK-46762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819830#comment-17819830
]
nirav patel edited comment on SPARK-46762 at 2/22/24 10:13 PM:
---
I did some
[
https://issues.apache.org/jira/browse/SPARK-46762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819830#comment-17819830
]
nirav patel edited comment on SPARK-46762 at 2/22/24 10:11 PM:
---
I did some
[
https://issues.apache.org/jira/browse/SPARK-46762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
nirav patel updated SPARK-46762:
Attachment: Screenshot 2024-02-22 at 2.04.49 PM.png
Screenshot 2024-02-22 at
[
https://issues.apache.org/jira/browse/SPARK-46762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819830#comment-17819830
]
nirav patel commented on SPARK-46762:
-
I did some more digging into executor classloading and heap
[
https://issues.apache.org/jira/browse/SPARK-47137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin updated SPARK-47137:
--
Summary: Add getAll to spark.conf for feature parity with Scala (was: Add
getAll for
[
https://issues.apache.org/jira/browse/SPARK-47137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin updated SPARK-47137:
--
Summary: Add getAll for spark.conf for feature parity with Scala (was: Add
getAll for
Takuya Ueshin created SPARK-47137:
-
Summary: Add getAll for pyspark.sql.conf for feature parity with
Scala
Key: SPARK-47137
URL: https://issues.apache.org/jira/browse/SPARK-47137
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-47136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-47136:
--
Summary: Fix `MavenUtilsSuite` to use `MavenUtils.resolveMavenCoordinates`
properly (was:
[
https://issues.apache.org/jira/browse/SPARK-47136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-47136:
--
Component/s: Tests
> Use `ivyPath` param of `MavenUtils.loadIvySettings` in `MavenUtilsSuite`
[
https://issues.apache.org/jira/browse/SPARK-47136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-47136:
---
Labels: pull-request-available (was: )
> Use `ivyPath` param of
[
https://issues.apache.org/jira/browse/SPARK-47136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-47136:
--
Summary: Use `ivyPath` param of `MavenUtils.loadIvySettings` in
`MavenUtilsSuite` (was: Use
Dongjoon Hyun created SPARK-47136:
-
Summary: Use `ivyPath` parameter of `MavenUtils.loadIvySettings`
in `MavenUtilsSuite`
Key: SPARK-47136
URL: https://issues.apache.org/jira/browse/SPARK-47136
[
https://issues.apache.org/jira/browse/SPARK-47069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin resolved SPARK-47069.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 45129
[
https://issues.apache.org/jira/browse/SPARK-47134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819789#comment-17819789
]
Bruce Robbins commented on SPARK-47134:
---
Oddly, I cannot reproduce on either 3.4.1 or 3.5.0.
[
https://issues.apache.org/jira/browse/SPARK-47132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819779#comment-17819779
]
Xinrong Meng edited comment on SPARK-47132 at 2/22/24 7:21 PM:
---
[
https://issues.apache.org/jira/browse/SPARK-47132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819779#comment-17819779
]
Xinrong Meng commented on SPARK-47132:
--
[~wunderalbert] would you double check if you set up your
[
https://issues.apache.org/jira/browse/SPARK-47132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819780#comment-17819780
]
Xinrong Meng commented on SPARK-47132:
--
Resolved by https://github.com/apache/spark/pull/45197.
>
[
https://issues.apache.org/jira/browse/SPARK-47132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xinrong Meng updated SPARK-47132:
-
Attachment: image-2024-02-22-11-18-02-429.png
> Mistake in Docstring for Pyspark's
[
https://issues.apache.org/jira/browse/SPARK-47132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xinrong Meng updated SPARK-47132:
-
Issue Type: Documentation (was: Bug)
> Mistake in Docstring for Pyspark's Dataframe.head()
>
[
https://issues.apache.org/jira/browse/SPARK-47132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xinrong Meng updated SPARK-47132:
-
Affects Version/s: 4.0.0
(was: 3.5.0)
> Mistake in Docstring for
[
https://issues.apache.org/jira/browse/SPARK-47132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819777#comment-17819777
]
Xinrong Meng commented on SPARK-47132:
--
I modified the ticket to Documentation (from Bug) and 4.0.0
[
https://issues.apache.org/jira/browse/SPARK-47135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819771#comment-17819771
]
B. Micheal Okutubo commented on SPARK-47135:
I'm working on this. Will send PR soon.
>
B. Micheal Okutubo created SPARK-47135:
--
Summary: Implement error classes for Kafka data loss exceptions
Key: SPARK-47135
URL: https://issues.apache.org/jira/browse/SPARK-47135
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-47001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-47001:
---
Labels: pull-request-available (was: )
> Pushdown Verification in Optimizer.scala should
[
https://issues.apache.org/jira/browse/SPARK-47133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Filippo Monari updated SPARK-47133:
---
Environment:
* We are running Spark in stand-alone mode, on Kubernetes.
* The containers
[
https://issues.apache.org/jira/browse/SPARK-47134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dylan Walker updated SPARK-47134:
-
Attachment: 321queryplan.txt
> Unexpected nulls when casting decimal values in specific cases
>
[
https://issues.apache.org/jira/browse/SPARK-47134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dylan Walker updated SPARK-47134:
-
Attachment: 341queryplan.txt
> Unexpected nulls when casting decimal values in specific cases
>
[
https://issues.apache.org/jira/browse/SPARK-47134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dylan Walker updated SPARK-47134:
-
Description:
In specific cases, casting decimal values can result in `null` values where no
[
https://issues.apache.org/jira/browse/SPARK-47134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dylan Walker updated SPARK-47134:
-
Description:
In specific cases, casting decimal values can result in `null` values where no
[
https://issues.apache.org/jira/browse/SPARK-47133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Filippo Monari updated SPARK-47133:
---
Summary: java.lang.NullPointerException: Missing SslContextFactory when
accessing Worker
[
https://issues.apache.org/jira/browse/SPARK-47133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Filippo Monari updated SPARK-47133:
---
Description:
Hi,
We are encountering the error described here below.
If SSL/TLS is
[
https://issues.apache.org/jira/browse/SPARK-47134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dylan Walker updated SPARK-47134:
-
Description:
In specific cases, casting decimal values can result in `null` values where no
[
https://issues.apache.org/jira/browse/SPARK-47134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dylan Walker updated SPARK-47134:
-
Description:
In specific cases, casting decimal values can result in `null` values where no
[
https://issues.apache.org/jira/browse/SPARK-47133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Filippo Monari updated SPARK-47133:
---
Description:
Hi,
We are encountering the error described here below.
If SSL/TLS is
Dylan Walker created SPARK-47134:
Summary: Unexpected nulls when casting decimal values in specific
cases
Key: SPARK-47134
URL: https://issues.apache.org/jira/browse/SPARK-47134
Project: Spark
Filippo Monari created SPARK-47133:
--
Summary: java.lang.NullPointerException: Missing SslContextFactory
when accessing Worker WebUI from Master as reverse proxy
Key: SPARK-47133
URL:
[
https://issues.apache.org/jira/browse/SPARK-47133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Filippo Monari updated SPARK-47133:
---
Description:
Hi,
we are encountering the error described here below.
If SSL/TLS is
[
https://issues.apache.org/jira/browse/SPARK-43259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk reassigned SPARK-43259:
Assignee: Mihailo Milosevic
> Assign a name to the error class _LEGACY_ERROR_TEMP_2024
>
[
https://issues.apache.org/jira/browse/SPARK-43259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk resolved SPARK-43259.
--
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 45095
[
https://issues.apache.org/jira/browse/SPARK-47131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-47131:
---
Labels: pull-request-available (was: )
> contains, startswith, endswith
>
[
https://issues.apache.org/jira/browse/SPARK-47102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mihailo Milosevic updated SPARK-47102:
--
Description:
*What changes were proposed in this pull request?*
This PR adds
[
https://issues.apache.org/jira/browse/SPARK-47102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mihailo Milosevic updated SPARK-47102:
--
Description:
### What changes were proposed in this pull request?
This PR adds
[
https://issues.apache.org/jira/browse/SPARK-47102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-47102:
---
Labels: pull-request-available (was: )
> Add COLLATION_ENABLED config flag
>
Albert Ziegler created SPARK-47132:
--
Summary: Mistake in Docstring for Pyspark's Dataframe.head()
Key: SPARK-47132
URL: https://issues.apache.org/jira/browse/SPARK-47132
Project: Spark
Uroš Bojanić created SPARK-47131:
Summary: contains, startswith, endswith
Key: SPARK-47131
URL: https://issues.apache.org/jira/browse/SPARK-47131
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-46975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng updated SPARK-46975:
--
Summary: Support dedicated fallback methods (was: Move to_{hdf, feather,
stata} to the
[
https://issues.apache.org/jira/browse/SPARK-42328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk reassigned SPARK-42328:
Assignee: Nikola Mandic
> Assign name to _LEGACY_ERROR_TEMP_1175
>
[
https://issues.apache.org/jira/browse/SPARK-42328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Gekk resolved SPARK-42328.
--
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 45183
[
https://issues.apache.org/jira/browse/SPARK-47130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-47130:
---
Labels: pull-request-available (was: )
> Use listStatus to bypass block location info when
[
https://issues.apache.org/jira/browse/SPARK-47129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng updated SPARK-47129:
--
Summary: Make ResolveRelations cache connect plan properly (was: Make
ResolveRelations
Kent Yao created SPARK-47130:
Summary: Use listStatus to bypass block location info when
cleaning driver logs
Key: SPARK-47130
URL: https://issues.apache.org/jira/browse/SPARK-47130
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-47129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-47129:
---
Labels: pull-request-available (was: )
> Make ResolveRelations handle planId properly
>
[
https://issues.apache.org/jira/browse/SPARK-47128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-47128:
--
Parent: SPARK-47046
Issue Type: Sub-task (was: Improvement)
> Improve
79 matches
Mail list logo