[jira] [Created] (SPARK-33728) Improve error messages during K8s integration test failure

Holden Karau created SPARK-33728: Summary: Improve error messages during K8s integration test failure Key: SPARK-33728 URL: https://issues.apache.org/jira/browse/SPARK-33728 Project: Spark

[jira] [Created] (SPARK-33724) Allow decommissioning script location to be configured

Holden Karau created SPARK-33724: Summary: Allow decommissioning script location to be configured Key: SPARK-33724 URL: https://issues.apache.org/jira/browse/SPARK-33724 Project: Spark Issue

[jira] [Created] (SPARK-33716) Decommissioning Race Condition during Pod Snapshot

Holden Karau created SPARK-33716: Summary: Decommissioning Race Condition during Pod Snapshot Key: SPARK-33716 URL: https://issues.apache.org/jira/browse/SPARK-33716 Project: Spark Issue

[jira] [Created] (SPARK-33262) Keep pending pods in account while scheduling new pods

Holden Karau created SPARK-33262: Summary: Keep pending pods in account while scheduling new pods Key: SPARK-33262 URL: https://issues.apache.org/jira/browse/SPARK-33262 Project: Spark Issue

[jira] [Created] (SPARK-33261) Allow people to extend the pod feature steps

Holden Karau created SPARK-33261: Summary: Allow people to extend the pod feature steps Key: SPARK-33261 URL: https://issues.apache.org/jira/browse/SPARK-33261 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-30821) Executor pods with multiple containers will not be rescheduled unless all containers fail

[ https://issues.apache.org/jira/browse/SPARK-30821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-30821. -- Fix Version/s: 3.1.0 3.0.2 Resolution: Fixed > Executor pods with

[jira] [Created] (SPARK-33231) Make podCreationTimeout configurable

Holden Karau created SPARK-33231: Summary: Make podCreationTimeout configurable Key: SPARK-33231 URL: https://issues.apache.org/jira/browse/SPARK-33231 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-33200) Validate that all shuffle files are migrated during E2E testing

Holden Karau created SPARK-33200: Summary: Validate that all shuffle files are migrated during E2E testing Key: SPARK-33200 URL: https://issues.apache.org/jira/browse/SPARK-33200 Project: Spark

[jira] [Created] (SPARK-33154) Handle shuffle blocks being removed during decommissioning

Holden Karau created SPARK-33154: Summary: Handle shuffle blocks being removed during decommissioning Key: SPARK-33154 URL: https://issues.apache.org/jira/browse/SPARK-33154 Project: Spark

[jira] [Resolved] (SPARK-33151) Jenkins PRB is not responding

[ https://issues.apache.org/jira/browse/SPARK-33151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-33151. -- Resolution: Fixed > Jenkins PRB is not responding > - > >

[jira] [Created] (SPARK-33151) Jenkins PRB is not responding

Holden Karau created SPARK-33151: Summary: Jenkins PRB is not responding Key: SPARK-33151 URL: https://issues.apache.org/jira/browse/SPARK-33151 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-33097) Add Decommissioning messages to the Spark listener bus

Holden Karau created SPARK-33097: Summary: Add Decommissioning messages to the Spark listener bus Key: SPARK-33097 URL: https://issues.apache.org/jira/browse/SPARK-33097 Project: Spark Issue

[jira] [Created] (SPARK-33049) Decommission Core Integration Test is flaky.

Holden Karau created SPARK-33049: Summary: Decommission Core Integration Test is flaky. Key: SPARK-33049 URL: https://issues.apache.org/jira/browse/SPARK-33049 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-32381) Expose the ability for users to use parallel file & avoid location information discovery in RDDs

[ https://issues.apache.org/jira/browse/SPARK-32381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau reassigned SPARK-32381: Assignee: Chao Sun > Expose the ability for users to use parallel file & avoid location

[jira] [Resolved] (SPARK-32381) Expose the ability for users to use parallel file & avoid location information discovery in RDDs

[ https://issues.apache.org/jira/browse/SPARK-32381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-32381. -- Fix Version/s: 3.1.0 Resolution: Fixed > Expose the ability for users to use parallel

[jira] [Commented] (SPARK-32980) Launcher Client tests flake with minikube

[ https://issues.apache.org/jira/browse/SPARK-32980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17201073#comment-17201073 ] Holden Karau commented on SPARK-32980: -- Our method of getting the service assumes the service is on

[jira] [Created] (SPARK-32980) Launcher Client tests flake with minikube

Holden Karau created SPARK-32980: Summary: Launcher Client tests flake with minikube Key: SPARK-32980 URL: https://issues.apache.org/jira/browse/SPARK-32980 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-32979) Spark K8s decom test is broken

[ https://issues.apache.org/jira/browse/SPARK-32979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-32979. -- Resolution: Duplicate Duplicate of SPARK-32937 > Spark K8s decom test is broken >

[jira] [Created] (SPARK-32979) Spark K8s decom test is broken

Holden Karau created SPARK-32979: Summary: Spark K8s decom test is broken Key: SPARK-32979 URL: https://issues.apache.org/jira/browse/SPARK-32979 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-32937) DecomissionSuite in k8s integration tests is failing.

[ https://issues.apache.org/jira/browse/SPARK-32937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17198867#comment-17198867 ] Holden Karau commented on SPARK-32937: -- So there are additional proposed changes to this chunk of

[jira] [Commented] (SPARK-32937) DecomissionSuite in k8s integration tests is failing.

[ https://issues.apache.org/jira/browse/SPARK-32937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17198863#comment-17198863 ] Holden Karau commented on SPARK-32937: -- I want to be clear, I'm asking for a revert then fix. I do

[jira] [Commented] (SPARK-32937) DecomissionSuite in k8s integration tests is failing.

[ https://issues.apache.org/jira/browse/SPARK-32937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17198860#comment-17198860 ] Holden Karau commented on SPARK-32937: -- It looks like someone changed the logging message again

[jira] [Commented] (SPARK-32881) NoSuchElementException occurs during decommissioning

[ https://issues.apache.org/jira/browse/SPARK-32881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17195700#comment-17195700 ] Holden Karau commented on SPARK-32881: -- Thanks for the catch, I'll take a look at this issue. >

[jira] [Created] (SPARK-32866) Docker buildx now requires --push

Holden Karau created SPARK-32866: Summary: Docker buildx now requires --push Key: SPARK-32866 URL: https://issues.apache.org/jira/browse/SPARK-32866 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-32745) Add an option to reject block migrations when under disk pressure

Holden Karau created SPARK-32745: Summary: Add an option to reject block migrations when under disk pressure Key: SPARK-32745 URL: https://issues.apache.org/jira/browse/SPARK-32745 Project: Spark

[jira] [Resolved] (SPARK-32643) [Cleanup] Consolidate state kept in ExecutorDecommissionInfo with TaskSetManager.tidToExecutorKillTimeMapping

[ https://issues.apache.org/jira/browse/SPARK-32643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-32643. -- Fix Version/s: 3.1.0 Resolution: Fixed > [Cleanup] Consolidate state kept in

[jira] [Assigned] (SPARK-32643) [Cleanup] Consolidate state kept in ExecutorDecommissionInfo with TaskSetManager.tidToExecutorKillTimeMapping

[ https://issues.apache.org/jira/browse/SPARK-32643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau reassigned SPARK-32643: Assignee: Devesh Agrawal > [Cleanup] Consolidate state kept in ExecutorDecommissionInfo

[jira] [Created] (SPARK-32657) Decommissioning Integration Test checks for old string

Holden Karau created SPARK-32657: Summary: Decommissioning Integration Test checks for old string Key: SPARK-32657 URL: https://issues.apache.org/jira/browse/SPARK-32657 Project: Spark Issue

[jira] [Created] (SPARK-32642) Add support for ESS in Spark sidecar

Holden Karau created SPARK-32642: Summary: Add support for ESS in Spark sidecar Key: SPARK-32642 URL: https://issues.apache.org/jira/browse/SPARK-32642 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-32642) Add support for ESS in Spark sidecar

[ https://issues.apache.org/jira/browse/SPARK-32642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17179257#comment-17179257 ] Holden Karau commented on SPARK-32642: -- I'm exploring this. > Add support for ESS in Spark sidecar

[jira] [Resolved] (SPARK-31198) Use graceful decommissioning as part of dynamic scaling

[ https://issues.apache.org/jira/browse/SPARK-31198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-31198. -- Fix Version/s: 3.1.0 Resolution: Fixed > Use graceful decommissioning as part of

[jira] [Commented] (SPARK-32530) SPIP: Kotlin support for Apache Spark

[ https://issues.apache.org/jira/browse/SPARK-32530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17175547#comment-17175547 ] Holden Karau commented on SPARK-32530: -- I can understand the desire to have this be inside the ASF,

[jira] [Resolved] (SPARK-31197) Exit the executor once all tasks & migrations are finished

[ https://issues.apache.org/jira/browse/SPARK-31197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-31197. -- Fix Version/s: 3.1.0 Target Version/s: 3.1.0 Resolution: Fixed > Exit the

[jira] [Assigned] (SPARK-31197) Exit the executor once all tasks & migrations are finished

[ https://issues.apache.org/jira/browse/SPARK-31197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau reassigned SPARK-31197: Assignee: Holden Karau > Exit the executor once all tasks & migrations are finished >

[jira] [Resolved] (SPARK-32417) Flaky test: BlockManagerDecommissionIntegrationSuite.verify that an already running task which is going to cache data succeeds on a decommissioned executor

[ https://issues.apache.org/jira/browse/SPARK-32417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-32417. -- Fix Version/s: 3.1.0 Assignee: Devesh Agrawal Resolution: Fixed > Flaky test:

[jira] [Resolved] (SPARK-32199) Clear shuffle state when decommissioned nodes/executors are finally lost

[ https://issues.apache.org/jira/browse/SPARK-32199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-32199. -- Fix Version/s: 3.1.0 Assignee: Devesh Agrawal Resolution: Fixed > Clear

[jira] [Assigned] (SPARK-32198) Don't fail running jobs when decommissioned executors finally go away

[ https://issues.apache.org/jira/browse/SPARK-32198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau reassigned SPARK-32198: Assignee: Devesh Agrawal > Don't fail running jobs when decommissioned executors finally

[jira] [Resolved] (SPARK-32198) Don't fail running jobs when decommissioned executors finally go away

[ https://issues.apache.org/jira/browse/SPARK-32198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-32198. -- Fix Version/s: 3.1.0 Target Version/s: 3.1.0 Resolution: Fixed > Don't fail

[jira] [Commented] (SPARK-32264) More resources in Github Actions

[ https://issues.apache.org/jira/browse/SPARK-32264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17164066#comment-17164066 ] Holden Karau commented on SPARK-32264: -- It's being routed inside of GitHub as of my last contact

[jira] [Resolved] (SPARK-32217) Track whether the worker is also being decommissioned along with an executor

[ https://issues.apache.org/jira/browse/SPARK-32217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-32217. -- Fix Version/s: 3.1.0 Assignee: Devesh Agrawal Resolution: Fixed > Track

[jira] [Created] (SPARK-32397) Snapshot artifacts can have differing timestamps, making it hard to consume

Holden Karau created SPARK-32397: Summary: Snapshot artifacts can have differing timestamps, making it hard to consume Key: SPARK-32397 URL: https://issues.apache.org/jira/browse/SPARK-32397 Project:

[jira] [Resolved] (SPARK-24266) Spark client terminates while driver is still running

[ https://issues.apache.org/jira/browse/SPARK-24266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-24266. -- Fix Version/s: 3.1.0 Target Version/s: 3.1.0 (was: 2.4.7, 3.1.0) Resolution:

[jira] [Created] (SPARK-32381) Expose the ability for users to use parallel file & avoid location information discovery in RDDs

Holden Karau created SPARK-32381: Summary: Expose the ability for users to use parallel file & avoid location information discovery in RDDs Key: SPARK-32381 URL: https://issues.apache.org/jira/browse/SPARK-32381

[jira] [Commented] (SPARK-26345) Parquet support Column indexes

[ https://issues.apache.org/jira/browse/SPARK-26345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17162313#comment-17162313 ] Holden Karau commented on SPARK-26345: -- We don't assign issues normally until after the merge.

[jira] [Resolved] (SPARK-20629) Copy shuffle data when nodes are being shut down

[ https://issues.apache.org/jira/browse/SPARK-20629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-20629. -- Fix Version/s: 3.1.0 Assignee: Holden Karau Resolution: Fixed > Copy shuffle

[jira] [Created] (SPARK-32354) Fix & re-enable failing R K8s tests

Holden Karau created SPARK-32354: Summary: Fix & re-enable failing R K8s tests Key: SPARK-32354 URL: https://issues.apache.org/jira/browse/SPARK-32354 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-21040) On executor/worker decommission consider speculatively re-launching current tasks

[ https://issues.apache.org/jira/browse/SPARK-21040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-21040. -- Fix Version/s: 3.1.0 Resolution: Fixed > On executor/worker decommission consider

[jira] [Commented] (SPARK-21040) On executor/worker decommission consider speculatively re-launching current tasks

[ https://issues.apache.org/jira/browse/SPARK-21040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17160266#comment-17160266 ] Holden Karau commented on SPARK-21040: -- Thanks for fixing this! > On executor/worker decommission

[jira] [Assigned] (SPARK-21040) On executor/worker decommission consider speculatively re-launching current tasks

[ https://issues.apache.org/jira/browse/SPARK-21040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau reassigned SPARK-21040: Assignee: Prakhar Jain > On executor/worker decommission consider speculatively

[jira] [Created] (SPARK-32326) R version is too old on Jenkins k8s PRB

Holden Karau created SPARK-32326: Summary: R version is too old on Jenkins k8s PRB Key: SPARK-32326 URL: https://issues.apache.org/jira/browse/SPARK-32326 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-32004) Drop references to slave

[ https://issues.apache.org/jira/browse/SPARK-32004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-32004. -- Fix Version/s: 3.1.0 Assignee: Holden Karau Resolution: Fixed > Drop

[jira] [Created] (SPARK-32111) Cleanup locks and docs in CoarseGrainedSchedulerBackend

Holden Karau created SPARK-32111: Summary: Cleanup locks and docs in CoarseGrainedSchedulerBackend Key: SPARK-32111 URL: https://issues.apache.org/jira/browse/SPARK-32111 Project: Spark

[jira] [Commented] (SPARK-32111) Cleanup locks and docs in CoarseGrainedSchedulerBackend

[ https://issues.apache.org/jira/browse/SPARK-32111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17146613#comment-17146613 ] Holden Karau commented on SPARK-32111: -- I'm working on this since I'm in the code anyways for

[jira] [Commented] (SPARK-20624) SPIP: Add better handling for node shutdown

[ https://issues.apache.org/jira/browse/SPARK-20624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17145978#comment-17145978 ] Holden Karau commented on SPARK-20624: -- The SPIP document is at  

[jira] [Commented] (SPARK-20624) SPIP: Add better handling for node shutdown

[ https://issues.apache.org/jira/browse/SPARK-20624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17145977#comment-17145977 ] Holden Karau commented on SPARK-20624: -- The current design document is at 

[jira] [Updated] (SPARK-20624) SPIP: Add better handling for node shutdown

[ https://issues.apache.org/jira/browse/SPARK-20624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-20624: - Summary: SPIP: Add better handling for node shutdown (was: Add better handling for node

[jira] [Commented] (SPARK-20624) Add better handling for node shutdown

[ https://issues.apache.org/jira/browse/SPARK-20624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17140124#comment-17140124 ] Holden Karau commented on SPARK-20624: -- [~hyukjin.kwon] that doesn't seem comparable, the history

[jira] [Commented] (SPARK-20624) Add better handling for node shutdown

[ https://issues.apache.org/jira/browse/SPARK-20624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17140094#comment-17140094 ] Holden Karau commented on SPARK-20624: -- [~hyukjin.kwon] the design doc is at

[jira] [Created] (SPARK-32004) Drop references to slave

Holden Karau created SPARK-32004: Summary: Drop references to slave Key: SPARK-32004 URL: https://issues.apache.org/jira/browse/SPARK-32004 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-31974) Stop tracking speculative shuffle files in ExecutorMonitor

Holden Karau created SPARK-31974: Summary: Stop tracking speculative shuffle files in ExecutorMonitor Key: SPARK-31974 URL: https://issues.apache.org/jira/browse/SPARK-31974 Project: Spark

[jira] [Created] (SPARK-31972) Improve heurestic for selecting nodes for scale down to take into account graceful decommission cost

Holden Karau created SPARK-31972: Summary: Improve heurestic for selecting nodes for scale down to take into account graceful decommission cost Key: SPARK-31972 URL:

[jira] [Commented] (SPARK-31197) Exit the executor once all tasks & migrations are finished

[ https://issues.apache.org/jira/browse/SPARK-31197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17133776#comment-17133776 ] Holden Karau commented on SPARK-31197: -- I'm working on this, will post PR soon. > Exit the

[jira] [Commented] (SPARK-31198) Use graceful decommissioning as part of dynamic scaling

[ https://issues.apache.org/jira/browse/SPARK-31198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17133777#comment-17133777 ] Holden Karau commented on SPARK-31198: -- I'm going to start working on this (on top of my

[jira] [Resolved] (SPARK-31890) Decommissioning Test Does not wait long enough for executors to launch

[ https://issues.apache.org/jira/browse/SPARK-31890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-31890. -- Fix Version/s: 3.1.0 Resolution: Fixed Fixed in one of the decom PRs >

[jira] [Resolved] (SPARK-31934) Don't print out extra info from the docker image tool if passed --help

[ https://issues.apache.org/jira/browse/SPARK-31934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-31934. -- Fix Version/s: 3.1.0 3.0.1 Resolution: Fixed > Don't print out

[jira] [Created] (SPARK-31934) Don't print out extra info from the docker image tool if passed --help

Holden Karau created SPARK-31934: Summary: Don't print out extra info from the docker image tool if passed --help Key: SPARK-31934 URL: https://issues.apache.org/jira/browse/SPARK-31934 Project:

[jira] [Resolved] (SPARK-31902) K8s integration tests are failing with mockito errors

[ https://issues.apache.org/jira/browse/SPARK-31902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-31902. -- Resolution: Fixed HTML Unit version change was reverted > K8s integration tests are failing

[jira] [Created] (SPARK-31902) K8s integration tests are failing with mockito errors

Holden Karau created SPARK-31902: Summary: K8s integration tests are failing with mockito errors Key: SPARK-31902 URL: https://issues.apache.org/jira/browse/SPARK-31902 Project: Spark Issue

[jira] [Resolved] (SPARK-31778) Support cross-building docker images

[ https://issues.apache.org/jira/browse/SPARK-31778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-31778. -- Fix Version/s: 3.1.0 3.0.1 3.0.0 Assignee:

[jira] [Resolved] (SPARK-31860) Only push release tags on success

[ https://issues.apache.org/jira/browse/SPARK-31860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-31860. -- Fix Version/s: 2.4.7 3.1.0 3.0.1

[jira] [Updated] (SPARK-31890) Decommissioning Test Does not wait long enough for executors to launch

[ https://issues.apache.org/jira/browse/SPARK-31890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-31890: - Affects Version/s: (was: 3.0.1) (was: 3.0.0) > Decommissioning

[jira] [Created] (SPARK-31890) Decommissioning Test Does not wait long enough for executors to launch

Holden Karau created SPARK-31890: Summary: Decommissioning Test Does not wait long enough for executors to launch Key: SPARK-31890 URL: https://issues.apache.org/jira/browse/SPARK-31890 Project:

[jira] [Resolved] (SPARK-31889) Docker release script does not allocate enough memory to reliably publish

[ https://issues.apache.org/jira/browse/SPARK-31889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-31889. -- Fix Version/s: 2.4.7 3.1.0 3.0.1

[jira] [Created] (SPARK-31889) Docker release script does not allocate enough memory to reliably publish

Holden Karau created SPARK-31889: Summary: Docker release script does not allocate enough memory to reliably publish Key: SPARK-31889 URL: https://issues.apache.org/jira/browse/SPARK-31889 Project:

[jira] [Updated] (SPARK-31692) Hadoop confs passed via spark config are not set in URLStream Handler Factory

[ https://issues.apache.org/jira/browse/SPARK-31692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-31692: - Fix Version/s: (was: 2.4.7) 2.4.6 > Hadoop confs passed via spark config

[jira] [Updated] (SPARK-31663) Grouping sets with having clause returns the wrong result

[ https://issues.apache.org/jira/browse/SPARK-31663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-31663: - Fix Version/s: (was: 2.4.7) 2.4.6 > Grouping sets with having clause

[jira] [Updated] (SPARK-25694) URL.setURLStreamHandlerFactory causing incompatible HttpURLConnection issue

[ https://issues.apache.org/jira/browse/SPARK-25694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-25694: - Fix Version/s: (was: 2.4.7) 2.4.6 > URL.setURLStreamHandlerFactory

[jira] [Updated] (SPARK-31655) Upgrade snappy to version 1.1.7.5

[ https://issues.apache.org/jira/browse/SPARK-31655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-31655: - Fix Version/s: (was: 2.4.7) 2.4.6 > Upgrade snappy to version 1.1.7.5 >

[jira] [Resolved] (SPARK-31541) Backport SPARK-26095 Disable parallelization in make-distibution.sh. (Avoid build hanging)

[ https://issues.apache.org/jira/browse/SPARK-31541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-31541. -- Fix Version/s: 2.4.6 Assignee: Marcelo Masiero Vanzin Resolution: Fixed >

[jira] [Updated] (SPARK-26095) make-distribution.sh is hanging in jenkins

[ https://issues.apache.org/jira/browse/SPARK-26095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-26095: - Fix Version/s: 2.4.6 Affects Version/s: 2.4.6 > make-distribution.sh is hanging in

[jira] [Reopened] (SPARK-31541) Backport SPARK-26095 Disable parallelization in make-distibution.sh. (Avoid build hanging)

[ https://issues.apache.org/jira/browse/SPARK-31541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau reopened SPARK-31541: -- > Backport SPARK-26095 Disable parallelization in make-distibution.sh. > (Avoid build

[jira] [Commented] (SPARK-31541) Backport SPARK-26095 Disable parallelization in make-distibution.sh. (Avoid build hanging)

[ https://issues.apache.org/jira/browse/SPARK-31541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119930#comment-17119930 ] Holden Karau commented on SPARK-31541: -- Ran into issues with this during the RC7 build so I'm

[jira] [Created] (SPARK-31860) Only push release tags on success

Holden Karau created SPARK-31860: Summary: Only push release tags on success Key: SPARK-31860 URL: https://issues.apache.org/jira/browse/SPARK-31860 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-31791) Improve cache block migration test reliability

[ https://issues.apache.org/jira/browse/SPARK-31791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-31791. -- Resolution: Fixed > Improve cache block migration test reliability >

[jira] [Updated] (SPARK-31791) Improve cache block migration test reliability

[ https://issues.apache.org/jira/browse/SPARK-31791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-31791: - Fix Version/s: 3.1.0 > Improve cache block migration test reliability >

[jira] [Assigned] (SPARK-31791) Improve cache block migration test reliability

[ https://issues.apache.org/jira/browse/SPARK-31791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau reassigned SPARK-31791: Assignee: Holden Karau > Improve cache block migration test reliability >

[jira] [Created] (SPARK-31791) Improve cache block migration test reliability

Holden Karau created SPARK-31791: Summary: Improve cache block migration test reliability Key: SPARK-31791 URL: https://issues.apache.org/jira/browse/SPARK-31791 Project: Spark Issue Type:

[jira] [Commented] (SPARK-31555) Improve cache block migration

[ https://issues.apache.org/jira/browse/SPARK-31555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17113736#comment-17113736 ] Holden Karau commented on SPARK-31555: -- Rocking. We're running into an issue in master with the

[jira] [Created] (SPARK-31778) Support cross-building docker images

Holden Karau created SPARK-31778: Summary: Support cross-building docker images Key: SPARK-31778 URL: https://issues.apache.org/jira/browse/SPARK-31778 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-20732) Copy cache data when node is being shut down

[ https://issues.apache.org/jira/browse/SPARK-20732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-20732. -- Fix Version/s: 3.1.0 Resolution: Fixed > Copy cache data when node is being shut down

[jira] [Updated] (SPARK-31555) Improve cache block migration

[ https://issues.apache.org/jira/browse/SPARK-31555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-31555: - Description: We should explore the following improvements to cache block migration: 1) Peer

[jira] [Updated] (SPARK-31555) Improve cache block migration

[ https://issues.apache.org/jira/browse/SPARK-31555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-31555: - Description: We should explore the following improvements to cache block migration: 1) Peer

[jira] [Updated] (SPARK-31555) Improve cache block migration

[ https://issues.apache.org/jira/browse/SPARK-31555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-31555: - Description: We should explore the following improvements to cache block migration: 1) Peer

[jira] [Updated] (SPARK-31555) Improve cache block migration

[ https://issues.apache.org/jira/browse/SPARK-31555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-31555: - Description: We should explore the following improvements to cache block migration: 1) Peer

[jira] [Updated] (SPARK-26908) Fix toMillis

[ https://issues.apache.org/jira/browse/SPARK-26908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-26908: - Fix Version/s: (was: 2.4.7) 2.4.6 > Fix toMillis > > >

[jira] [Updated] (SPARK-31456) If shutdownhook is added with priority Integer.MIN_VALUE, it's supposed to be called the last, but it gets called before other positive priority shutdownhook

[ https://issues.apache.org/jira/browse/SPARK-31456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-31456: - Fix Version/s: (was: 2.4.7) 2.4.6 > If shutdownhook is added with

[jira] [Updated] (SPARK-31676) QuantileDiscretizer raise error parameter splits given invalid value (splits array includes -0.0 and 0.0)

[ https://issues.apache.org/jira/browse/SPARK-31676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-31676: - Fix Version/s: (was: 2.4.7) 2.4.6 > QuantileDiscretizer raise error

[jira] [Updated] (SPARK-31671) Wrong error message in VectorAssembler when column lengths can not be inferred

[ https://issues.apache.org/jira/browse/SPARK-31671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-31671: - Fix Version/s: (was: 2.4.7) 2.4.6 > Wrong error message in

[jira] [Updated] (SPARK-31632) The ApplicationInfo in KVStore may be accessed before it's prepared

[ https://issues.apache.org/jira/browse/SPARK-31632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-31632: - Fix Version/s: (was: 2.4.7) 2.4.6 > The ApplicationInfo in KVStore may

[jira] [Updated] (SPARK-24266) Spark client terminates while driver is still running

[ https://issues.apache.org/jira/browse/SPARK-24266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-24266: - Target Version/s: 3.0.0, 3.1.0, 2.4.7 (was: 2.4.6, 3.0.0, 3.1.0) > Spark client terminates

<    1   2   3   4   >