[jira] [Updated] (SPARK-49752) Remove workaround for YARN-3350

2024-09-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49752: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Remove workaround

[jira] [Assigned] (SPARK-49752) Remove workaround for YARN-3350

2024-09-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49752: - Assignee: Cheng Pan > Remove workaround for YARN-3

[jira] [Resolved] (SPARK-49752) Remove workaround for YARN-3350

2024-09-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49752. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48201 [https

[jira] [Assigned] (SPARK-49746) Upgrade Scala to 2.13.15

2024-09-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49746: - Assignee: BingKun Pan > Upgrade Scala to 2.13

[jira] [Updated] (SPARK-49746) Upgrade Scala to 2.13.15

2024-09-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49746: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Upgrade Scala

[jira] [Resolved] (SPARK-49742) Upgrade `README`, examples, tests to use `preview2`

2024-09-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49742. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-49740) Update `publish-java17.yaml` and `publish-java21.yaml` to use `preview2` by default

2024-09-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49740. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 71 [https

[jira] [Assigned] (SPARK-49740) Update `publish-java17.yaml` and `publish-java21.yaml` to use `preview2` by default

2024-09-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49740: - Assignee: Dongjoon Hyun > Update `publish-java17.yaml` and `publish-java21.yaml`

[jira] [Created] (SPARK-49740) Update `publish-java17.yaml` and `publish-java21.yaml` to use `preview2` by default

2024-09-20 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-49740: - Summary: Update `publish-java17.yaml` and `publish-java21.yaml` to use `preview2` by default Key: SPARK-49740 URL: https://issues.apache.org/jira/browse/SPARK-49740

[jira] [Resolved] (SPARK-49736) Add Apache Spark `4.0.0-preview2` Dockerfiles

2024-09-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49736. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 70 [https

[jira] [Resolved] (SPARK-49735) Upgrade Spark to `4.0.0-preview2`

2024-09-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49735. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull

[jira] [Commented] (SPARK-49531) Support line plot with plotly backend

2024-09-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17883318#comment-17883318 ] Dongjoon Hyun commented on SPARK-49531: --- This is resolved via [https://github

[jira] [Resolved] (SPARK-49704) Upgrade `commons-io` to 2.17.0

2024-09-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49704. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48154 [https

[jira] [Updated] (SPARK-49704) Upgrade `commons-io` to 2.17.0

2024-09-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49704: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Upgrade `commons

[jira] [Updated] (SPARK-49736) Add Apache Spark `4.0.0-preview2` Dockerfiles

2024-09-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49736: -- Summary: Add Apache Spark `4.0.0-preview2` Dockerfiles (was: Add Apache Spark 4.0.0-preview2

[jira] [Created] (SPARK-49736) Add Apache Spark 4.0.0-preview2 Dockerfiles

2024-09-20 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-49736: - Summary: Add Apache Spark 4.0.0-preview2 Dockerfiles Key: SPARK-49736 URL: https://issues.apache.org/jira/browse/SPARK-49736 Project: Spark Issue Type

[jira] [Resolved] (SPARK-49724) Add Java 21 in the e2e test

2024-09-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49724. --- Fix Version/s: kubernetes-operator-0.1.0 Assignee: Qi Tan Resolution: Fixed

[jira] [Created] (SPARK-49735) Use Spark `4.0.0-preview2`

2024-09-20 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-49735: - Summary: Use Spark `4.0.0-preview2` Key: SPARK-49735 URL: https://issues.apache.org/jira/browse/SPARK-49735 Project: Spark Issue Type: Sub-task

[VOTE][RESULT] Release Spark 4.0.0-preview2 (RC1)

2024-09-20 Thread Dongjoon Hyun
The vote passes with 14 +1s (9 binding +1s). Thanks to all who helped with the release! (* = binding) +1: - Zhou Jiang - Holden Karau * - Dongjoon Hyun * - Liang-Chi Hsieh * - Huaxin Gao * - Xinrong Meng * - John Zhuge - Wenchen Fan * - Cheng Pan - Yuming Wang * - Xiao Li * - Gengliang Wang

Re: [VOTE] Release Spark 4.0.0-preview2 (RC1)

2024-09-20 Thread Dongjoon Hyun
Thank you all! I'll conclude this vote. Dongjoon. - To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

[jira] [Resolved] (SPARK-49721) Upgrade `protobuf-java` to 3.25.5

2024-09-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49721. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48171 [https

[jira] [Updated] (SPARK-49721) Upgrade `protobuf-java` to `3.25.5`

2024-09-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49721: -- Summary: Upgrade `protobuf-java` to `3.25.5` (was: Upgrade `protobuf-java` to 3.25.5

[jira] [Resolved] (SPARK-49720) Add a script to clean up PySpark temp files

2024-09-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49720. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48167 [https

[jira] [Assigned] (SPARK-49720) Add a script to clean up PySpark temp files

2024-09-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49720: - Assignee: Ruifeng Zheng > Add a script to clean up PySpark temp fi

[jira] [Assigned] (SPARK-49718) Switch `Scatter` plot to sampled data

2024-09-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49718: - Assignee: Ruifeng Zheng > Switch `Scatter` plot to sampled d

[jira] [Resolved] (SPARK-49718) Switch `Scatter` plot to sampled data

2024-09-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49718. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48164 [https

[jira] [Updated] (ORC-1775) Upgrade `aircompressor` to 2.0.2

2024-09-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated ORC-1775: --- Fix Version/s: 2.0.3 > Upgrade `aircompressor` to 2.

[jira] [Updated] (ORC-1750) Bump `protobuf-java` to 3.25.4

2024-09-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated ORC-1750: --- Fix Version/s: 2.0.3 > Bump `protobuf-java` to 3.2

[jira] [Updated] (ORC-1777) Upgrade `protobuf-java` to 3.25.5

2024-09-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated ORC-1777: --- Fix Version/s: 2.0.3 > Upgrade `protobuf-java` to 3.2

[jira] [Updated] (ORC-1776) Remove `MacOS 12` from GitHub Action CI and docs

2024-09-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated ORC-1776: --- Fix Version/s: 2.0.3 > Remove `MacOS 12` from GitHub Action CI and d

[jira] [Updated] (SPARK-46535) NPE when describe extended a column without col stats

2024-09-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46535: -- Fix Version/s: 3.4.4 > NPE when describe extended a column without col st

[jira] [Resolved] (ORC-1777) Upgrade `protobuf-java` to 3.25.5

2024-09-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved ORC-1777. Fix Version/s: 2.1.0 Resolution: Fixed Issue resolved by pull request 2027 [https

[jira] [Assigned] (ORC-1777) Upgrade `protobuf-java` to 3.25.5

2024-09-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned ORC-1777: -- Assignee: Dongjoon Hyun > Upgrade `protobuf-java` to 3.2

[jira] [Created] (ORC-1777) Upgrade `protobuf-java` to 3.25.5

2024-09-19 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created ORC-1777: -- Summary: Upgrade `protobuf-java` to 3.25.5 Key: ORC-1777 URL: https://issues.apache.org/jira/browse/ORC-1777 Project: ORC Issue Type: Bug Components

[jira] [Updated] (SPARK-48933) Upgrade `protobuf-java` to `3.25.3`

2024-09-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48933: -- Parent Issue: SPARK-47046 (was: SPARK-44111) > Upgrade `protobuf-java` to `3.2

[jira] [Assigned] (SPARK-49721) Upgrade `protobuf-java` to 3.25.5

2024-09-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49721: - Assignee: Dongjoon Hyun > Upgrade `protobuf-java` to 3.2

[jira] [Assigned] (SPARK-49716) Fix documentation and add test of barh plot

2024-09-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49716: - Assignee: Xinrong Meng > Fix documentation and add test of barh p

[jira] [Resolved] (SPARK-49716) Fix documentation and add test of barh plot

2024-09-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49716. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48161 [https

[jira] [Assigned] (SPARK-49719) UUID and SHUFFLE should accept integer seed

2024-09-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49719: - Assignee: Ruifeng Zheng > UUID and SHUFFLE should accept integer s

[jira] [Resolved] (SPARK-49719) UUID and SHUFFLE should accept integer seed

2024-09-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49719. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48166 [https

[jira] [Resolved] (SPARK-49715) Add `Java 21`-based `SparkCluster` example

2024-09-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49715. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-49714) Add `Java 21`-based `SparkPi` example

2024-09-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49714. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-49705) Use `spark-examples.jar` instead of `spark-examples_2.13-4.0.0-preview1.jar`

2024-09-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49705. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull

[jira] [Updated] (SPARK-45497) Add a symbolic link file `spark-examples.jar` in K8s Docker images

2024-09-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45497: -- Parent: SPARK-49524 Issue Type: Sub-task (was: Improvement) > Add a symbolic l

[jira] [Updated] (SPARK-44935) Fix `RELEASE` file to have the correct information in Docker images

2024-09-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44935: -- Parent: SPARK-49524 Issue Type: Sub-task (was: Bug) > Fix `RELEASE` file to have

[jira] [Updated] (SPARK-49701) Use JDK for Spark 3.5+ Docker image

2024-09-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49701: -- Parent Issue: SPARK-49524 (was: SPARK-44111) > Use JDK for Spark 3.5+ Docker im

[jira] [Updated] (SPARK-49703) Publish Java 21 Docker image for preview1

2024-09-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49703: -- Parent Issue: SPARK-49524 (was: SPARK-44111) > Publish Java 21 Docker image for previ

[jira] [Updated] (SPARK-49702) Make `spark-docker` repository's Dockerfiles up-to-date

2024-09-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49702: -- Parent Issue: SPARK-49524 (was: SPARK-44111) > Make `spark-docker` repository's Doc

[jira] [Assigned] (SPARK-49715) Add `Java 21`-based `SparkCluster` example

2024-09-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49715: - Assignee: Dongjoon Hyun > Add `Java 21`-based `SparkCluster` exam

[jira] [Updated] (SPARK-49715) Add `Java 21`-based `SparkCluster` example

2024-09-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49715: -- Summary: Add `Java 21`-based `SparkCluster` example (was: Add `Java 21`-based SparkCluster

[jira] [Created] (SPARK-49715) Add `Java 21`-based SparkCluster example

2024-09-18 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-49715: - Summary: Add `Java 21`-based SparkCluster example Key: SPARK-49715 URL: https://issues.apache.org/jira/browse/SPARK-49715 Project: Spark Issue Type: Sub

[jira] [Updated] (SPARK-49714) Add `Java 21`-based `SparkPi` example

2024-09-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49714: -- Summary: Add `Java 21`-based `SparkPi` example (was: Add Java 21 Pi example) > Add `Java

[jira] [Created] (SPARK-49714) Add Java 21 Pi example

2024-09-18 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-49714: - Summary: Add Java 21 Pi example Key: SPARK-49714 URL: https://issues.apache.org/jira/browse/SPARK-49714 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-49702) Make `spark-docker` repository's Dockerfiles up-to-date

2024-09-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49702. --- Fix Version/s: 4.0.0 Resolution: Fixed > Make `spark-docker` repositor

[jira] [Resolved] (SPARK-49703) Publish Java 21 Docker image for preview1

2024-09-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49703. --- Fix Version/s: 4.0.0 Resolution: Fixed This is resolved via [https://github.com

[jira] [Resolved] (SPARK-49706) Use `apache/spark` images instead of `spark`

2024-09-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49706. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-49706) Use `apache/spark` images instead of `spark`

2024-09-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49706: - Assignee: Dongjoon Hyun > Use `apache/spark` images instead of `sp

[jira] [Created] (SPARK-49706) Use `apache/spark` images instead of `spark`

2024-09-18 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-49706: - Summary: Use `apache/spark` images instead of `spark` Key: SPARK-49706 URL: https://issues.apache.org/jira/browse/SPARK-49706 Project: Spark Issue Type

[jira] [Assigned] (SPARK-49705) Use `spark-examples.jar` instead of `spark-examples_2.13-4.0.0-preview1.jar`

2024-09-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49705: - Assignee: Dongjoon Hyun > Use `spark-examples.jar` instead of `spark-examples_2

[jira] [Created] (SPARK-49705) Use `spark-examples.jar` instead of `spark-examples_2.13-4.0.0-preview1.jar`

2024-09-18 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-49705: - Summary: Use `spark-examples.jar` instead of `spark-examples_2.13-4.0.0-preview1.jar` Key: SPARK-49705 URL: https://issues.apache.org/jira/browse/SPARK-49705

[jira] [Created] (SPARK-49703) Publish Java 21 Docker image for preview1

2024-09-18 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-49703: - Summary: Publish Java 21 Docker image for preview1 Key: SPARK-49703 URL: https://issues.apache.org/jira/browse/SPARK-49703 Project: Spark Issue Type: Sub

[jira] [Assigned] (SPARK-49703) Publish Java 21 Docker image for preview1

2024-09-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49703: - Assignee: Dongjoon Hyun > Publish Java 21 Docker image for previ

[jira] [Updated] (SPARK-48664) Add official image Dockerfile for Apache Spark 4.0.0-preview1

2024-09-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48664: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Task) > Add official image Dockerf

[jira] [Resolved] (SPARK-49701) Use JDK for Spark 3.5+ Docker image

2024-09-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49701. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 66 [https

[jira] [Assigned] (SPARK-49701) Use JDK for Spark 3.5+ Docker image

2024-09-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49701: - Assignee: Dongjoon Hyun > Use JDK for Spark 3.5+ Docker im

[jira] [Updated] (SPARK-49701) Use JDK for Spark 3.5+ Docker image

2024-09-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49701: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Bug) > Use JDK for Spark 3.5+ Doc

[jira] [Updated] (SPARK-49702) Make `spark-docker` repository's Dockerfiles up-to-date

2024-09-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49702: -- Description: Apache Spark Docker repository is outdated. We need to update it with the

[jira] [Assigned] (SPARK-49702) Make `spark-docker` repository's Dockerfiles up-to-date

2024-09-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49702: - Assignee: Dongjoon Hyun > Make `spark-docker` repository's Dockerfiles up

[jira] [Created] (SPARK-49702) Make `spark-docker` repository's Dockerfiles up-to-date

2024-09-18 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-49702: - Summary: Make `spark-docker` repository's Dockerfiles up-to-date Key: SPARK-49702 URL: https://issues.apache.org/jira/browse/SPARK-49702 Project:

[jira] [Created] (SPARK-49701) Use JDK for Spark 3.5+ Docker image

2024-09-18 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-49701: - Summary: Use JDK for Spark 3.5+ Docker image Key: SPARK-49701 URL: https://issues.apache.org/jira/browse/SPARK-49701 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-49691) Function `substring` should accept column names

2024-09-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49691: - Assignee: Ruifeng Zheng > Function `substring` should accept column na

[jira] [Resolved] (SPARK-49691) Function `substring` should accept column names

2024-09-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49691. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48135 [https

[jira] [Updated] (SPARK-49691) Function `substring` should accept column names

2024-09-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49691: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Bug) > Function `substring` sho

[jira] [Updated] (SPARK-49696) Flaky test: `Cancellation APIs in SparkSession are isolated`

2024-09-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49696: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Test) > Flaky test: `Cancellat

[jira] [Created] (SPARK-49696) Flaky test: `Cancellation APIs in SparkSession are isolated`

2024-09-18 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-49696: - Summary: Flaky test: `Cancellation APIs in SparkSession are isolated` Key: SPARK-49696 URL: https://issues.apache.org/jira/browse/SPARK-49696 Project: Spark

[jira] [Resolved] (ORC-1775) Upgrade `aircompressor` to 2.0.2

2024-09-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved ORC-1775. Fix Version/s: 2.1.0 Resolution: Fixed Issue resolved by pull request 2006 [https

[jira] [Assigned] (ORC-1775) Upgrade `aircompressor` to 2.0.2

2024-09-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned ORC-1775: -- Assignee: Dongjoon Hyun > Upgrade `aircompressor` to 2.

[jira] [Resolved] (ORC-1776) Remove `MacOS 12` from GitHub Action CI and docs

2024-09-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved ORC-1776. Fix Version/s: 2.1.0 Resolution: Fixed Issue resolved by pull request 2026 [https

[jira] [Assigned] (ORC-1776) Remove `MacOS 12` from GitHub Action CI and docs

2024-09-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned ORC-1776: -- Assignee: Dongjoon Hyun > Remove `MacOS 12` from GitHub Action CI and d

[jira] [Assigned] (SPARK-49682) Upgrade joda-time to 2.13.0

2024-09-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49682: - Assignee: BingKun Pan > Upgrade joda-time to 2.1

[jira] [Resolved] (SPARK-49682) Upgrade joda-time to 2.13.0

2024-09-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49682. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48130 [https

[jira] [Updated] (SPARK-49682) Upgrade joda-time to 2.13.0

2024-09-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49682: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Upgrade joda-time

[jira] [Updated] (ORC-1776) Remove `MacOS 12` from GitHub Action CI and docs

2024-09-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated ORC-1776: --- Summary: Remove `MacOS 12` from GitHub Action CI and docs (was: Remove `MacOS 12` from GitHub Action

[jira] [Created] (ORC-1776) Remove `MacOS 12` from GitHub Action CI

2024-09-17 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created ORC-1776: -- Summary: Remove `MacOS 12` from GitHub Action CI Key: ORC-1776 URL: https://issues.apache.org/jira/browse/ORC-1776 Project: ORC Issue Type: Test

[jira] [Created] (ORC-1775) Upgrade `aircompressor` to 2.0.2

2024-09-17 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created ORC-1775: -- Summary: Upgrade `aircompressor` to 2.0.2 Key: ORC-1775 URL: https://issues.apache.org/jira/browse/ORC-1775 Project: ORC Issue Type: Bug Components

[jira] [Resolved] (ORC-1774) Upgrade `snappy-java` to 1.1.10.7 in `bench` module

2024-09-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved ORC-1774. Fix Version/s: 2.1.0 2.0.3 Assignee: Dongjoon Hyun Resolution

[jira] [Updated] (ORC-1774) Upgrade `snappy-java` to 1.1.10.7 in `bench` module

2024-09-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated ORC-1774: --- Affects Version/s: 2.1.0 > Upgrade `snappy-java` to 1.1.10.7 in `bench` mod

[jira] [Updated] (ORC-1756) Bump `snappy-java` to 1.1.10.6 in `bench` module

2024-09-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated ORC-1756: --- Fix Version/s: 2.0.3 > Bump `snappy-java` to 1.1.10.6 in `bench` mod

[jira] [Updated] (ORC-1774) Upgrade `snappy-java` to 1.1.10.7

2024-09-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated ORC-1774: --- Issue Type: Test (was: Bug) > Upgrade `snappy-java` to 1.1.1

[jira] [Updated] (ORC-1774) Upgrade `snappy-java` to 1.1.10.7 in `bench` module

2024-09-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/ORC-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated ORC-1774: --- Summary: Upgrade `snappy-java` to 1.1.10.7 in `bench` module (was: Upgrade `snappy-java` to 1.1.10.7

[jira] [Created] (ORC-1774) Upgrade `snappy-java` to 1.1.10.7

2024-09-17 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created ORC-1774: -- Summary: Upgrade `snappy-java` to 1.1.10.7 Key: ORC-1774 URL: https://issues.apache.org/jira/browse/ORC-1774 Project: ORC Issue Type: Bug Components

[jira] [Resolved] (SPARK-49687) Delay sorting in validateAndMaybeEvolveStateSchema

2024-09-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49687. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48116 [https

[jira] [Assigned] (SPARK-49687) Delay sorting in validateAndMaybeEvolveStateSchema

2024-09-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49687: - Assignee: Zhihong Yu > Delay sorting in validateAndMaybeEvolveStateSch

[jira] [Resolved] (SPARK-49657) Two instances of Spark Operator running at the same time

2024-09-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49657. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-49657) Two instances of Spark Operator running at the same time

2024-09-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49657: - Assignee: Qi Tan > Two instances of Spark Operator running at the same t

[jira] [Assigned] (SPARK-49658) E2E Workflow Refactor

2024-09-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49658: - Assignee: Qi Tan > E2E Workflow Refac

[jira] [Resolved] (SPARK-49658) E2E Workflow Refactor

2024-09-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49658. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-49678) Support `spark.test.master` in `SparkSubmitArguments`

2024-09-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49678. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48126 [https

[jira] [Assigned] (SPARK-49678) Support `spark.test.master` in `SparkSubmitArguments`

2024-09-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49678: - Assignee: Dongjoon Hyun > Support `spark.test.master` in `SparkSubmitArgume

[jira] [Resolved] (SPARK-49680) Limit `Sphinx` build parallelism to 4 by default

2024-09-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49680. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48129 [https

  1   2   3   4   5   6   7   8   9   10   >