[jira] [Assigned] (SPARK-49272) Update `Dockerfile` to use `alpine/java:17-jdk` instead of `gradle:8.9.0-jdk17-jammy`

[ https://issues.apache.org/jira/browse/SPARK-49272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49272: - Assignee: Dongjoon Hyun > Update `Dockerfile` to use `alpine/java:17-jdk` instead

[jira] [Created] (SPARK-49272) Update `Dockerfile` to use `alpine/java:17-jdk` instead of `gradle:8.9.0-jdk17-jammy`

Dongjoon Hyun created SPARK-49272: - Summary: Update `Dockerfile` to use `alpine/java:17-jdk` instead of `gradle:8.9.0-jdk17-jammy` Key: SPARK-49272 URL: https://issues.apache.org/jira/browse/SPARK-49272

[jira] [Assigned] (SPARK-49271) Improve `gradlew` to support both `curl` and `wget`

[ https://issues.apache.org/jira/browse/SPARK-49271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49271: - Assignee: Dongjoon Hyun > Improve `gradlew` to support both `curl` and `w

[jira] [Resolved] (SPARK-49271) Improve `gradlew` to support both `curl` and `wget`

[ https://issues.apache.org/jira/browse/SPARK-49271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49271. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull

[jira] [Created] (SPARK-49271) Improve `gradlew` to support both `curl` and `wget`

Dongjoon Hyun created SPARK-49271: - Summary: Improve `gradlew` to support both `curl` and `wget` Key: SPARK-49271 URL: https://issues.apache.org/jira/browse/SPARK-49271 Project: Spark Issue

[jira] [Assigned] (SPARK-49270) Add `sql.yaml` example

[ https://issues.apache.org/jira/browse/SPARK-49270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49270: - Assignee: Dongjoon Hyun > Add `sql.yaml` exam

[jira] [Resolved] (SPARK-49270) Add `sql.yaml` example

[ https://issues.apache.org/jira/browse/SPARK-49270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49270. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull

[jira] [Created] (SPARK-49270) Add `sql.yaml` example

Dongjoon Hyun created SPARK-49270: - Summary: Add `sql.yaml` example Key: SPARK-49270 URL: https://issues.apache.org/jira/browse/SPARK-49270 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-48913) Implement IndentingXMLStreamWriter

[ https://issues.apache.org/jira/browse/SPARK-48913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48913: - Assignee: Alden Lau > Implement IndentingXMLStreamWri

[jira] [Updated] (SPARK-48066) Enable ANSI for TPCDSQueryBenchmark

[ https://issues.apache.org/jira/browse/SPARK-48066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48066: -- Summary: Enable ANSI for TPCDSQueryBenchmark (was: TPCDSBenchmark fails with divide by zero

[jira] [Updated] (SPARK-48066) Enable ANSI for TPCDSQueryBenchmark

[ https://issues.apache.org/jira/browse/SPARK-48066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48066: -- Description: Previously, TPCDSBenchmark fails with divide by zero in q90 for ANSI. > Ena

[jira] [Resolved] (SPARK-48066) TPCDSBenchmark fails with divide by zero in q90 for ANSI

[ https://issues.apache.org/jira/browse/SPARK-48066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48066. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47787 [https

[jira] [Assigned] (SPARK-48066) TPCDSBenchmark fails with divide by zero in q90 for ANSI

[ https://issues.apache.org/jira/browse/SPARK-48066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48066: - Assignee: Kent Yao > TPCDSBenchmark fails with divide by zero in q90 for A

[jira] [Resolved] (SPARK-49258) Add `pi.yaml` example and update README.md

[ https://issues.apache.org/jira/browse/SPARK-49258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49258. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-49256) Upgrade `kubernetes-client` to 6.13.3 and `commons-lang3` to 3.16.0

[ https://issues.apache.org/jira/browse/SPARK-49256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49256. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-49253) Install and test Helm chart in K8s integration test CI

[ https://issues.apache.org/jira/browse/SPARK-49253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49253. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull

[jira] [Commented] (SPARK-44111) Prepare Apache Spark 4.0.0

[ https://issues.apache.org/jira/browse/SPARK-44111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17874118#comment-17874118 ] Dongjoon Hyun commented on SPARK-44111: --- To [~markj-db] , we successf

[jira] [Resolved] (SPARK-49255) Upgrade `kubernetes-client` to 6.13.3

[ https://issues.apache.org/jira/browse/SPARK-49255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49255. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47782 [https

[jira] [Created] (SPARK-49258) Add `pi.yaml` example and update README.md

Dongjoon Hyun created SPARK-49258: - Summary: Add `pi.yaml` example and update README.md Key: SPARK-49258 URL: https://issues.apache.org/jira/browse/SPARK-49258 Project: Spark Issue Type: Sub

[jira] [Assigned] (SPARK-49256) Upgrade `kubernetes-client` to 6.13.3 and `commons-lang3` to 3.16.0

[ https://issues.apache.org/jira/browse/SPARK-49256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49256: - Assignee: Dongjoon Hyun > Upgrade `kubernetes-client` to 6.13.3 and `commons-lang3`

[jira] [Assigned] (SPARK-49253) Install and test Helm chart in K8s integration test CI

[ https://issues.apache.org/jira/browse/SPARK-49253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49253: - Assignee: Dongjoon Hyun > Install and test Helm chart in K8s integration test

[jira] [Resolved] (SPARK-49254) Upgrade mima-core & sbt-mima-plugin to 1.1.4

[ https://issues.apache.org/jira/browse/SPARK-49254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49254. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47780 [https

[jira] [Created] (SPARK-49256) Upgrade `kubernetes-client` to 6.13.3 and `commons-lang3` to 3.16.0

Dongjoon Hyun created SPARK-49256: - Summary: Upgrade `kubernetes-client` to 6.13.3 and `commons-lang3` to 3.16.0 Key: SPARK-49256 URL: https://issues.apache.org/jira/browse/SPARK-49256 Project: Spark

[jira] [Created] (SPARK-49255) Upgrade `kubernetes-client` to 6.13.3

Dongjoon Hyun created SPARK-49255: - Summary: Upgrade `kubernetes-client` to 6.13.3 Key: SPARK-49255 URL: https://issues.apache.org/jira/browse/SPARK-49255 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-48514) Upgrade kubernetes-client to 6.13.0 for K8s v1.30.0

[ https://issues.apache.org/jira/browse/SPARK-48514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48514: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Dependency upgrade) > Upgr

[jira] [Updated] (SPARK-49196) Upgrade `kubernetes-client` to 6.13.2

[ https://issues.apache.org/jira/browse/SPARK-49196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49196: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Upgrade `kuberne

[jira] [Updated] (SPARK-49014) Upgrade Avro to 1.12.0

[ https://issues.apache.org/jira/browse/SPARK-49014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49014: -- Summary: Upgrade Avro to 1.12.0 (was: Bump Apache Avro to 1.12.0) > Upgrade Avro to 1.1

[jira] [Updated] (SPARK-49014) Bump Apache Avro to 1.12.0

[ https://issues.apache.org/jira/browse/SPARK-49014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49014: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Bump Apache Avro

[jira] [Updated] (SPARK-49251) Upgrade ORC to 2.0.2

[ https://issues.apache.org/jira/browse/SPARK-49251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49251: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Task) > Upgrade ORC to 2.

[jira] [Created] (SPARK-49253) Install and test Helm chart in K8s integration test CI

Dongjoon Hyun created SPARK-49253: - Summary: Install and test Helm chart in K8s integration test CI Key: SPARK-49253 URL: https://issues.apache.org/jira/browse/SPARK-49253 Project: Spark

[jira] [Updated] (SPARK-48398) Add Helm Chart

[ https://issues.apache.org/jira/browse/SPARK-48398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48398: -- Summary: Add Helm Chart (was: Add Helm chart for Operator Deployment) > Add Helm Ch

[jira] [Assigned] (SPARK-48398) Add Helm chart for Operator Deployment

[ https://issues.apache.org/jira/browse/SPARK-48398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48398: - Assignee: Zhou JIANG > Add Helm chart for Operator Deploym

[jira] [Resolved] (SPARK-48398) Add Helm chart for Operator Deployment

[ https://issues.apache.org/jira/browse/SPARK-48398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48398. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull

[ANNOUNCE] Announcing Apache ORC 2.0.2

Hi All. We are happy to announce the availability of Apache ORC 2.0.2! https://orc.apache.org/news/2024/08/15/ORC-2.0.2/ 2.0.2 is a maintenance release containing 20 patches. It's available in Apache Downloads and Maven Central. https://downloads.apache.org/orc/orc-2.0.2/ https://re

[ANNOUNCE] Announcing Apache ORC 2.0.2

Hi All. We are happy to announce the availability of Apache ORC 2.0.2! https://orc.apache.org/news/2024/08/15/ORC-2.0.2/ 2.0.2 is a maintenance release containing 20 patches. It's available in Apache Downloads and Maven Central. https://downloads.apache.org/orc/orc-2.0.2/ https://re

[jira] [Closed] (ORC-1746) Bump `netty-all` to 4.1.110.Final

[ https://issues.apache.org/jira/browse/ORC-1746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed ORC-1746. -- > Bump `netty-all` to 4.1.110.Final > - > > K

[jira] [Closed] (ORC-1744) Add `ubuntu-24.04` to GitHub Action

[ https://issues.apache.org/jira/browse/ORC-1744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed ORC-1744. -- > Add `ubuntu-24.04` to GitHub Action > --- > >

[jira] [Closed] (ORC-1700) Write parquet decimal type data in Benchmark using FIXED_LEN_BYTE_ARRAY type

[ https://issues.apache.org/jira/browse/ORC-1700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed ORC-1700. -- > Write parquet decimal type data in Benchmark using FIXED_LEN_BYTE_ARRAY t

[jira] [Closed] (ORC-1751) [C++] Syntax error in ThirdpartyToolchain

[ https://issues.apache.org/jira/browse/ORC-1751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed ORC-1751. -- > [C++] Syntax error in ThirdpartyToolch

[jira] [Closed] (ORC-1742) Support print the id, name and type of each column in dump tool

[ https://issues.apache.org/jira/browse/ORC-1742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed ORC-1742. -- > Support print the id, name and type of each column in dump t

[jira] [Closed] (ORC-1724) JsonFileDump utility should print user metadata

[ https://issues.apache.org/jira/browse/ORC-1724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed ORC-1724. -- > JsonFileDump utility should print user metad

[jira] [Closed] (ORC-1740) Avoid the dump tool repeatedly parsing ColumnStatistics

[ https://issues.apache.org/jira/browse/ORC-1740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed ORC-1740. -- > Avoid the dump tool repeatedly parsing ColumnStatist

[jira] [Closed] (ORC-1752) Fix NumberFormatException when reading json timestamp type in benchmark

[ https://issues.apache.org/jira/browse/ORC-1752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed ORC-1752. -- > Fix NumberFormatException when reading json timestamp type in benchm

[jira] [Closed] (ORC-1733) [C++][CMake] Fix CMAKE_MODULE_PATH not to use PROJECT_SOURCE_DIR

[ https://issues.apache.org/jira/browse/ORC-1733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed ORC-1733. -- > [C++][CMake] Fix CMAKE_MODULE_PATH not to use PROJECT_SOURCE_

[jira] [Closed] (ORC-1741) Respect decimal reader isRepeating flag

[ https://issues.apache.org/jira/browse/ORC-1741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed ORC-1741. -- > Respect decimal reader isRepeating flag > --- > >

[jira] [Closed] (ORC-1753) Use Avro 1.12.0 in bench module

[ https://issues.apache.org/jira/browse/ORC-1753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed ORC-1753. -- > Use Avro 1.12.0 in bench module > --- > > K

[jira] [Closed] (ORC-1732) [C++] Can't detect Protobuf installed by Homebrew on macOS

[ https://issues.apache.org/jira/browse/ORC-1732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed ORC-1732. -- > [C++] Can't detect Protobuf installed by Homebrew

[jira] [Closed] (ORC-1697) Fix IllegalArgumentException when reading json timestamp type in benchmark

[ https://issues.apache.org/jira/browse/ORC-1697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed ORC-1697. -- > Fix IllegalArgumentException when reading json timestamp type in benchm

[jira] [Closed] (ORC-1694) Upgrade gson to 2.9.0 for Benchmarks Hive

[ https://issues.apache.org/jira/browse/ORC-1694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed ORC-1694. -- > Upgrade gson to 2.9.0 for Benchmarks H

[jira] [Closed] (ORC-1747) Upgrade `zstd-jni` to 1.5.6-4

[ https://issues.apache.org/jira/browse/ORC-1747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed ORC-1747. -- > Upgrade `zstd-jni` to 1.5.6-4 > - > > K

[jira] [Closed] (ORC-1749) Fix `supportVectoredIO` for hadoop version string with optional patch labels

[ https://issues.apache.org/jira/browse/ORC-1749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed ORC-1749. -- > Fix `supportVectoredIO` for hadoop version string with optional patch lab

[jira] [Closed] (ORC-1743) Upgrade Spark to 4.0.0-preview1

[ https://issues.apache.org/jira/browse/ORC-1743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed ORC-1743. -- > Upgrade Spark to 4.0.0-preview1 > --- > > K

[jira] [Updated] (ORC-1742) Support print the id, name and type of each column in dump tool

[ https://issues.apache.org/jira/browse/ORC-1742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated ORC-1742: --- Summary: Support print the id, name and type of each column in dump tool (was: Suppor print the id

[VOTE][RESULT] Release Apache ORC 2.0.2 (RC0)

The vote passed with 4 +1s (3 binding +1s). Thanks to all who helped with the release! (* = binding) +1: - Dongjoon Hyun * - Gang Wu * - William Hyun * - Shaoyun Chen +0: None -1: None

[jira] [Resolved] (SPARK-49243) Add `OpenContainers` Annotations in docker images

[ https://issues.apache.org/jira/browse/SPARK-49243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49243. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47766 [https

[jira] [Assigned] (SPARK-49243) Add `OpenContainers` Annotations in docker images

[ https://issues.apache.org/jira/browse/SPARK-49243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49243: - Assignee: Dongjoon Hyun > Add `OpenContainers` Annotations in docker ima

[jira] [Updated] (SPARK-49243) Add `OpenContainers` Annotations in docker images

[ https://issues.apache.org/jira/browse/SPARK-49243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49243: -- Description: h3. BEFORE {code:java} $ docker inspect apache/spark:3.5.2 | jq 

[jira] [Updated] (SPARK-49243) Add `OpenContainers` Annotations in docker images

[ https://issues.apache.org/jira/browse/SPARK-49243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49243: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Task) > Add `OpenContain

[jira] [Created] (SPARK-49243) Add `OpenContainers` Annotations in docker images

Dongjoon Hyun created SPARK-49243: - Summary: Add `OpenContainers` Annotations in docker images Key: SPARK-49243 URL: https://issues.apache.org/jira/browse/SPARK-49243 Project: Spark Issue

Re: [VOTE] Release Apache ORC 2.0.2 (RC0)

Total Test time (real) = 355.55 sec > Built target test-out > ``` > > ``` > java -version > openjdk version "17.0.6" 2023-01-17 LTS > OpenJDK Runtime Environment Zulu17.40+19-CA (build 17.0.6+10-LTS) > OpenJDK 64-Bit Server VM Zulu17.40+19-CA (build 17.0.6+10-LT

[jira] [Assigned] (SPARK-49240) Add `scalastyle` and `checkstyle` rules to avoid `URL` constructors

[ https://issues.apache.org/jira/browse/SPARK-49240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49240: - Assignee: Dongjoon Hyun > Add `scalastyle` and `checkstyle` rules to avoid `

[jira] [Created] (SPARK-49240) Add `scalastyle` and `checkstyle` rules to avoid `URL` constructors

Dongjoon Hyun created SPARK-49240: - Summary: Add `scalastyle` and `checkstyle` rules to avoid `URL` constructors Key: SPARK-49240 URL: https://issues.apache.org/jira/browse/SPARK-49240 Project: Spark

[jira] [Resolved] (SPARK-49239) Add `k8s-integration-tests` GitHub Action CI job

[ https://issues.apache.org/jira/browse/SPARK-49239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49239. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-49238) Upgrade Gradle to 8.10

[ https://issues.apache.org/jira/browse/SPARK-49238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49238. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-49239) Add `k8s-integration-tests` GitHub Action CI job

[ https://issues.apache.org/jira/browse/SPARK-49239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49239: - Assignee: Dongjoon Hyun > Add `k8s-integration-tests` GitHub Action CI

[jira] [Assigned] (SPARK-49238) Upgrade Gradle to 8.10

[ https://issues.apache.org/jira/browse/SPARK-49238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49238: - Assignee: Dongjoon Hyun > Upgrade Gradle to 8

[jira] [Created] (SPARK-49239) Add `k8s-integration-tests` GitHub Action CI job

Dongjoon Hyun created SPARK-49239: - Summary: Add `k8s-integration-tests` GitHub Action CI job Key: SPARK-49239 URL: https://issues.apache.org/jira/browse/SPARK-49239 Project: Spark Issue

[jira] [Created] (SPARK-49238) Upgrade Gradle to 8.10

Dongjoon Hyun created SPARK-49238: - Summary: Upgrade Gradle to 8.10 Key: SPARK-49238 URL: https://issues.apache.org/jira/browse/SPARK-49238 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-49237) Speed up docker image building by excluding `check` instead of `test`

[ https://issues.apache.org/jira/browse/SPARK-49237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49237. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-49237) Speed up docker image building by excluding `check` instead of `test`

[ https://issues.apache.org/jira/browse/SPARK-49237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49237: - Assignee: Dongjoon Hyun > Speed up docker image building by excluding `check` inst

[jira] [Created] (SPARK-49237) Speed up docker image building by excluding `check` instead of `test`

Dongjoon Hyun created SPARK-49237: - Summary: Speed up docker image building by excluding `check` instead of `test` Key: SPARK-49237 URL: https://issues.apache.org/jira/browse/SPARK-49237 Project

[jira] [Resolved] (SPARK-49236) Update `README.md` with `build/test/CI` info

[ https://issues.apache.org/jira/browse/SPARK-49236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49236. --- Fix Version/s: kubernetes-operator-0.1.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-49236) Update `README.md` with `build/test/CI` info

[ https://issues.apache.org/jira/browse/SPARK-49236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49236: - Assignee: Dongjoon Hyun > Update `README.md` with `build/test/CI` i

[jira] [Created] (SPARK-49236) Update `README.md` with `build/test/CI` info

Dongjoon Hyun created SPARK-49236: - Summary: Update `README.md` with `build/test/CI` info Key: SPARK-49236 URL: https://issues.apache.org/jira/browse/SPARK-49236 Project: Spark Issue Type

[jira] [Commented] (SPARK-44120) Support Python 3.12

[ https://issues.apache.org/jira/browse/SPARK-44120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17873589#comment-17873589 ] Dongjoon Hyun commented on SPARK-44120: --- Thank you for the feedback, [~raphae

[jira] [Resolved] (SPARK-49232) Remove `3.4.2` from `SKIP_SPARK_RELEASE_VERSIONS`

[ https://issues.apache.org/jira/browse/SPARK-49232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49232. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47748 [https

[jira] [Commented] (SPARK-49038) Spark UI is showing wrong timing metrics for min and median time.

[ https://issues.apache.org/jira/browse/SPARK-49038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17873406#comment-17873406 ] Dongjoon Hyun commented on SPARK-49038: --- This landed at branch-3.5/3.4 via [h

[jira] [Updated] (SPARK-49038) Spark UI is showing wrong timing metrics for min and median time.

[ https://issues.apache.org/jira/browse/SPARK-49038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49038: -- Fix Version/s: 3.4.4 3.5.3 > Spark UI is showing wrong timing metrics

[jira] [Created] (SPARK-49234) Upgrade `xz` to `1.10`

Dongjoon Hyun created SPARK-49234: - Summary: Upgrade `xz` to `1.10` Key: SPARK-49234 URL: https://issues.apache.org/jira/browse/SPARK-49234 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-49228) Investigate ExternalAppendOnlyUnsafeRowArrayBenchmark

[ https://issues.apache.org/jira/browse/SPARK-49228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17873394#comment-17873394 ] Dongjoon Hyun commented on SPARK-49228: --- Thank you, [~Lucifer

[jira] [Assigned] (SPARK-49228) Investigate ExternalAppendOnlyUnsafeRowArrayBenchmark

[ https://issues.apache.org/jira/browse/SPARK-49228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49228: - Assignee: Dongjoon Hyun > Investigate ExternalAppendOnlyUnsafeRowArrayBenchm

[jira] [Resolved] (SPARK-49228) Investigate ExternalAppendOnlyUnsafeRowArrayBenchmark

[ https://issues.apache.org/jira/browse/SPARK-49228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49228. --- Resolution: Done This is resolved by reverting the root cause via [https://github.com

[jira] [Reopened] (SPARK-48628) Add task peak on/off heap execution memory metrics

[ https://issues.apache.org/jira/browse/SPARK-48628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-48628: --- Assignee: (was: Ziqi Liu) > Add task peak on/off heap execution memory metr

[jira] [Commented] (SPARK-48628) Add task peak on/off heap execution memory metrics

[ https://issues.apache.org/jira/browse/SPARK-48628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17873392#comment-17873392 ] Dongjoon Hyun commented on SPARK-48628: --- This is reverted via [h

Re: [VOTE] Release Apache ORC 2.0.2 (RC0)

joon for driving this! > > > > Best, > > Gang > > > > On Mon, Aug 12, 2024 at 6:34 AM Dongjoon Hyun > > wrote: > > > > > +1 > > > > > > I tested the following as a release manager. > > > - Checksum and sign. > > > -

[jira] [Resolved] (SPARK-49224) Regenerate benchmark results

[ https://issues.apache.org/jira/browse/SPARK-49224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49224. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47743 [https

[jira] [Updated] (SPARK-48913) Implement IndentingXMLStreamWriter

[ https://issues.apache.org/jira/browse/SPARK-48913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48913: -- Summary: Implement IndentingXMLStreamWriter (was: Avoid `com.sun.xml.txw2

[jira] [Assigned] (SPARK-48913) Implement IndentingXMLStreamWriter

[ https://issues.apache.org/jira/browse/SPARK-48913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48913: - Assignee: (was: Dongjoon Hyun) > Implement IndentingXMLStreamWri

[jira] [Resolved] (SPARK-48913) Avoid `com.sun.xml.txw2.output.IndentingXMLStreamWriter` usage

[ https://issues.apache.org/jira/browse/SPARK-48913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48913. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47593 [https

[jira] [Resolved] (SPARK-49038) Spark UI is showing wrong timing metrics for min and median time.

[ https://issues.apache.org/jira/browse/SPARK-49038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49038. --- Fix Version/s: 4.0.0 Assignee: Wenchen Fan Resolution: Fixed This is

[jira] [Created] (SPARK-49228) Investigate ExternalAppendOnlyUnsafeRowArrayBenchmark

Dongjoon Hyun created SPARK-49228: - Summary: Investigate ExternalAppendOnlyUnsafeRowArrayBenchmark Key: SPARK-49228 URL: https://issues.apache.org/jira/browse/SPARK-49228 Project: Spark

[jira] [Created] (SPARK-49224) Regenerate benchmark results

Dongjoon Hyun created SPARK-49224: - Summary: Regenerate benchmark results Key: SPARK-49224 URL: https://issues.apache.org/jira/browse/SPARK-49224 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-49179) Fix v2 multi bucketed inner joins throw AssertionError

[ https://issues.apache.org/jira/browse/SPARK-49179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49179: -- Fix Version/s: (was: 3.4.4) (was: 3.5.3) > Fix v2 multi bucke

[jira] [Updated] (SPARK-49187) Upgrade slf4j to 2.0.16

[ https://issues.apache.org/jira/browse/SPARK-49187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49187: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Upgrade slf4j

[jira] [Assigned] (SPARK-49199) `build/mvn` should check project local install Maven ahead

[ https://issues.apache.org/jira/browse/SPARK-49199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-49199: - Assignee: Cheng Pan > `build/mvn` should check project local install Maven ah

[jira] [Resolved] (SPARK-49199) `build/mvn` should check project local install Maven ahead

[ https://issues.apache.org/jira/browse/SPARK-49199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-49199. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 47706 [https

Re: [DISCUSS] Deprecating SparkR

+1 Dongjoon On Mon, Aug 12, 2024 at 17:52 Holden Karau wrote: > +1 > > Are the sparklyr folks on this list? > > Twitter: https://twitter.com/holdenkarau > Books (Learning Spark, High Performance Spark, etc.): > https://amzn.to/2MaRAG9 > YouTube Live Streams: https://w

Re: Welcome new Apache Spark committers

Congratulations, Martin, Haejoon, Allison. :) Dongjoon On Mon, Aug 12, 2024 at 5:19 PM Hyukjin Kwon wrote: > Hi all, > > The Spark PMC recently voted to add three new committers. Please join me > in welcoming them to their new role! > > - Martin Grund > - Haejoon Lee > - Allison Wang > > They c

Re: Welcoming a new PMC member

Congratulations, Kent. Dongjoon. On Mon, Aug 12, 2024 at 5:22 PM Xiao Li wrote: > Congratulations ! > > Hyukjin Kwon 于2024年8月12日周一 17:20写道： > >> Hi all, >> >> The Spark PMC recently voted to add a new PMC member, Kent Yao. Join me >> in welcoming him to his new role! >> >>

[jira] [Updated] (SPARK-49197) Redact `Spark Command` output in `launcher` module

[ https://issues.apache.org/jira/browse/SPARK-49197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49197: -- Description: When `launcher` module shows `Spark Command`, there is no redaction. Although

<    1   2   3   4   5   6   7   8   9   10   >