(spark) branch master updated: [SPARK-46287][PYTHON][CONNECT] `DataFrame.isEmpty` should work with all datatypes

2023-12-06 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f4e41e0e318 [SPARK-46287][PYTHON][CONNECT

(spark) branch master updated: [SPARK-46288][PS][TESTS] Remove unused code in `pyspark.pandas.tests.frame.*`

2023-12-06 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f6861c3918b [SPARK-46288][PS][TESTS] Remove

(spark) branch master updated: [SPARK-46268][PS][CONNECT][TESTS] Re-organize `StatsTests`

2023-12-05 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ef05fb632424 [SPARK-46268][PS][CONNECT][TESTS

(spark) branch master updated: [SPARK-46271][PS][TESTS] Remove unused properties in `pyspark.pandas.tests.groupby.*`

2023-12-05 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a56ca8a673d7 [SPARK-46271][PS][TESTS] Remove

(spark) branch master updated: [SPARK-46266][PS][CONNECT][TESTS] Re-organize `NumOpsTests`

2023-12-05 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e9ba896f8446 [SPARK-46266][PS][CONNECT][TESTS

(spark) branch master updated (7c741c8c25fc -> 9808ad3ac322)

2023-12-05 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 7c741c8c25fc [SPARK-46265][CONNECT] Assertions in AddArtifact RPC make the connect client incompatible with older

(spark) branch master updated: [SPARK-46219][SQL] Unwrap cast in join predicates

2023-12-05 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8235f1d56bf2 [SPARK-46219][SQL] Unwrap cast in

(spark) branch master updated (b4bf9ec065bf -> c8451b58a3c4)

2023-12-05 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from b4bf9ec065bf [SPARK-46269][PS] Enable more NumPy compatibility function tests add c8451b58a3c4 [SPARK-46069

(spark) branch master updated: [SPARK-46269][PS] Enable more NumPy compatibility function tests

2023-12-05 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b4bf9ec065bf [SPARK-46269][PS] Enable more

(spark) branch master updated: [SPARK-46258][CORE] Add `RocksDBPersistenceEngine`

2023-12-05 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new dd11075db618 [SPARK-46258][CORE] Add

(spark) branch master updated: [SPARK-46233][PYTHON] Migrate all remaining `AttributeError` into PySpark error framework

2023-12-04 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new be49ca6dd71b [SPARK-46233][PYTHON] Migrate all

(spark) branch branch-3.3 updated: [SPARK-46239][CORE] Hide `Jetty` info

2023-12-04 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new aaec17fb244c [SPARK-46239][CORE] Hide

(spark) branch branch-3.4 updated: [SPARK-46239][CORE] Hide `Jetty` info

2023-12-04 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 757c3a9d62b7 [SPARK-46239][CORE] Hide

(spark) branch branch-3.5 updated: [SPARK-46239][CORE] Hide `Jetty` info

2023-12-04 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 1321b4e64dea [SPARK-46239][CORE] Hide

(spark) branch master updated: [SPARK-46239][CORE] Hide `Jetty` info

2023-12-04 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ff4f59341215 [SPARK-46239][CORE] Hide `Jetty

(spark) branch branch-3.3 updated: [SPARK-46092][SQL][3.3] Don't push down Parquet row group filters that overflow

2023-12-04 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new c9412307394f [SPARK-46092][SQL][3.3

(spark) branch master updated: [SPARK-46245][CORE][SQL][SS][YARN][K8S][UI] Replcace `s.c.MapOps.view.filterKeys` with `s.c.MapOps.filter`

2023-12-04 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ac0bd2eb7b40 [SPARK-46245][CORE][SQL][SS][YARN

(spark) branch master updated: [SPARK-32246][BUILD][INFRA] Enable `streaming-kinesis-asl` tests in Github Action CI

2023-12-04 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 64ec5f1017e1 [SPARK-32246][BUILD][INFRA

(spark) branch branch-3.4 updated: [SPARK-46092][SQL][3.4] Don't push down Parquet row group filters that overflow

2023-12-04 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 05b5c9e2e3df [SPARK-46092][SQL][3.4

(spark) branch branch-3.5 updated: [SPARK-46092][SQL][3.5] Don't push down Parquet row group filters that overflow

2023-12-04 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 97472c91ed56 [SPARK-46092][SQL][3.5

(spark) branch master updated: [SPARK-46231][PYTHON] Migrate all remaining `NotImplementedError` & `TypeError` into PySpark error framework

2023-12-04 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 9666bf37958e [SPARK-46231][PYTHON] Migrate all

(spark) branch master updated: [SPARK-46237][SQL][TESTS] Make `HiveDDLSuite` independently testable

2023-12-04 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 37d19b9ee0e4 [SPARK-46237][SQL][TESTS] Make

(spark) branch master updated: [SPARK-46232][PYTHON] Migrate all remaining ValueError into PySpark error framework

2023-12-03 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b23ae15da019 [SPARK-46232][PYTHON] Migrate all

(spark) branch branch-3.4 updated: [SPARK-46182][CORE] Track `lastTaskFinishTime` using the exact task finished event

2023-12-03 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new b8750d5c0b41 [SPARK-46182][CORE] Track

(spark) branch branch-3.5 updated: [SPARK-46182][CORE] Track `lastTaskFinishTime` using the exact task finished event

2023-12-03 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 273ef5708fc3 [SPARK-46182][CORE] Track

(spark) branch master updated: [SPARK-46182][CORE] Track `lastTaskFinishTime` using the exact task finished event

2023-12-03 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 6f112f7b1a50 [SPARK-46182][CORE] Track

(spark) branch master updated (0c029e70706c -> 712352e37ec5)

2023-12-03 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 0c029e70706c [SPARK-46218][BUILD] Upgrade commons-cli to 1.6.0 add 712352e37ec5 [SPARK-40559][PYTHON][DOCS

(spark) branch master updated: [SPARK-46218][BUILD] Upgrade commons-cli to 1.6.0

2023-12-03 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 0c029e70706c [SPARK-46218][BUILD] Upgrade

(spark) branch master updated: [SPARK-46227][SQL] Move `withSQLConf` from `SQLHelper` to `SQLConfHelper`

2023-12-03 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new aee6b1582775 [SPARK-46227][SQL] Move

(spark) branch master updated: [SPARK-46217][CORE][TESTS] Include `Driver/App` data in `PersistenceEngineBenchmark`

2023-12-03 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 5031e52f9e0 [SPARK-46217][CORE][TESTS] Include

(spark) branch master updated: [SPARK-46216][CORE] Improve `FileSystemPersistenceEngine` to support compressions

2023-12-03 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 3da2e5c6324 [SPARK-46216][CORE] Improve

(spark) branch master updated: [SPARK-46206][PS] Use a narrower scope exception for SQL processor

2023-12-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 73a09ed7bd7 [SPARK-46206][PS] Use a narrower

(spark) branch master updated: [SPARK-46212][CORE][SQL][SS][CONNECT][MLLIB][GRAPHX][DSTREAM][PROTOBUF][EXAMPLES] Use other functions to simplify the code pattern of `s.c.MapOps#view.mapValues`

2023-12-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 938b7f58051 [SPARK-46212][CORE][SQL][SS

(spark) branch master updated: [SPARK-46215][CORE] Improve `FileSystemPersistenceEngine` to allow nonexistent parents

2023-12-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d1311f75dea [SPARK-46215][CORE] Improve

(spark) branch master updated: [SPARK-46213][PYTHON] Introduce `PySparkImportError` for error framework

2023-12-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 75b0eb2d6017 [SPARK-46213][PYTHON] Introduce

(spark) branch master updated: [MINOR][DOCS] Add `since` tag for `Scan.reportDriverMetrics`

2023-12-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new aa1eca8d26cc [MINOR][DOCS] Add `since` tag for

(spark) branch master updated: [SPARK-41532][CONNECT][PYTHON][FOLLOWUP] Expose `SessionNotSameException` as PySpark exceptions

2023-12-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ccedc1988fa5 [SPARK-41532][CONNECT][PYTHON

(spark) branch master updated: [SPARK-46205][CORE][TESTS][FOLLOWUP] Simplify PersistenceEngineBenchmark

2023-12-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a6afd09f7f2f [SPARK-46205][CORE][TESTS

(spark) branch branch-3.5 updated: [SPARK-45975][SQL][TESTS][3.5] Reset storeAssignmentPolicy to original

2023-12-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new fde0fe676358 [SPARK-45975][SQL][TESTS

(spark) branch master updated: [SPARK-46092][SQL] Don't push down Parquet row group filters that overflow

2023-12-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8f8e41ea5203 [SPARK-46092][SQL] Don't

(spark) branch master updated: [SPARK-46214][BUILD] Upgrade commons-io to 2.15.1

2023-12-02 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 341b7d7a6e3a [SPARK-46214][BUILD] Upgrade

(spark) branch master updated: [SPARK-46205][CORE] Improve `PersistenceEngine` performance with `KryoSerializer`

2023-12-01 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 0d40b1aea758 [SPARK-46205][CORE] Improve

(spark) branch master updated: [SPARK-46201][PYTHON][DOCS] Correct the typing of `schema_of_{csv, json, xml}`

2023-12-01 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a4678143f6bb [SPARK-46201][PYTHON][DOCS

(spark) branch master updated: [SPARK-46199][PYTHON][DOCS] Add PyPi link icon to PySpark doc header

2023-12-01 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8060e7e73170 [SPARK-46199][PYTHON][DOCS] Add

(spark) branch master updated: [SPARK-46200][INFRA] re-org the testing dockerfile

2023-12-01 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c85d41c558b6 [SPARK-46200][INFRA] re-org the

(spark) branch master updated: [SPARK-46204][K8S] Fix `dev-run-integration-tests.sh` to use 17 for `JAVA_VERSION`

2023-12-01 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d78126978799 [SPARK-46204][K8S] Fix `dev-run

(spark) branch master updated: [SPARK-46193][CORE][TESTS] Add `PersistenceEngineBenchmark`

2023-12-01 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 0e689611f099 [SPARK-46193][CORE][TESTS] Add

(spark) branch master updated: [SPARK-46197][INFRA] Upgrade `memory-profiler>=0.61.0` for Python 3.12

2023-12-01 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 2ff9b7241e46 [SPARK-46197][INFRA] Upgrade

(spark) branch master updated: [SPARK-46196][PYTHON][DOCS] Add missing `toDegrees/toRadians/atan2/approxCountDistinct` function descriptions

2023-12-01 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f0ec157fe833 [SPARK-46196][PYTHON][DOCS] Add

(spark) branch master updated: [SPARK-46194][BUILD] Remove TODO comments left in SPARK-33775

2023-11-30 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a0677302c62d [SPARK-46194][BUILD] Remove TODO

(spark) branch master updated: [SPARK-46191][CORE] Improve `FileSystemPersistenceEngine.persist` error msg in case of the existing file

2023-11-30 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new bfc5ad79bc81 [SPARK-46191][CORE] Improve

(spark) branch master updated: [SPARK-46184][CORE][SQL][CONNECT][MLLIB] Reduce stack depth by replace Option.isDefined with Option.isEmpty

2023-11-30 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 783c7bc0092a [SPARK-46184][CORE][SQL][CONNECT

svn commit: r65708 - /release/spark/spark-3.4.1/

2023-11-30 Thread dongjoon
Author: dongjoon Date: Thu Nov 30 10:26:03 2023 New Revision: 65708 Log: Remove Apache Spark 3.4.1 after releasing 3.4.2 Removed: release/spark/spark-3.4.1/ - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org

(spark) tag v3.4.2 created (now 0c0e7d4087c6)

2023-11-30 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to tag v3.4.2 in repository https://gitbox.apache.org/repos/asf/spark.git at 0c0e7d4087c6 (commit) No new revisions were added by this update

svn commit: r65707 - /dev/spark/v3.4.2-rc1-bin/ /release/spark/spark-3.4.2/

2023-11-30 Thread dongjoon
Author: dongjoon Date: Thu Nov 30 10:08:30 2023 New Revision: 65707 Log: Release Apache Spark 3.4.2 Added: release/spark/spark-3.4.2/ - copied from r65706, dev/spark/v3.4.2-rc1-bin/ Removed: dev/spark/v3.4.2-rc1-bin

(spark) branch master updated: [SPARK-46060][BUILD][TESTS] Upgrade `MySQL/MariaDB/PostgreSQL/DB2` test dependencies

2023-11-29 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 9987cab84bb [SPARK-46060][BUILD][TESTS

(spark) branch master updated: [SPARK-46133][CORE][DOCS] Make `ShuffleWriteProcessor.write` method description up-to-date

2023-11-29 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c6793fd4847 [SPARK-46133][CORE][DOCS] Make

(spark) branch master updated: [SPARK-45267][PS][FOLLOWUP] Remove duplicated test

2023-11-29 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 06c8a5fe32e [SPARK-45267][PS][FOLLOWUP] Remove

(spark) branch master updated: [SPARK-46169][PS] Assign appropriate JIRA numbers for missing parameters from `DataFrame` API

2023-11-29 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 96507921b3b [SPARK-46169][PS] Assign

(spark) branch master updated: [SPARK-46172][SQL][DOCS] Describe arguments of `encode()`

2023-11-29 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 1bd2a975ba8 [SPARK-46172][SQL][DOCS] Describe

(spark) branch master updated: [SPARK-46174][BUILD] Upgrade `gcs-connector` to 2.2.18

2023-11-29 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 7bdabaae32d [SPARK-46174][BUILD] Upgrade `gcs

(spark) branch master updated: [SPARK-46155][INFRA] Upgrade github-script action to v7

2023-11-29 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8bd9c8c00db [SPARK-46155][INFRA] Upgrade

(spark) branch master updated (587c863f261 -> f9e69642d38)

2023-11-28 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 587c863f261 [SPARK-46147][PS][TESTS] Fix the doctest in pyspark.pandas.series.Seires.to_dict (Python 3.12) add

(spark) branch master updated: [SPARK-46147][PS][TESTS] Fix the doctest in pyspark.pandas.series.Seires.to_dict (Python 3.12)

2023-11-28 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 587c863f261 [SPARK-46147][PS][TESTS] Fix the

(spark) branch master updated: [SPARK-46140][SQL][TESTS] Remove comments about JVM module options from `HiveExternalCatalogVersionsSuite`

2023-11-28 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 6a300ce9ed3 [SPARK-46140][SQL][TESTS] Remove

(spark) branch master updated: [SPARK-46134][PROTOBUF][TESTS] Replace `df.take(1).toSeq(0)` with `df.first()` in `ProtobufFunctionsSuite`

2023-11-28 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 9183ddec108 [SPARK-46134][PROTOBUF][TESTS

(spark) branch master updated: [SPARK-46119][SQL] Override `toString` method for `UnresolvedAlias`

2023-11-28 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 7b2f6bfa202 [SPARK-46119][SQL] Override

(spark) branch master updated: [SPARK-46139][SQL][TESTS] Fix `QueryExecutionErrorsSuite` with Java 21

2023-11-28 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 931e68b88d0b [SPARK-46139][SQL][TESTS] Fix

(spark) branch master updated: [SPARK-46089][BUILD] Upgrade commons-lang3 to 3.14.0

2023-11-27 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e6edb1013b74 [SPARK-46089][BUILD] Upgrade

svn commit: r65531 - in /dev/spark/v3.4.2-rc1-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/R/articles/ _site/api/R/deps/ _site/api/R/deps/bootstrap-5.3.1/ _site/api/R/deps/bootstrap-5.3.1/fonts/

2023-11-25 Thread dongjoon
Author: dongjoon Date: Sat Nov 25 08:57:37 2023 New Revision: 65531 Log: Apache Spark v3.4.2-rc1 docs [This commit notification would consist of 2987 parts, which exceeds the limit of 50 ones, so it was shortened to the summary

svn commit: r65530 - /dev/spark/v3.4.2-rc1-bin/

2023-11-24 Thread dongjoon
Author: dongjoon Date: Sat Nov 25 07:49:57 2023 New Revision: 65530 Log: Apache Spark v3.4.2-rc1 Added: dev/spark/v3.4.2-rc1-bin/ dev/spark/v3.4.2-rc1-bin/SparkR_3.4.2.tar.gz (with props) dev/spark/v3.4.2-rc1-bin/SparkR_3.4.2.tar.gz.asc dev/spark/v3.4.2-rc1-bin/SparkR_3.4.2

(spark) 01/01: Preparing development version 3.4.3-SNAPSHOT

2023-11-24 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git commit aff5a9f82ae2895a8a43b34ad4d3148441255333 Author: Dongjoon Hyun AuthorDate: Sat Nov 25 06:40:37 2023 +

(spark) branch branch-3.4 updated (03dac186d84 -> aff5a9f82ae)

2023-11-24 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git from 03dac186d84 [SPARK-46095][DOCS] Document `REST API` for Spark Standalone Cluster add 0c0e7d4087c Preparing

(spark) 01/01: Preparing Spark release v3.4.2-rc1

2023-11-24 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to tag v3.4.2-rc1 in repository https://gitbox.apache.org/repos/asf/spark.git commit 0c0e7d4087c64efca259b4fb656b8be643be5686 Author: Dongjoon Hyun AuthorDate: Sat Nov 25 06:40:32 2023 +

(spark) tag v3.4.2-rc1 created (now 0c0e7d4087c)

2023-11-24 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to tag v3.4.2-rc1 in repository https://gitbox.apache.org/repos/asf/spark.git at 0c0e7d4087c (commit) This tag includes the following new commits: new 0c0e7d4087c Preparing Spark release

(spark) branch master updated: [SPARK-46085][CONNECT] Dataset.groupingSets in Scala Spark Connect client

2023-11-24 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 5211f6b140a [SPARK-46085][CONNECT

(spark) branch branch-3.4 updated: [SPARK-46095][DOCS] Document `REST API` for Spark Standalone Cluster

2023-11-24 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 03dac186d84 [SPARK-46095][DOCS

(spark) branch branch-3.5 updated: [SPARK-46095][DOCS] Document `REST API` for Spark Standalone Cluster

2023-11-24 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 132c1a1f08d [SPARK-46095][DOCS

(spark) branch master updated: [SPARK-46095][DOCS] Document `REST API` for Spark Standalone Cluster

2023-11-24 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a694a8a0be5 [SPARK-46095][DOCS] Document `REST

(spark) branch master updated: [SPARK-46066][SQL] Use the Separators API instead of the String API to construct the `DefaultPrettyPrinter`

2023-11-24 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 50f189b3f48 [SPARK-46066][SQL] Use the

(spark) branch master updated (4530b12090e -> 441e15ef5f1)

2023-11-24 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 4530b12090e [SPARK-45356][INFRA] Adjust the test configuration of `maven_test.yml` add 441e15ef5f1 [SPARK

(spark) branch master updated: [SPARK-46084][PS] Refactor data type casting operation for Categorical type

2023-11-23 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 6ad80fd0368 [SPARK-46084][PS] Refactor data

(spark) branch master updated (10b9c61ee9a -> 1131a56d1f3)

2023-11-23 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 10b9c61ee9a [SPARK-46083][PYTHON] Make SparkNoSuchElementException as a canonical error API add 1131a56d1f3

(spark) branch master updated: [SPARK-46083][PYTHON] Make SparkNoSuchElementException as a canonical error API

2023-11-23 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 10b9c61ee9a [SPARK-46083][PYTHON] Make

(spark) branch master updated: [SPARK-46080][PYTHON] Upgrade Cloudpickle to 3.0.0

2023-11-23 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d3d35ab3e64 [SPARK-46080][PYTHON] Upgrade

(spark) branch master updated: [SPARK-46081][INFRA] Set `DEDICATED_JVM_SBT_TESTS` in `build_java21.yml`

2023-11-23 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4be5e218dc3 [SPARK-46081][INFRA] Set

(spark) branch master updated: [SPARK-46079][INFRA] Install `torch` nightly only at Python 3.12 in Infra docker image

2023-11-23 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 37f8221926b [SPARK-46079][INFRA] Install

(spark) branch master updated: [MINOR][CORE][TESTS] Move `TransportConfSuite.java` to correct directory

2023-11-23 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4670410f59a [MINOR][CORE][TESTS] Move

(spark) branch master updated: [SPARK-46059][INFRA][PYTHON] Install `six==1.16.0` explicitly for `pandas` in Python 3.12

2023-11-22 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 7220d134670 [SPARK-46059][INFRA][PYTHON

(spark) branch master updated: [SPARK-46042][FOLLOWUP][CONNECT] Test and adapt to streaming RPC behavior change from grpc 1.56 to 1.59

2023-11-22 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 9c291e1165c1 [SPARK-46042][FOLLOWUP][CONNECT

(spark) branch branch-3.4 updated: [MINOR][BUILD] Rename gprcVersion to grpcVersion in SparkBuild

2023-11-22 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 0fd150112fc7 [MINOR][BUILD] Rename

(spark) branch master updated: [SPARK-46042][CONNECT] Reenable a `releaseSession` test case in SparkConnectServiceE2ESuite

2023-11-22 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 2966c791cb90 [SPARK-46042][CONNECT] Reenable a

(spark) branch branch-3.5 updated: [MINOR][BUILD] Rename gprcVersion to grpcVersion in SparkBuild

2023-11-22 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 18bcd020118a [MINOR][BUILD] Rename

(spark) branch master updated: [SPARK-46053][TESTS] Support `DEDICATED_JVM_SBT_TESTS`

2023-11-22 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c4a7588cbd5 [SPARK-46053][TESTS] Support

(spark) branch master updated: [SPARK-46045][DOCS][PS] Add individual categories for `Options and settings` to API reference

2023-11-21 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b6d6cf30efb [SPARK-46045][DOCS][PS] Add

(spark) branch master updated: [SPARK-46038][BUILD] Upgrade log4j2 to 2.22.0

2023-11-21 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 6622d56c062 [SPARK-46038][BUILD] Upgrade

(spark) branch master updated: [SPARK-46035][BUILD] Upgrade zstd-jni to 1.5.5-10

2023-11-21 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 354a5374208 [SPARK-46035][BUILD] Upgrade zstd

(spark) branch branch-3.3 updated: [SPARK-46012][CORE][FOLLOWUP] Invoke `fs.listStatus` once and reuse the result

2023-11-21 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new b412cc5529c [SPARK-46012][CORE

(spark) branch branch-3.4 updated: [SPARK-46012][CORE][FOLLOWUP] Invoke `fs.listStatus` once and reuse the result

2023-11-21 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new d1277836354 [SPARK-46012][CORE

(spark) branch branch-3.5 updated: [SPARK-46012][CORE][FOLLOWUP] Invoke `fs.listStatus` once and reuse the result

2023-11-21 Thread dongjoon
This is an automated email from the ASF dual-hosted git repository. dongjoon pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 20657549acf [SPARK-46012][CORE

<    8   9   10   11   12   13   14   15   16   17   >