(spark) branch master updated: [SPARK-48012][SQL] SPJ: Support Transfrom Expressions for One Side Shuffle

2024-06-09 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 24bce72c9065 [SPARK-48012][SQL] SPJ: Support

(spark) branch master updated: [SPARK-48392][CORE][FOLLOWUP] Add `--load-spark-defaults` flag to decide whether to load `spark-defaults.conf`

2024-06-01 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8cf3195aed8a [SPARK-48392][CORE][FOLLOWUP] Add

(spark) branch master updated: [SPARK-48392][CORE] Also load `spark-defaults.conf` when provided `--properties-file`

2024-05-28 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new eac413afa0e8 [SPARK-48392][CORE] Also load

(spark) branch master updated: [SPARK-48065][SQL] SPJ: allowJoinKeysSubsetOfPartitionKeys is too strict

2024-05-02 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 5ec62a760bcd [SPARK-48065][SQL] SPJ

(spark) branch master updated: [SPARK-48030][SQL] SPJ: cache rowOrdering and structType for InternalRowComparableWrapper

2024-04-29 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e6217c111fbd [SPARK-48030][SQL] SPJ: cache

(spark) branch master updated: [SPARK-47094][SQL] SPJ : Dynamically rebalance number of buckets when they are not equal

2024-04-05 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 11abc64a731d [SPARK-47094][SQL] SPJ

(spark) branch master updated: [SPARK-42040][SQL] SPJ: Introduce a new API for V2 input partition to report partition statistics

2024-03-26 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new eef44f0e8bd7 [SPARK-42040][SQL] SPJ: Introduce

(spark) branch master updated: [SPARK-46947][CORE] Delay memory manager initialization until Driver plugin is loaded

2024-02-26 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 0ea318f3e23f [SPARK-46947][CORE] Delay memory

(spark) branch master updated: [SPARK-45731][SQL] Also update partition statistics with `ANALYZE TABLE` command

2023-11-09 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ce818ba96953 [SPARK-45731][SQL] Also update

(spark) branch branch-3.4 updated: [SPARK-45678][CORE] Cover BufferReleasingInputStream.available/reset under tryOrFetchFailedException

2023-10-27 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new d8922f36a42 [SPARK-45678][CORE] Cover

(spark) branch branch-3.5 updated: [SPARK-45678][CORE] Cover BufferReleasingInputStream.available/reset under tryOrFetchFailedException

2023-10-27 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 238630e3aca [SPARK-45678][CORE] Cover

(spark) branch master updated: [SPARK-45678][CORE] Cover BufferReleasingInputStream.available/reset under tryOrFetchFailedException

2023-10-27 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 57e73dafeb9 [SPARK-45678][CORE] Cover

[spark] branch master updated: [SPARK-45652][SQL] SPJ: Handle empty input partitions after dynamic filtering

2023-10-26 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8c11804c440 [SPARK-45652][SQL] SPJ: Handle

[spark] branch master updated (4863dec91f1 -> bef11d89cab)

2023-09-29 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 4863dec91f1 [SPARK-45380][CORE][SQL][ML][R][CONNECT] Replace `mutable.WrappedArray` with `mutable.ArraySeq` add

[spark] branch master updated: [SPARK-45365][INFRA] Allow `branch-3.4` daily test to use the new test group tags

2023-09-28 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b938ff9f520 [SPARK-45365][INFRA] Allow `branch

[spark] branch branch-3.4 updated: [SPARK-45054][SQL] HiveExternalCatalog.listPartitions should restore partition statistics

2023-09-01 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new d61bfb87e39 [SPARK-45054][SQL

[spark] branch branch-3.5 updated: [SPARK-45054][SQL] HiveExternalCatalog.listPartitions should restore partition statistics

2023-09-01 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 215f2d1c852 [SPARK-45054][SQL

[spark] branch master updated: [SPARK-45054][SQL] HiveExternalCatalog.listPartitions should restore partition statistics

2023-09-01 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e9962e89335 [SPARK-45054][SQL

[spark] branch master updated: [SPARK-41471][SQL] Reduce Spark shuffle when only one side of a join is KeyGroupedPartitioning

2023-08-24 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ce12f6dbad2 [SPARK-41471][SQL] Reduce Spark

[spark] branch branch-3.4 updated: [SPARK-44641][SQL] Incorrect result in certain scenarios when SPJ is not triggered

2023-08-07 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 5c7d1e2f8a2 [SPARK-44641][SQL

[spark] branch branch-3.5 updated: [SPARK-44641][SQL] Incorrect result in certain scenarios when SPJ is not triggered

2023-08-07 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 06871f2ae4c [SPARK-44641][SQL

[spark] branch master updated: [SPARK-44641][SQL] Incorrect result in certain scenarios when SPJ is not triggered

2023-08-07 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new aa1261dc129 [SPARK-44641][SQL] Incorrect result

[spark] branch master updated: [SPARK-42454][SQL] SPJ: encapsulate all SPJ related parameters in BatchScanExec

2023-07-14 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c63ba6c4f43 [SPARK-42454][SQL] SPJ: encapsulate

[spark] branch master updated: [SPARK-43494][CORE] Directly call `replicate()` for `HdfsDataOutputStreamBuilder` instead of reflection in `SparkHadoopUtil#createFile`

2023-05-15 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 98da24869b6 [SPARK-43494][CORE] Directly call

[spark] branch master updated (46332d985e5 -> cfd09a2a9e1)

2023-05-12 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 46332d985e5 [SPARK-43484][BUILD][DSTREAM] Kafka/Kinesis Assembly should not package hadoop-client-runtime add

[spark] branch master updated (1782d0ed9d3 -> 46332d985e5)

2023-05-12 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 1782d0ed9d3 [SPARK-43386][SQL] Improve list of suggested column/attributes in `UNRESOLVED_COLUMN.WITH_SUGGESTION

[spark] branch master updated: [SPARK-43410][SQL] Improve vectorized loop for Packed skipValues

2023-05-08 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new fd9b8a094b0 [SPARK-43410][SQL] Improve

[spark] branch master updated: [SPARK-43248][SQL] Unnecessary serialize/deserialize of Path on parallel gather partition stats

2023-04-26 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d243fb88803 [SPARK-43248][SQL] Unnecessary

[spark] branch master updated (31aba5bef92 -> 35f0d8e9a2d)

2023-04-24 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 31aba5bef92 [SPARK-43217] Correctly recurse in nested maps/arrays in findNestedField add 35f0d8e9a2d [SPARK

[spark] branch master updated (958a7d594d4 -> 2cbe0494f2e)

2023-04-21 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 958a7d594d4 [SPARK-43179][SHUFFLE] Allowing apps to control whether their metadata gets saved in the db

[spark] branch master updated: [SPARK-43211][HIVE] Remove Hadoop2 support in IsolatedClientLoader

2023-04-20 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 20e07bf51a9 [SPARK-43211][HIVE] Remove Hadoop2

[spark] branch master updated: [SPARK-43202][YARN] Replace reflection w/ direct calling for YARN Resource API

2023-04-20 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 5bade8addd9 [SPARK-43202][YARN] Replace

[spark] branch master updated (55eafb4eb3b -> 01dc1cb491a)

2023-04-20 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 55eafb4eb3b [SPARK-43184][YARN] Resume using enumeration to compare `NodeState.DECOMMISSIONING` state add

[spark] branch master updated: [SPARK-43196][YARN] Replace reflection w/ direct calling for `ContainerLaunchContext#setTokensConf`

2023-04-19 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 87ccfc24023 [SPARK-43196][YARN] Replace

[spark] branch master updated (78407a73aa8 -> 34d1c22980f)

2023-04-19 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 78407a73aa8 [SPARK-43200][DOCS] Remove Hadoop 2 reference in docs add 34d1c22980f [SPARK-43191][CORE] Replace

[spark] branch master updated: [SPARK-43200][DOCS] Remove Hadoop 2 reference in docs

2023-04-19 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 78407a73aa8 [SPARK-43200][DOCS] Remove Hadoop 2

[spark] branch master updated: [SPARK-43195][CORE] Remove unnecessary serializable wrapper in HadoopFSUtils

2023-04-19 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 29b40f6fd0c [SPARK-43195][CORE] Remove

[spark] branch master updated: [SPARK-43187][TEST] Remove workaround for MiniKdc's BindException

2023-04-19 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 77b72fc5535 [SPARK-43187][TEST] Remove

[spark] branch master updated: [SPARK-43186][SQL][HIVE] Remove workaround for FileSinkDesc

2023-04-19 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 2097581dfb2 [SPARK-43186][SQL][HIVE] Remove

[spark] branch master updated: [SPARK-42452][BUILD] Remove `hadoop-2` profile from Apache Spark 3.5.0

2023-04-18 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 816ebaca4a8 [SPARK-42452][BUILD] Remove `hadoop

[spark] branch master updated (d31718d6c70 -> 52c10681908)

2023-04-15 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from d31718d6c70 [MINOR][CONNECT][PYTHON] Typo fixes add 52c10681908 [SPARK-42388][SQL] Avoid parquet footer reads

[spark] branch master updated: [SPARK-43150][SQL] Remove workaround for PARQUET-2160

2023-04-14 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8deb950f09c [SPARK-43150][SQL] Remove

[spark] branch master updated: [SPARK-43064][SQL] Spark SQL CLI SQL tab should only show once statement once

2023-04-14 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4708adc9185 [SPARK-43064][SQL] Spark SQL CLI

[spark] branch master updated: [SPARK-43104][BUILD] Set `shadeTestJar` of `protobuf` module to `false`

2023-04-14 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 70094dac1eb [SPARK-43104][BUILD] Set

[spark] branch master updated: [SPARK-43121][SQL] Use `BytesWritable.copyBytes` instead of manual copy in `HiveInspectors

2023-04-13 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 5e9ed5bcadd [SPARK-43121][SQL] Use

[spark] branch branch-3.4 updated: [SPARK-43126][SQL] Mark two Hive UDF expressions as stateful

2023-04-13 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 1a0c6e2484a [SPARK-43126][SQL] Mark two

[spark] branch master updated (c73c7003c6f -> e117f624d51)

2023-04-13 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from c73c7003c6f [SPARK-43135][INFRA] Remove `branch-3.2` from `publish_snapshot` GitHub Action job add e117f624d51

[spark] branch master updated (fa4978a6601 -> c73c7003c6f)

2023-04-13 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from fa4978a6601 [SPARK-43085][SQL] Support column DEFAULT assignment for multi-part table names add c73c7003c6f

[spark] branch branch-3.4 updated: [SPARK-42480][SQL] Improve the performance of drop partitions

2023-03-08 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 5eb4edf53c4 [SPARK-42480][SQL] Improve

[spark] branch master updated: [SPARK-42480][SQL] Improve the performance of drop partitions

2023-03-08 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 153ace7075e [SPARK-42480][SQL] Improve

[spark] branch master updated: [SPARK-42539][SQL][HIVE] Eliminate separate classloader when using 'builtin' Hive version for metadata client

2023-03-01 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 2e34427d4f3 [SPARK-42539][SQL][HIVE] Eliminate

[spark] branch branch-3.4 updated: [SPARK-42539][SQL][HIVE] Eliminate separate classloader when using 'builtin' Hive version for metadata client

2023-02-27 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 40a4019dfc5 [SPARK-42539][SQL][HIVE

[spark] branch master updated (fdb36df3f60 -> 27ad5830f9a)

2023-02-27 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from fdb36df3f60 [SPARK-42542][CONNECT] Support Pivot without providing pivot column values add 27ad5830f9a [SPARK

[spark] branch branch-3.4 updated: [SPARK-41952][SQL] Fix Parquet zstd off-heap memory leak as a workaround for PARQUET-2160

2023-02-20 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 4560d4c4f75 [SPARK-41952][SQL] Fix

[spark] branch branch-3.2 updated: [SPARK-41952][SQL] Fix Parquet zstd off-heap memory leak as a workaround for PARQUET-2160

2023-02-20 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new 0b84da9b59e [SPARK-41952][SQL] Fix

[spark] branch branch-3.3 updated: [SPARK-41952][SQL] Fix Parquet zstd off-heap memory leak as a workaround for PARQUET-2160

2023-02-20 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new 6da0f88e513 [SPARK-41952][SQL] Fix

[spark] branch master updated: [SPARK-41952][SQL] Fix Parquet zstd off-heap memory leak as a workaround for PARQUET-2160

2023-02-20 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 1688a8768fb [SPARK-41952][SQL] Fix Parquet zstd

[spark] branch branch-3.4 updated: [SPARK-41470][SQL] SPJ: Relax constraints on Storage-Partitioned-Join should assume InternalRow implements equals and hashCode

2023-02-06 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 4d7a58a4221 [SPARK-41470][SQL] SPJ

[spark] branch master updated: [SPARK-41470][SQL] SPJ: Relax constraints on Storage-Partitioned-Join should assume InternalRow implements equals and hashCode

2023-02-06 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 97a20edb258 [SPARK-41470][SQL] SPJ: Relax

[spark] branch master updated: [SPARK-42168][SQL][PYTHON][FOLLOW-UP] Test FlatMapCoGroupsInPandas with Window function

2023-01-27 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d9ca9820384 [SPARK-42168][SQL][PYTHON][FOLLOW

[spark] branch master updated (b3276ef4e3a -> ebbe0b0d78c)

2022-12-22 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from b3276ef4e3a [SPARK-41534][CONNECT][SQL] Setup initial client module for Spark Connect add ebbe0b0d78c [SPARK

[spark] tag v3.2.3 created (now b53c341e0fe)

2022-11-28 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a change to tag v3.2.3 in repository https://gitbox.apache.org/repos/asf/spark.git at b53c341e0fe (commit) No new revisions were added by this update

svn commit: r58020 - /dev/spark/KEYS

2022-11-14 Thread sunchao
Author: sunchao Date: Tue Nov 15 00:01:16 2022 New Revision: 58020 Log: Update KEYS for Chao Modified: dev/spark/KEYS Modified: dev/spark/KEYS == --- dev/spark/KEYS (original) +++ dev/spark/KEYS Tue Nov 15 00:01:16

svn commit: r58015 - in /dev/spark/v3.2.3-rc1-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _site/api/java/org/apache/parqu

2022-11-14 Thread sunchao
Author: sunchao Date: Mon Nov 14 19:44:03 2022 New Revision: 58015 Log: Apache Spark v3.2.3-rc1 docs [This commit notification would consist of 2529 parts, which exceeds the limit of 50 ones, so it was shortened to the summary

[spark] branch master updated (5ff060ec5b6 -> 928f518574e)

2022-11-14 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 5ff060ec5b6 [SPARK-41109][CORE][FOLLOWUP] Re-order error class to fix `SparkThrowableSuite` add 928f518574e

svn commit: r58013 - /dev/spark/v3.2.3-rc1-bin/

2022-11-14 Thread sunchao
Author: sunchao Date: Mon Nov 14 18:47:39 2022 New Revision: 58013 Log: Apache Spark v3.2.3-rc1 Added: dev/spark/v3.2.3-rc1-bin/ dev/spark/v3.2.3-rc1-bin/SparkR_3.2.3.tar.gz (with props) dev/spark/v3.2.3-rc1-bin/SparkR_3.2.3.tar.gz.asc dev/spark/v3.2.3-rc1-bin/SparkR_3.2.3

[spark] 01/01: Preparing development version 3.2.4-SNAPSHOT

2022-11-14 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git commit b9a026105d520b4f2c50f5b33b8a2a2b73cbab0e Author: Chao Sun AuthorDate: Mon Nov 14 16:01:34 2022 + Preparing

[spark] tag v3.2.3-rc1 created (now b53c341e0fe)

2022-11-14 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a change to tag v3.2.3-rc1 in repository https://gitbox.apache.org/repos/asf/spark.git at b53c341e0fe (commit) This tag includes the following new commits: new b53c341e0fe Preparing Spark release

[spark] branch branch-3.2 updated (ddccb6fbe2c -> b9a026105d5)

2022-11-14 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a change to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git from ddccb6fbe2c [SPARK-41091][BUILD][3.2] Fix Docker release tool for branch-3.2 add b53c341e0fe Preparing

[spark] 01/01: Preparing Spark release v3.2.3-rc1

2022-11-14 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to tag v3.2.3-rc1 in repository https://gitbox.apache.org/repos/asf/spark.git commit b53c341e0fefbb33d115ab630369a18765b7763d Author: Chao Sun AuthorDate: Mon Nov 14 16:01:29 2022 + Preparing

[spark] branch branch-3.3 updated (5b81c0fd834 -> 1f2b5d197dc)

2022-09-21 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a change to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git from 5b81c0fd834 [MINOR][DOCS][PYTHON] Document datetime.timedelta <> DayTimeIntervalType add 1f2b5d197dc

[spark] branch master updated: [SPARK-40508][SQL] Treat unknown partitioning as UnknownPartitioning

2022-09-21 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 08044ec3ce3 [SPARK-40508][SQL] Treat unknown

[spark] branch branch-3.2 updated: [SPARK-40169][SQL] Don't pushdown Parquet filters with no reference to data schema

2022-09-16 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new e90a57e1aa5 [SPARK-40169][SQL] Don't

[spark] branch branch-3.3 updated: [SPARK-40169][SQL] Don't pushdown Parquet filters with no reference to data schema

2022-09-16 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new ba6d17288c3 [SPARK-40169][SQL] Don't

[spark] branch master updated (d71b180295e -> 4e0fea2393b)

2022-09-16 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from d71b180295e [SPARK-40398][CORE][SQL] Use Loop instead of Arrays.stream api add 4e0fea2393b [SPARK-40169][SQL

[spark] branch master updated: [SPARK-40295][SQL] Allow v2 functions with literal args in write distribution/ordering

2022-09-07 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 127ccc208aa [SPARK-40295][SQL] Allow v2

[spark] branch master updated: [SPARK-40128][SQL] Make the VectorizedColumnReader recognize DELTA_LENGTH_BYTE_ARRAY as a standalone column encoding

2022-08-17 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 01f9d270ea1 [SPARK-40128][SQL] Make

[spark] branch master updated: [SPARK-40110][SQL][TESTS] Add JDBCWithAQESuite

2022-08-17 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 44f30a04dad [SPARK-40110][SQL][TESTS] Add

[spark] branch master updated (c748052af6a -> eeaa655838c)

2022-08-12 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from c748052af6a [SPARK-40052][SQL] Handle direct byte buffers in VectorizedDeltaBinaryPackedReader add eeaa655838c

[spark] branch master updated (f8d51b9940b -> c748052af6a)

2022-08-12 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from f8d51b9940b [SPARK-40054][SQL] Restore the error handling syntax of try_cast() add c748052af6a [SPARK-40052

[spark] branch branch-3.3 updated: [SPARK-39951][SQL] Update Parquet V2 columnar check for nested fields

2022-08-02 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new a0242eabaee [SPARK-39951][SQL] Update

[spark] branch master updated: [SPARK-39951][SQL] Update Parquet V2 columnar check for nested fields

2022-08-02 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b9bc3c79190 [SPARK-39951][SQL] Update Parquet

[spark] branch branch-3.3 updated: Revert "[SPARK-37205][FOLLOWUP] Should call non-static setTokensConf method"

2022-07-01 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new 2707a5ab522 Revert "[SPARK-

[spark] branch master updated: Revert "[SPARK-37205][FOLLOWUP] Should call non-static setTokensConf method"

2022-07-01 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 6e466a4513b Revert "[SPARK-37205][FOL

[spark] branch master updated (41043613680 -> 71635f3638a)

2022-07-01 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 41043613680 [SPARK-39231][SQL][FOLLOWUP] Move `ColumnVectorUtils.allocateColumns` to `VectorizedParquetRecordReader

[spark] branch master updated (ded5981823a -> 41043613680)

2022-07-01 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from ded5981823a [SPARK-37205][FOLLOWUP] Should call non-static setTokensConf method add 41043613680 [SPARK-39231

[spark] branch branch-3.3 updated: [SPARK-37205][FOLLOWUP] Should call non-static setTokensConf method

2022-07-01 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new 7e2a1827757 [SPARK-37205][FOLLOWUP

[spark] branch master updated: [SPARK-37205][FOLLOWUP] Should call non-static setTokensConf method

2022-07-01 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ded5981823a [SPARK-37205][FOLLOWUP] Should call

[spark] branch master updated: [SPARK-39231][SQL] Use `ConstantColumnVector` instead of `On/OffHeapColumnVector` to store partition columns in `VectorizedParquetRecordReader`

2022-06-29 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c0a12cfbb82 [SPARK-39231][SQL] Use

[spark] branch master updated: [SPARK-38647][SQL] Add SupportsReportOrdering mix in interface for Scan (DataSourceV2)

2022-06-21 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b588d070ebc [SPARK-38647][SQL] Add

[spark] branch branch-3.3 updated: [SPARK-39313][SQL] `toCatalystOrdering` should fail if V2Expression can not be translated

2022-06-01 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new 000270a4ead [SPARK-39313][SQL

[spark] branch master updated (5a3ba9b0b30 -> ef0b87a5a95)

2022-06-01 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 5a3ba9b0b30 [SPARK-39267][SQL] Clean up dsl unnecessary symbol add ef0b87a5a95 [SPARK-39313][SQL

[spark] branch master updated (6604929fe6d -> c74506cc33b)

2022-05-12 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 6604929fe6d [SPARK-37702][SQL] Support ANSI Aggregate Function: regr_syy add c74506cc33b [SPARK-39086][SQL

[spark] branch master updated (8f0aca27916 -> 7c8f702a0c7)

2022-05-04 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 8f0aca27916 [SPARK-38744][SQL][TESTS] Test the error class: NON_LITERAL_PIVOT_VALUES add 7c8f702a0c7 [MINOR

[spark] branch branch-3.3 updated: [SPARK-38891][SQL] Skipping allocating vector for repetition & definition levels when possible

2022-05-04 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new 94d3d6b5fce [SPARK-38891][SQL] Skipping

[spark] branch master updated: [SPARK-38891][SQL] Skipping allocating vector for repetition & definition levels when possible

2022-05-04 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c20d5195c34 [SPARK-38891][SQL] Skipping

[spark] branch branch-3.3 updated: [SPARK-34863][SQL][FOLLOW-UP] Handle IsAllNull in OffHeapColumnVector

2022-04-26 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new 80efaa2e979 [SPARK-34863][SQL][FOLLOW

[spark] branch master updated (6f4e7b6894b -> 0d8ace569de)

2022-04-26 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 6f4e7b6894b [SPARK-38985][SQL] Add sub error classes add 0d8ace569de [SPARK-34863][SQL][FOLLOW-UP] Handle

[spark] branch master updated: [SPARK-38573][SQL] Support Auto Partition Statistics Collection

2022-04-15 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 9756fbaa8c9 [SPARK-38573][SQL] Support Auto

[spark] branch master updated: [SPARK-38786][SQL][TEST] Bug in StatisticsSuite 'change stats after add/drop partition command'

2022-04-05 Thread sunchao
This is an automated email from the ASF dual-hosted git repository. sunchao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a6b04f007c0 [SPARK-38786][SQL][TEST] Bug

  1   2   >