[spark] branch master updated (a01b86f9d46 -> b3ed0c10db1)

2022-10-31 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from a01b86f9d46 [SPARK-40944][SQL] Relax ordering constraint for CREATE TABLE column options add b3ed0c10db1 [SPARK

[spark] branch master updated: [SPARK-40971][CONNECT][DSL] Do not need to use `proto.` to refer generated classes in Connect DSL

2022-10-31 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c85c294d689 [SPARK-40971][CONNECT][DSL] Do

[spark] branch master updated: [SPARK-40713][CONNECT] Improve SET operation support in the proto and the server

2022-10-31 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 31bff52431d [SPARK-40713][CONNECT] Improve SET

[spark] branch branch-3.3 updated: [SPARK-40918][SQL][3.3] Mismatch between FileSourceScanExec and Orc and ParquetFileFormat on producing columnar output

2022-10-31 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new fb2bdeaa234 [SPARK-40918][SQL][3.3

[spark] branch branch-3.3 updated: [SPARK-40932][CORE] Fix issue messages for allGather are overridden

2022-10-28 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new 0f234d9997b [SPARK-40932][CORE] Fix

[spark] branch master updated: [SPARK-40932][CORE] Fix issue messages for allGather are overridden

2022-10-28 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 0b892a543f9 [SPARK-40932][CORE] Fix issue

[spark] branch master updated: [SPARK-40918][SQL] Mismatch between FileSourceScanExec and Orc and ParquetFileFormat on producing columnar output

2022-10-28 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 77694b4673d [SPARK-40918][SQL] Mismatch between

[spark] branch master updated: [SPARK-40926][CONNECT] Refactor server side tests to only use DataFrame API

2022-10-27 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d26e48404a0 [SPARK-40926][CONNECT] Refactor

[spark] branch master updated: [SPARK-40862][SQL] Support non-aggregated subqueries in RewriteCorrelatedScalarSubquery

2022-10-27 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 3feddec3d9c [SPARK-40862][SQL] Support non

[spark] branch master updated: [SPARK-40879][CONNECT] Support Join UsingColumns in proto

2022-10-25 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a27ccd78875 [SPARK-40879][CONNECT] Support Join

[spark] branch master updated: [SPARK-40836][CONNECT] AnalyzeResult should use struct for schema

2022-10-25 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 0b3d9544c93 [SPARK-40836][CONNECT

[spark] branch master updated (e64afb6f9d4 -> ae797040add)

2022-10-25 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from e64afb6f9d4 [SPARK-40899][CONNECT] Make UserContext extensible add ae797040add [SPARK-40906][SQL] `Mode` should

[spark] branch master updated: [SPARK-40899][CONNECT] Make UserContext extensible

2022-10-24 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e64afb6f9d4 [SPARK-40899][CONNECT] Make

[spark] branch master updated: [SPARK-40857][CONNECT] Enable configurable GPRC Interceptors

2022-10-24 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4ba7ce2136a [SPARK-40857][CONNECT] Enable

[spark] branch master updated: [SPARK-34265][PYTHON][SQL] Instrument Python UDFs using SQL metrics

2022-10-24 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e966c387f62 [SPARK-34265][PYTHON][SQL

[spark] branch master updated (825f2190bd8 -> 91407958b49)

2022-10-24 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 825f2190bd8 [SPARK-40882][INFRA] Upgrade actions/setup-java to v3 with distribution specified add 91407958b49

[spark] branch master updated (4d33ee07227 -> 58490da6d2e)

2022-10-23 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 4d33ee07227 [SPARK-36114][SQL] Support subqueries with correlated non-equality predicates add 58490da6d2e

[spark] branch master updated (74c82642941 -> 4d33ee07227)

2022-10-23 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 74c82642941 [SPARK-40812][CONNECT][PYTHON][FOLLOW-UP] Improve Deduplicate in Python client add 4d33ee07227

[spark] branch master updated: [SPARK-40812][CONNECT][PYTHON][FOLLOW-UP] Improve Deduplicate in Python client

2022-10-23 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 74c82642941 [SPARK-40812][CONNECT][PYTHON

[spark] branch master updated: [SPARK-40812][CONNECT] Add Deduplicate to Connect proto and DSL

2022-10-20 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b14da8b1b65 [SPARK-40812][CONNECT] Add

[spark] branch master updated: [SPARK-40539][CONNECT] Initial DataFrame Read API parity for Spark Connect

2022-10-19 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 01c7a46f24f [SPARK-40539][CONNECT] Initial

[spark] branch master updated (933dc0c42f0 -> 3c5bc21fc47)

2022-10-19 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 933dc0c42f0 [SPARK-40753][SQL] Fix bug in test case for catalog directory operation add 3c5bc21fc47 [SPARK

[spark] branch master updated: [SPARK-40753][SQL] Fix bug in test case for catalog directory operation

2022-10-19 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 933dc0c42f0 [SPARK-40753][SQL] Fix bug in test

[spark] branch master updated (646d7160bcf -> 14d8604eacb)

2022-10-18 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 646d7160bcf [SPARK-40816][CONNECT][PYTHON] Rename LogicalPlan.collect to LogicalPlan.to_proto add 14d8604eacb

[spark] branch master updated (11bc5ce19ef -> 480ca17dd36)

2022-10-18 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 11bc5ce19ef [SPARK-40368][SQL] Migrate Bloom Filter type check failures onto error classes add 480ca17dd36

[spark] branch master updated (15dc0eb6c6b -> d0ab83c19b6)

2022-10-17 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 15dc0eb6c6b [SPARK-40809][SPARK-40780][FOLLOW-UP] Improve filter and alias testing coverage in python client

[spark] branch master updated (cd950441fea -> 269acf7192f)

2022-10-17 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from cd950441fea [SPARK-40799][BUILD][CONNECT] Enforce scalafmt for Spark Connect module add 269acf7192f [SPARK

[spark] branch master updated (6e0ef86821b -> ac07cea234f)

2022-10-13 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 6e0ef86821b [SPARK-40382][SQL] Group distinct aggregate expressions by semantically equivalent children

[spark] branch master updated: [SPARK-40382][SQL] Group distinct aggregate expressions by semantically equivalent children in `RewriteDistinctAggregates`

2022-10-13 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 6e0ef86821b [SPARK-40382][SQL] Group distinct

[spark] branch master updated: [SPARK-39876][FOLLOW-UP][SQL] Add parser and Dataset tests for SQL UNPIVOT

2022-10-13 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 9bc8c06bc45 [SPARK-39876][FOLLOW-UP][SQL] Add

[spark] branch master updated: [SPARK-40618][SQL] Fix bug in MergeScalarSubqueries rule with nested subqueries using reference tracking

2022-10-13 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 9287fc9dd73 [SPARK-40618][SQL] Fix bug

[spark] branch master updated (d9c90887cb9 -> 069967ba42c)

2022-10-13 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from d9c90887cb9 [SPARK-40780][CONNECT] Add WHERE to Connect proto and DSL add 069967ba42c [SPARK-40773][SQL

[spark] branch master updated: [SPARK-40780][CONNECT] Add WHERE to Connect proto and DSL

2022-10-13 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d9c90887cb9 [SPARK-40780][CONNECT] Add WHERE

[spark] branch master updated: [SPARK-40697][SQL] Add read-side char padding to cover external data files

2022-10-12 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b9998cf1bf3 [SPARK-40697][SQL] Add read-side

[spark] branch master updated: [SPARK-40717][CONNECT] Support Column Alias in the Connect DSL

2022-10-11 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d94c65eb24c [SPARK-40717][CONNECT] Support

[spark] branch master updated (9ddd7344464 -> 8e853933ba6)

2022-10-11 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 9ddd7344464 [SPARK-40740][SQL] Improve listFunctions in SessionCatalog add 8e853933ba6 [SPARK-40667][SQL

[spark] branch master updated: [SPARK-40707][CONNECT] Add groupby to connect DSL and test more than one grouping expressions

2022-10-10 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4e4a848c275 [SPARK-40707][CONNECT] Add groupby

[spark] branch master updated (288bdd28635 -> 67c6408f133)

2022-10-10 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 288bdd28635 [SPARK-40714][SQL] Remove `PartitionAlreadyExistsException` add 67c6408f133 [SPARK-40534][CONNECT

[spark] branch master updated (1c0b0966159 -> 29e45528315)

2022-10-07 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 1c0b0966159 [SPARK-40454][CONNECT] Initial DSL framework for protobuf testing add 29e45528315 [SPARK-39876][SQL

[spark] branch master updated (c4cd193b4d4 -> 1c0b0966159)

2022-10-07 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from c4cd193b4d4 [SPARK-40565][SQL] Don't push non-deterministic filters to V2 file sources add 1c0b0966159 [SPARK

[spark] branch master updated: [SPARK-40216][SQL] Extract common `ParquetUtils.prepareWrite` method to deduplicate code in `ParquetFileFormat` and `ParquetWrite`

2022-10-06 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f8ccb391b29 [SPARK-40216][SQL] Extract common

[spark] branch master updated: [SPARK-40660][CORE][SQL] Switch to XORShiftRandom to distribute elements

2022-10-05 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e6bebb66651 [SPARK-40660][CORE][SQL] Switch

[spark] branch master updated (99a76a62ea3 -> ccb837f7fbe)

2022-10-04 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 99a76a62ea3 [SPARK-40645][CONNECT] Throw exception for Collect() and recommend to use toPandas() add

[spark] branch master updated: [SPARK-35242][SQL] Support changing session catalog's default database

2022-09-26 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 576c4046742 [SPARK-35242][SQL] Support changing

[spark] branch master updated: [SPARK-40501][SQL] Add PushProjectionThroughLimit for Optimizer

2022-09-26 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c02aef01bbc [SPARK-40501][SQL] Add

[spark] branch master updated: [SPARK-40530][SQL] Add error-related developer APIs

2022-09-26 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 2bf26dfbd70 [SPARK-40530][SQL] Add error

[spark] branch branch-3.3 updated: [SPARK-38717][SQL][3.3] Handle Hive's bucket spec case preserving behaviour

2022-09-25 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new ec5c2d0e7a1 [SPARK-38717][SQL][3.3

[spark] branch master updated: [SPARK-38717][SQL] Handle Hive's bucket spec case preserving behaviour

2022-09-23 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 0942ea9f352 [SPARK-38717][SQL] Handle Hive's

[spark] branch master updated (def8cca7d89 -> 541b8301505)

2022-09-23 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from def8cca7d89 [SPARK-40543][PS][SQL] Make `ddof` in `DataFrame.var` and `Series.var` accept arbitary integers add

[spark] branch branch-3.2 updated: [SPARK-40407][SQL] Fix the potential data skew caused by df.repartition

2022-09-22 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new 18e83f9ab23 [SPARK-40407][SQL] Fix

[spark] branch branch-3.3 updated: [SPARK-40407][SQL] Fix the potential data skew caused by df.repartition

2022-09-22 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new 2bae604d05e [SPARK-40407][SQL] Fix

[spark] branch master updated: [SPARK-40407][SQL] Fix the potential data skew caused by df.repartition

2022-09-22 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f6c4e58b85d [SPARK-40407][SQL] Fix

[spark] branch master updated (39b65b414c4 -> 037fbc0a867)

2022-09-22 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 39b65b414c4 [SPARK-40529][PS] Remove `pyspark.pandas.ml` add 037fbc0a867 [SPARK-40488] Do not wrap exceptions

[spark] branch master updated (c6f4526be5e -> 9cae4230751)

2022-09-21 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from c6f4526be5e [SPARK-40498][PS] Implement `kendall` and `min_periods` in `Series.corr` add 9cae4230751 [SPARK

[spark] branch master updated: [SPARK-40496][SQL] Fix configs to control "enableDateTimeParsingFallback"

2022-09-20 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a031aaa487e [SPARK-40496][SQL] Fix configs

[spark] branch master updated: [SQL][MINOR] Re-generate equals/hashCode of IdentifierImpl with non-null optimization

2022-09-20 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 47ca1f0613c [SQL][MINOR] Re-generate equals

[spark] branch master updated: [SPARK-40456][SQL] PartitionIterator.hasNext should be cheap to call repeatedly

2022-09-19 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 3b9e5cf662c [SPARK-40456][SQL

[spark] branch master updated: [SPARK-40425][SQL] DROP TABLE does not need to do table lookup

2022-09-19 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 1a134191024 [SPARK-40425][SQL] DROP TABLE does

[spark] branch master updated: [SPARK-40482][SQL] Revert `SPARK-24544 Print actual failure cause when look up function failed`

2022-09-18 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 127c40366b6 [SPARK-40482][SQL] Revert `SPARK

[spark] branch master updated (128479fe92c -> 8b6b3be273f)

2022-09-15 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 128479fe92c [SPARK-40196][PYTHON][PS] Consolidate `lit` function with NumPy scalar in sql and pandas module add

[spark] branch master updated: [SPARK-40387][SQL] Improve the implementation of Spark Decimal

2022-09-15 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 193b5b229c7 [SPARK-40387][SQL] Improve

[spark] branch branch-3.3 updated: [SPARK-39915][SQL] Ensure the output partitioning is user-specified in AQE

2022-09-13 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new 82351bee9bb [SPARK-39915][SQL] Ensure

[spark] branch master updated (4dd153055fd -> 801ca252f43)

2022-09-13 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 4dd153055fd Revert "[SPARK-40384][INFRA] Only do base image real in time build when infra dockerfile is ch

[spark] branch master updated (96ed6dc3e38 -> 3f97cd620a6)

2022-09-13 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 96ed6dc3e38 [SPARK-40400][SQL] Pass error message parameters to exceptions as maps add 3f97cd620a6 [SPARK-40362

[spark] branch master updated: [SPARK-40107][SQL][FOLLOW-UP] Update `empty2null` check

2022-09-12 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ff66adda3ca [SPARK-40107][SQL][FOLLOW-UP

[spark] branch branch-3.3 updated: [SPARK-40380][SQL] Fix constant-folding of InvokeLike to avoid non-serializable literal embedded in the plan

2022-09-08 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new 10cd3ac16bc [SPARK-40380][SQL] Fix

[spark] branch master updated (4d73552abf3 -> 5b96e82ad6a)

2022-09-08 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 4d73552abf3 [SPARK-40333][PS] Implement `GroupBy.nth` add 5b96e82ad6a [SPARK-40380][SQL] Fix constant-folding

[spark] branch branch-3.2 updated: [SPARK-40149][SQL][3.2] Propagate metadata columns through Project

2022-09-07 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new d566017de44 [SPARK-40149][SQL][3.2

[spark] branch master updated: [SPARK-40185][SQL] Remove column suggestion when the candidate list is empty

2022-09-07 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 32567e94b8a [SPARK-40185][SQL] Remove column

[spark] branch branch-3.3 updated: add back a mistakenly removed test case

2022-09-07 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new 81cb08b7b3a add back a mistakenly

[spark] branch branch-3.3 updated: [SPARK-40149][SQL] Propagate metadata columns through Project

2022-09-07 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new 433469f284e [SPARK-40149][SQL

[spark] branch master updated (e6c58c1bd6f -> 99ae1d9a897)

2022-09-07 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from e6c58c1bd6f [SPARK-40273][PYTHON][DOCS] Fix the documents "Contributing and Maintaining Type Hints"

[spark] branch branch-3.1 updated: [SPARK-40315][SQL] Add hashCode() for Literal of ArrayBasedMapData

2022-09-06 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.1 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.1 by this push: new 63025e952e8 [SPARK-40315][SQL] Add

[spark] branch branch-3.2 updated: [SPARK-40315][SQL] Add hashCode() for Literal of ArrayBasedMapData

2022-09-06 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new c7cc0ae2ab4 [SPARK-40315][SQL] Add

[spark] branch branch-3.3 updated: [SPARK-40315][SQL] Add hashCode() for Literal of ArrayBasedMapData

2022-09-06 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new 84c091845d4 [SPARK-40315][SQL] Add

[spark] branch master updated (82d4430144e -> e85a4ffbdfa)

2022-09-06 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 82d4430144e [SPARK-40352][SQL] Add function aliases: len, datepart, dateadd, date_diff and curdate add

[spark] branch branch-3.3 updated: [SPARK-40297][SQL] CTE outer reference nested in CTE main body cannot be resolved

2022-09-05 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new 1324f7d1680 [SPARK-40297][SQL] CTE

[spark] branch branch-3.3 updated: [SPARK-38404][SQL][3.3] Improve CTE resolution when a nested CTE references an outer CTE

2022-09-05 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new 9473840bac8 [SPARK-38404][SQL][3.3

[spark] branch master updated: [SPARK-40297][SQL] CTE outer reference nested in CTE main body cannot be resolved

2022-09-01 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f4ff2d16483 [SPARK-40297][SQL] CTE outer

[spark] branch master updated: [SPARK-40285][SQL] Simplify the `roundTo[Numeric]` for Spark `Decimal`

2022-08-31 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 1dc50d79115 [SPARK-40285][SQL] Simplify

[spark] branch master updated (701d6ee10eb -> ee9652a512d)

2022-08-31 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 701d6ee10eb [SPARK-40112][SQL] Improve the TO_BINARY() function add ee9652a512d [SPARK-40055][SQL][FOLLOWUP

[spark] branch master updated: [SPARK-40112][SQL] Improve the TO_BINARY() function

2022-08-31 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 701d6ee10eb [SPARK-40112][SQL] Improve

[spark] branch master updated: [SPARK-40219][SQL] Resolved view logical plan should hold the schema to avoid redundant lookup

2022-08-31 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e4a73db9383 [SPARK-40219][SQL] Resolved view

[spark] branch master updated (6c3c9575cf0 -> 247306c0fe8)

2022-08-31 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 6c3c9575cf0 [SPARK-40271][FOLLOWUP][PYTHON] fix the minor exception message add 247306c0fe8 [SPARK-40194][SQL

[spark] branch branch-3.3 updated: [SPARK-39896][SQL] UnwrapCastInBinaryComparison should work when the literal of In/InSet downcast failed

2022-08-30 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new c04aa36b771 [SPARK-39896][SQL

[spark] branch master updated: [SPARK-39896][SQL] UnwrapCastInBinaryComparison should work when the literal of In/InSet downcast failed

2022-08-30 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 6e62b93f3d1 [SPARK-39896][SQL

[spark] branch master updated: [SPARK-39915][SQL] Dataset.repartition(N) may not create N partitions Non-AQE part

2022-08-30 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ff7ab34a695 [SPARK-39915][SQL

[spark] branch master updated (375b4e70029 -> 0e8d7795a12)

2022-08-29 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 375b4e70029 [SPARK-40243][DOCS] Enhance Hive UDF support documentation add 0e8d7795a12 [SPARK-40245][SQL] Fix

[spark] branch branch-3.3 updated: [SPARK-40247][SQL] Fix BitSet equality check

2022-08-29 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new 60bd91f257f [SPARK-40247][SQL] Fix

[spark] branch master updated: [SPARK-40247][SQL] Fix BitSet equality check

2022-08-29 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 527ddece8fd [SPARK-40247][SQL] Fix BitSet

[spark] branch master updated: [SPARK-40224][SQL] Make ObjectHashAggregateExec release memory eagerly when fallback to sort-based

2022-08-29 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 0f4a9ac18f7 [SPARK-40224][SQL] Make

[spark] branch master updated: [SPARK-39607][SQL][DSV2] Distribution and ordering support V2 function in writing

2022-08-29 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 438233db4b2 [SPARK-39607][SQL][DSV2

[spark] branch branch-3.2 updated: [SPARK-40218][SQL] GROUPING SETS should preserve the grouping columns

2022-08-26 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new de649f0759a [SPARK-40218][SQL] GROUPING

[spark] branch branch-3.3 updated: [SPARK-40218][SQL] GROUPING SETS should preserve the grouping columns

2022-08-26 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new 784cb0f68af [SPARK-40218][SQL] GROUPING

[spark] branch master updated: [SPARK-40218][SQL] GROUPING SETS should preserve the grouping columns

2022-08-26 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 1ed592ef28a [SPARK-40218][SQL] GROUPING SETS

[spark] branch master updated: [SPARK-40153][SQL] Unify resolve functions and table-valued functions

2022-08-25 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 973b6746d4c [SPARK-40153][SQL] Unify resolve

[spark] branch master updated: [SPARK-40055][SQL] listCatalogs should also return spark_catalog even when spark_catalog implementation is defaultSessionCatalog

2022-08-24 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 245ed9002d1 [SPARK-40055][SQL] listCatalogs

[spark] branch master updated (af2d2ee1153 -> 5a71a7f7b5c)

2022-08-22 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from af2d2ee1153 [SPARK-40081][PYTHON][DOCS] Add document parameters for pyspark.sql.streaming.query add 5a71a7f7b5c

[spark] branch branch-3.1 updated: [SPARK-40089][SQL] Fix sorting for some Decimal types

2022-08-22 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.1 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.1 by this push: new 65936ef10f1 [SPARK-40089][SQL] Fix

[spark] branch branch-3.2 updated: [SPARK-40089][SQL] Fix sorting for some Decimal types

2022-08-22 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new f14db2cf0dc [SPARK-40089][SQL] Fix

<    4   5   6   7   8   9   10   11   12   13   >