[spark] branch branch-3.3 updated: [SPARK-41162][SQL][3.3] Fix anti- and semi-join for self-join with aggregations

2023-01-05 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new b97f79da04a [SPARK-41162][SQL][3.3] Fix

[spark] branch master updated: [SPARK-41912][SQL] Subquery should not validate CTE

2023-01-05 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 89666d44a39 [SPARK-41912][SQL] Subquery should

[spark] branch master updated (eba31a8de3f -> 729c4bff167)

2023-01-05 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from eba31a8de3f [SPARK-41806][SQL] Use AppendData.byName for SQL INSERT INTO by name for DSV2 add 729c4bff167

[spark] branch master updated: [SPARK-41806][SQL] Use AppendData.byName for SQL INSERT INTO by name for DSV2

2023-01-05 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new eba31a8de3f [SPARK-41806][SQL] Use

[spark] branch master updated (737eecded4d -> 3dc881afcfc)

2023-01-05 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 737eecded4d [SPARK-41162][SQL] Fix anti- and semi-join for self-join with aggregations add 3dc881afcfc [SPARK

[spark] branch master updated: [SPARK-41162][SQL] Fix anti- and semi-join for self-join with aggregations

2023-01-05 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 737eecded4d [SPARK-41162][SQL] Fix anti

[spark] branch master updated (0b786901633 -> 3130ca9748b)

2023-01-03 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 0b786901633 [SPARK-41850][CONNECT][PYTHON][TESTS] Enable doctest for `isnan` add 3130ca9748b [SPARK-41859][SQL

[spark] branch master updated (f0d9692c5d2 -> 3c40be2dddc)

2023-01-03 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from f0d9692c5d2 [SPARK-41855][SPARK-41814][SPARK-41851][SPARK-41852][CONNECT][PYTHON] Make `createDataFrame` handle

[spark] branch master updated: [SPARK-41049][SQL] Revisit stateful expression handling

2022-12-30 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4321604fe0b [SPARK-41049][SQL] Revisit stateful

[spark] branch master updated: [SPARK-41440][CONNECT][PYTHON] Avoid the cache operator for general Sample

2022-12-30 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 7143cbd0725 [SPARK-41440][CONNECT][PYTHON

[spark] branch master updated: [SPARK-41554] fix changing of Decimal scale when scale decreased by m…

2022-12-29 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 838954e5080 [SPARK-41554] fix changing

[spark] branch master updated: [SPARK-41760][BUILD][CONNECT] Enforce scalafmt for Connect Client module

2022-12-29 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new af8442ee903 [SPARK-41760][BUILD][CONNECT

[spark] branch master updated: [SPARK-41631][FOLLOWUP][SQL] Fix two issues in implicit lateral column alias resolution on Aggregate

2022-12-28 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 281378468cc [SPARK-41631][FOLLOWUP][SQL] Fix

[spark] branch master updated (93fc677d282 -> 9d5357df13b)

2022-12-28 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 93fc677d282 [SPARK-41747][SPARK-41744][SPARK-41748][SPARK-41749][CONNECT][TESTS] Reeanble tests for multiple

[spark] branch master updated: [SPARK-41713][SQL] Make CTAS hold a nested execution for data writing

2022-12-28 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4b40920e331 [SPARK-41713][SQL] Make CTAS hold

[spark] branch branch-3.3 updated: Revert "[MINOR][TEST][SQL] Add a CTE subquery scope test case"

2022-12-28 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new 0887a2f09fc Revert "[MINOR][TEST

[spark] branch master updated (030c1baf2bd -> a1767bdcfaa)

2022-12-26 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 030c1baf2bd [SPARK-41690][SQL][CONNECT] Agnostic Encoders add a1767bdcfaa [SPARK-41235][SQL][PYTHON] High-order

[spark] branch master updated (6cf42fe4e04 -> 030c1baf2bd)

2022-12-26 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 6cf42fe4e04 [SPARK-41717][CONNECT] Deduplicate print and _repr_html_ at LogicalPlan add 030c1baf2bd [SPARK

[spark] branch master updated: [MINOR][SQL] Document AnalysisOnlyCommand

2022-12-25 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 9bebf4b36cd [MINOR][SQL] Document

[spark] branch master updated (c526741ed09 -> 827ca9b8247)

2022-12-23 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from c526741ed09 [MINOR][DOCS] Fix grammatical error in streaming programming guide add 827ca9b8247 [SPARK-41498

[spark] branch master updated (a1c727f3867 -> 2ffa8178df1)

2022-12-23 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from a1c727f3867 [SPARK-41666][PYTHON] Support parameterized SQL by `sql()` add 2ffa8178df1 [SPARK-41407][SQL] Pull

[spark] branch master updated: [SPARK-41637][SQL] ORDER BY ALL

2022-12-22 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 6d77aa54d04 [SPARK-41637][SQL] ORDER BY ALL

[spark] branch master updated: [SPARK-41513][SQL] Implement an accumulator to collect per mapper row count metrics

2022-12-22 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 887f83122a0 [SPARK-41513][SQL] Implement

[spark] branch master updated (02562bb362b -> 3adc9b14a3e)

2022-12-22 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 02562bb362b [SPARK-41681][CONNECT] Factor GroupedData out to group.py add 3adc9b14a3e [SPARK-41635][SQL] GROUP

[spark] branch master updated: [SPARK-41639][SQL][PROTOBUF] Remove ScalaReflectionLock from SchemaConverters

2022-12-21 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 6e537f30ac2 [SPARK-41639][SQL][PROTOBUF] Remove

[spark] branch branch-3.3 updated: [SPARK-41350][3.3][SQL][FOLLOWUP] Allow simple name access of join hidden columns after alias

2022-12-21 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new 9934b56dbb2 [SPARK-41350][3.3][SQL

[spark] branch master updated: [SPARK-41669][SQL] Early pruning in canCollapseExpressions

2022-12-21 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 73593d8670c [SPARK-41669][SQL] Early pruning

[spark] branch master updated: [SPARK-41509][SQL] Only execute `Murmur3Hash` on aggregate expressions for semi-join runtime filter

2022-12-21 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 739aae15540 [SPARK-41509][SQL] Only execute

[spark] branch master updated: [SPARK-41660][SQL] Only propagate metadata columns if they are used

2022-12-21 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new bd864a085f2 [SPARK-41660][SQL] Only propagate

[spark] branch master updated (940946515bd -> fd6d226528e)

2022-12-20 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 940946515bd [SPARK-41440][CONNECT][PYTHON] Implement `DataFrame.randomSplit` add fd6d226528e [SPARK-41631][SQL

[spark] branch master updated: [SPARK-41396][SQL][PROTOBUF] OneOf field support and recursion checks

2022-12-20 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d33a59c940f [SPARK-41396][SQL][PROTOBUF] OneOf

[spark] branch master updated (1310ce2d894 -> 52082d3906b)

2022-12-19 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 1310ce2d894 [SPARK-41425][UI] Protobuf serializer for RDDStorageInfoWrapper add 52082d3906b Revert "[

[spark] branch master updated (05428c21844 -> bc7b8f54d40)

2022-12-19 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 05428c21844 [SPARK-41334][CONNECT][PYTHON] Move `SortOrder` proto from relations to expressions add bc7b8f54d40

[spark] branch master updated: [SPARK-41511][SQL] LongToUnsafeRowMap support ignoresDuplicatedKey

2022-12-15 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 1f35577a3ea [SPARK-41511][SQL

[spark] branch master updated: [SPARK-27561][SQL] Support implicit lateral column alias resolution on Project

2022-12-13 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 7e9b88bfceb [SPARK-27561][SQL] Support implicit

[spark] branch master updated: [SPARK-41468][SQL][FOLLOWUP] Handle NamedLambdaVariables in EquivalentExpressions

2022-12-13 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 27f4d1ef848 [SPARK-41468][SQL][FOLLOWUP] Handle

[spark] branch master updated (7801666f3b5 -> e43b4be77ad)

2022-12-12 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 7801666f3b5 [SPARK-41448] Make consistent MR job IDs in FileBatchWriter and FileFormatWriter add e43b4be77ad

[spark] branch branch-3.2 updated: [SPARK-41448] Make consistent MR job IDs in FileBatchWriter and FileFormatWriter

2022-12-12 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new 18d141250c8 [SPARK-41448] Make

[spark] branch branch-3.3 updated: [SPARK-41448] Make consistent MR job IDs in FileBatchWriter and FileFormatWriter

2022-12-12 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new 70f3d2fec92 [SPARK-41448] Make

[spark] branch master updated: [SPARK-41448] Make consistent MR job IDs in FileBatchWriter and FileFormatWriter

2022-12-12 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 7801666f3b5 [SPARK-41448] Make consistent MR

[spark] branch master updated: [SPARK-40775][SQL] Fix duplicate description entries for V2 file scans

2022-12-12 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 1f4c8e42479 [SPARK-40775][SQL] Fix duplicate

[spark] branch branch-3.3 updated: [SPARK-41468][SQL] Fix PlanExpression handling in EquivalentExpressions

2022-12-12 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new 231c63a2451 [SPARK-41468][SQL] Fix

[spark] branch master updated: [SPARK-41468][SQL] Fix PlanExpression handling in EquivalentExpressions

2022-12-12 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 1b2d7001f29 [SPARK-41468][SQL] Fix

[spark] branch master updated (42bc297d5b9 -> f14df511fd2)

2022-12-07 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 42bc297d5b9 [SPARK-41433][CONNECT] Make Max Arrow BatchSize configurable add f14df511fd2 [SPARK-41437][SQL] Do

[spark] branch master updated: [SPARK-41349][CONNECT] Implement DataFrame.hint

2022-12-07 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ec5d5471856 [SPARK-41349][CONNECT] Implement

[spark] branch branch-3.3 updated: [SPARK-41350][SQL] Allow simple name access of join hidden columns after subquery alias

2022-12-05 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new 398948ef51c [SPARK-41350][SQL] Allow

[spark] branch master updated: [SPARK-41355][SQL] Workaround hive table name validation issue

2022-12-05 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8319cec9869 [SPARK-41355][SQL] Workaround hive

[spark] branch master updated (d8a600e621f -> 32554a0831c)

2022-12-04 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from d8a600e621f [SPARK-41151][FOLLOW-UP][SQL] Keep built-in file _metadata fields nullable value consistent add

[spark] branch master updated (abeb9677bb3 -> d8a600e621f)

2022-12-04 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from abeb9677bb3 [SPARK-40379][K8S] Propagate decommission executor loss reason in K8s add d8a600e621f [SPARK-41151

[spark] branch master updated: [SPARK-41347][CONNECT] Add Cast to Expression proto

2022-12-01 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 41407e0b96d [SPARK-41347][CONNECT] Add Cast

[spark] branch master updated: [SPARK-41338][SQL] Resolve outer references and normal columns in the same analyzer batch

2022-11-30 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8d60736abd5 [SPARK-41338][SQL] Resolve outer

[spark] branch master updated: [SPARK-41343][CONNECT] Move FunctionName parsing to server side

2022-11-30 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ce41ca0848e [SPARK-41343][CONNECT] Move

[spark] branch master updated: [SPARK-41226][SQL] Refactor Spark types by introducing physical types

2022-11-30 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 3d598594cd6 [SPARK-41226][SQL] Refactor Spark

[spark] branch master updated: [SPARK-41323][SQL] Support current_schema

2022-11-29 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 7fd654c0142 [SPARK-41323][SQL] Support

[spark] branch master updated (5b7f89cee8e -> dcd9cae4a3c)

2022-11-29 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 5b7f89cee8e [MINOR][PYTHON][DOCS] Fix types and docstring in DataFrame.toDF add dcd9cae4a3c [SPARK-41256

[spark] branch master updated: [SPARK-41306][CONNECT] Improve Connect Expression proto documentation

2022-11-28 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c7878850f55 [SPARK-41306][CONNECT] Improve

[spark] branch master updated (1a8f2952225 -> c1df6a0ddd8)

2022-11-28 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 1a8f2952225 [SPARK-41291][CONNECT][PYTHON] DataFrame.explain` should print and return None add c1df6a0ddd8

[spark] branch master updated (e42d3836af9 -> 79f8c79a45c)

2022-11-23 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from e42d3836af9 [SPARK-41206][SQL][FOLLOWUP] Make result of `checkColumnNameDuplication` stable to fix

[spark] branch master updated (3bff4f6339f -> 25133684ef9)

2022-11-22 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 3bff4f6339f [SPARK-41135][SQL] Rename `UNSUPPORTED_EMPTY_LOCATION` to `INVALID_EMPTY_LOCATION` add 25133684ef9

[spark] branch master updated: [SPARK-41017][SQL][FOLLOWUP] Push Filter with both deterministic and nondeterministic predicates

2022-11-21 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 0cdbda13b08 [SPARK-41017][SQL][FOLLOWUP] Push

[spark] branch branch-3.3 updated: [SPARK-41154][SQL][3.3] Incorrect relation caching for queries with time travel spec

2022-11-21 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new ace3c69ef18 [SPARK-41154][SQL][3.3

[spark] branch master updated: [SPARK-41154][SQL] Incorrect relation caching for queries with time travel spec

2022-11-21 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 07427b854be [SPARK-41154][SQL] Incorrect

[spark] branch master updated (f231036a585 -> 31d90d06d1b)

2022-11-20 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from f231036a585 [SPARK-41203][CONNECT] Support Dataframe.tansform in Python client add 31d90d06d1b [SPARK-41183

[spark] branch master updated: [SPARK-40999] Hint propagation to subqueries

2022-11-18 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 0fa9c554fc0 [SPARK-40999] Hint propagation

[spark] branch master updated: [SPARK-41178][SQL] Fix parser rule precedence between JOIN and comma

2022-11-17 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d5b9fc119cc [SPARK-41178][SQL] Fix parser rule

[spark] branch master updated: [SPARK-41017][SQL][FOLLOWUP] Respect the original Filter operator order

2022-11-17 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ac84e1462c6 [SPARK-41017][SQL][FOLLOWUP

[spark] branch master updated: [SPARK-41048][SQL] Improve output partitioning and ordering with AQE cache

2022-11-16 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d218013 [SPARK-41048][SQL] Improve output

[spark] branch master updated (b627597c6d2 -> 3b4faaf89ec)

2022-11-16 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from b627597c6d2 [SPARK-41118][SQL] `to_number`/`try_to_number` should return `null` when format is `null` add

[spark] branch master updated (96211202d76 -> 80c91186bdc)

2022-11-16 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 96211202d76 [SPARK-40798][DOCS][FOLLOW-UP] Fix a typo in the configuration name at migration guide add

[spark] branch master updated (8b5fee7ea03 -> f3400e4fdac)

2022-11-15 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 8b5fee7ea03 [SPARK-41140][SQL] Rename the error class `_LEGACY_ERROR_TEMP_2440` to `INVALID_WHERE_CONDITION

[spark] branch master updated: [SPARK-40956] SQL Equivalent for Dataframe overwrite command

2022-11-15 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 5c43da68587 [SPARK-40956] SQL Equivalent

[spark] branch branch-3.3 updated: [SPARK-41144][SQL] Unresolved hint should not cause query failure

2022-11-15 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new 29dee664dd0 [SPARK-41144][SQL

[spark] branch master updated (bd29ca78905 -> a9bf5d2b3f5)

2022-11-15 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from bd29ca78905 [SPARK-41112][SQL] RuntimeFilter should apply ColumnPruning eagerly with in-subquery filter add

[spark] branch master updated: [SPARK-41112][SQL] RuntimeFilter should apply ColumnPruning eagerly with in-subquery filter

2022-11-15 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new bd29ca78905 [SPARK-41112][SQL] RuntimeFilter

[spark] branch master updated (dc903a072dc -> 490c6dbdf86)

2022-11-14 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from dc903a072dc [SPARK-41101][PYTHON][PROTOBUF] Message classname support for PYSPARK-PROTOBUF add 490c6dbdf86

[spark] branch master updated: [SPARK-38959][SQL][FOLLOWUP] Do not optimize subqueries twice

2022-11-14 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 632784dec8a [SPARK-38959][SQL][FOLLOWUP] Do

[spark] branch master updated (058fe273c56 -> 8651778a875)

2022-11-13 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 058fe273c56 [SPARK-37555][TEST][FOLLOWUP] Increase timeout of CLI test `spark-sql should pass last unclosed comment

[spark] branch master updated (e8965a12beb -> 058fe273c56)

2022-11-13 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from e8965a12beb [SPARK-41116][CONNECT] Input relation can be optional for Project in Connect proto add 058fe273c56

[spark] branch master updated: [SPARK-41116][CONNECT] Input relation can be optional for Project in Connect proto

2022-11-13 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e8965a12beb [SPARK-41116][CONNECT] Input

[spark] branch master updated: [SPARK-41102][CONNECT] Merge SparkConnectPlanner and SparkConnectCommandPlanner

2022-11-10 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new fd1e0d028cb [SPARK-41102][CONNECT] Merge

[spark] branch master updated (40a9a6ef5b8 -> 2bc1d4d684a)

2022-11-09 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 40a9a6ef5b8 [SPARK-40877][DOC][FOLLOW-UP] Update the doc of `DataFrame.stat.crosstab ` add 2bc1d4d684a [SPARK

[spark] branch master updated (110b5162df6 -> 6308f546c10)

2022-11-09 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 110b5162df6 [SPARK-41034][CONNECT][PYTHON] Connect DataFrame should require a RemoteSparkSession add

[spark] branch master updated: [SPARK-38959][SQL][FOLLOWUP] Optimizer batch `PartitionPruning` should optimize subqueries

2022-11-09 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 865a3ded2ea [SPARK-38959][SQL][FOLLOWUP

[spark] branch master updated: [SPARK-41078][CONNECT] Implement DataFrame `withColumnsRenamed` in Connect proto

2022-11-09 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new db84869d184 [SPARK-41078][CONNECT] Implement

[spark] branch master updated: [SPARK-41046][CONNECT] Support CreateView in Connect DSL

2022-11-09 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f5101319c1a [SPARK-41046][CONNECT] Support

[spark] branch master updated (6b88d55b14d -> 0b8ab3256d4)

2022-11-09 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 6b88d55b14d [SPARK-41041][SQL] Integrate `_LEGACY_ERROR_TEMP_1279` into `TABLE_OR_VIEW_ALREADY_EXISTS` add

[spark] branch branch-3.2 updated: [SPARK-40588] FileFormatWriter materializes AQE plan before accessing outputOrdering

2022-11-09 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new f0f83b518d0 [SPARK-40588

[spark] branch branch-3.3 updated (ef74381ec0d -> f0cad7ad6c2)

2022-11-09 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git from ef74381ec0d [SPARK-41035][SQL] Don't patch foldable children of aggregate functions

[spark] branch master updated: [SPARK-40992][CONNECT] Support toDF(columnNames) in Connect DSL

2022-11-08 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e1382c566b7 [SPARK-40992][CONNECT] Support toDF

[spark] branch master updated: [SPARK-41058][CONNECT] Remove unused import in commands.proto

2022-11-08 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 6858ba95bf7 [SPARK-41058][CONNECT] Remove

[spark] branch master updated: [SPARK-40852][CONNECT][PYTHON] Introduce `StatFunction` in proto and implement `DataFrame.summary`

2022-11-08 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4f096dba9d2 [SPARK-40852][CONNECT][PYTHON

[spark] branch master updated: [SPARK-38959][SQL][FOLLOW-UP] Address feedback for RowLevelOperationRuntimeGroupFiltering

2022-11-08 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 7429223cfd6 [SPARK-38959][SQL][FOLLOW-UP

[spark] branch master updated: [SPARK-41026][CONNECT] Support Repartition in Connect Proto

2022-11-07 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 9695b2cb59b [SPARK-41026][CONNECT] Support

[spark] branch master updated: [SPARK-40875][CONNECT] Improve aggregate in Connect DSL

2022-11-07 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new eac736e1a62 [SPARK-40875][CONNECT] Improve

[spark] branch master updated (5a2da015c65 -> 0745daeefbe)

2022-11-03 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 5a2da015c65 [SPARK-34079][SQL][FOLLOWUP] Improve the readability and simplify the code for MergeScalarSubqueries

[spark] branch master updated: [SPARK-34079][SQL][FOLLOWUP] Improve the readability and simplify the code for MergeScalarSubqueries

2022-11-03 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 5a2da015c65 [SPARK-34079][SQL][FOLLOWUP

[spark] branch master updated: [SPARK-40921][SQL] Add WHEN NOT MATCHED BY SOURCE clause to MERGE INTO

2022-11-01 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c7fa8471b34 [SPARK-40921][SQL] Add WHEN

[spark] branch master updated (8aaa6aa41ef -> fb756317fb6)

2022-11-01 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 8aaa6aa41ef [SPARK-40978][SQL] Migrate `failAnalysis()` w/o a context onto error classes add fb756317fb6 [SPARK

[spark] branch master updated (9bbc9ee730e -> 026b3d41bf8)

2022-11-01 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 9bbc9ee730e [SPARK-40975][SQL] Rename the error class `_LEGACY_ERROR_TEMP_0021` to `UNSUPPORTED_TYPED_LITERAL

[spark] branch master updated: [SPARK-40938][CONNECT] Support Alias for every type of Relation

2022-10-31 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c09c7793376 [SPARK-40938][CONNECT] Support

<    3   4   5   6   7   8   9   10   11   12   >