(spark) branch master updated: [SPARK-47476][SQL] Support REPLACE function to work with collated strings

2024-04-26 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 07b84dd57e38 [SPARK-47476][SQL] Support REPLACE

(spark) branch master updated: [SPARK-47351][SQL] Add collation support for StringToMap & Mask string expressions

2024-04-26 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new afe310d617e5 [SPARK-47351][SQL] Add collation

(spark) branch master updated: [SPARK-47350][SQL] Add collation support for SplitPart string expression

2024-04-26 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 6c40214f3d93 [SPARK-47350][SQL] Add collation

(spark) branch master updated: [SPARK-47922][SQL] Implement the try_parse_json expression

2024-04-26 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 033ca3e7dd5b [SPARK-47922][SQL] Implement

(spark) branch master updated (c6aaa18e6cfd -> b4624bf4be28)

2024-04-24 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from c6aaa18e6cfd Revert "[SPARK-45302][PYTHON] Remove PID communication between Pythonworkers when no demon is

(spark) branch master updated: [SPARK-47958][TESTS] Change LocalSchedulerBackend to notify scheduler of executor on start

2024-04-24 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 09ed09cb18e7 [SPARK-47958][TESTS] Change

(spark) branch master updated: [SPARK-47764][CORE][SQL] Cleanup shuffle dependencies based on ShuffleCleanupMode

2024-04-24 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c44493db1dd7 [SPARK-47764][CORE][SQL] Cleanup

(spark) branch master updated: [SPARK-47692][SQL] Fix default StringType meaning in implicit casting

2024-04-24 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 461ffa1a681b [SPARK-47692][SQL] Fix default

(spark) branch master updated: [SPARK-47418][SQL] Add hand-crafted implementations for lowercase unicode-aware contains, startsWith and endsWith and optimize UTF8_BINARY_LCASE

2024-04-24 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 890f78d03020 [SPARK-47418][SQL] Add hand

(spark) branch master updated: [SPARK-47873][SQL] Write collated strings to Hive metastore using the regular string type

2024-04-23 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 9d9f292ac941 [SPARK-47873][SQL] Write collated

(spark) branch master updated: [SPARK-47352][SQL] Fix Upper, Lower, InitCap collation awareness

2024-04-23 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b9f2270f5b0b [SPARK-47352][SQL] Fix Upper

(spark) branch master updated: [SPARK-47412][SQL] Add Collation Support for LPad/RPad

2024-04-23 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 885e98ecbe64 [SPARK-47412][SQL] Add Collation

(spark) branch master updated: [SPARK-47633][SQL] Include right-side plan output in `LateralJoin#allAttributes` for more consistent canonicalization

2024-04-23 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new eba6364dbb36 [SPARK-47633][SQL] Include right

(spark) branch master updated: [SPARK-47411][SQL] Support StringInstr & FindInSet functions to work with collated strings

2024-04-22 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 256fc51508e4 [SPARK-47411][SQL] Support

(spark) branch master updated (2fb31dea1c53 -> b20356ef55a2)

2024-04-22 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 2fb31dea1c53 [SPARK-47930][BUILD] Upgrade RoaringBitmap to 1.0.6 add b20356ef55a2 [SPARK-47900] Fix check

(spark) branch master updated (2d0b56c3eac6 -> e1432ef6405a)

2024-04-22 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 2d0b56c3eac6 [SPARK-47932][SQL][TESTS] Avoid using legacy commons-lang add e1432ef6405a [SPARK-47413][SQL] - add

(spark) branch master updated (9f34b8eca2f3 -> 458f70bd5213)

2024-04-21 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 9f34b8eca2f3 [SPARK-47845][SQL][PYTHON][CONNECT] Support Column type in split function for scala and python add

(spark) branch master updated (bb5ded8f1bb0 -> 76fb196a8ab7)

2024-04-18 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from bb5ded8f1bb0 [SPARK-47371][SQL][FOLLOWUP] XML: Stop ignoring CDATA within row tags add 76fb196a8ab7 [SPARK

(spark) branch branch-3.5 updated: [SPARK-47463][SQL][3.5] Use V2Predicate to wrap expression with return type of boolean

2024-04-18 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new e439e29a7bf1 [SPARK-47463][SQL][3.5

(spark) branch branch-3.4 updated: [SPARK-47895][SQL] group by all should be idempotent

2024-04-18 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 11c1c520fe57 [SPARK-47895][SQL] group

(spark) branch branch-3.5 updated: [SPARK-47895][SQL] group by all should be idempotent

2024-04-18 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 7aea21eae377 [SPARK-47895][SQL] group

(spark) branch master updated: [SPARK-47895][SQL] group by all should be idempotent

2024-04-18 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new b5bb75ca240a [SPARK-47895][SQL] group by all

(spark) branch master updated (c4b0c260bb13 -> 60e75e6e0275)

2024-04-17 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from c4b0c260bb13 [SPARK-47839][SQL] Fix aggregate bug in RewriteWithExpression add 60e75e6e0275 [SPARK-47810][SQL

(spark) branch master updated: [SPARK-47839][SQL] Fix aggregate bug in RewriteWithExpression

2024-04-17 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c4b0c260bb13 [SPARK-47839][SQL] Fix aggregate

(spark) branch master updated (37afc3fff8c6 -> 61a7901a2c83)

2024-04-17 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 37afc3fff8c6 [SPARK-47803][FOLLOWUP] Fix cast binary/decimal to variant add 61a7901a2c83 [SPARK-47846][SQL] Add

(spark) branch master updated: [SPARK-47803][FOLLOWUP] Fix cast binary/decimal to variant

2024-04-17 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 37afc3fff8c6 [SPARK-47803][FOLLOWUP] Fix cast

(spark) branch master updated: [SPARK-47867][FOLLOWUP] Fix variant parsing in JacksonParser

2024-04-17 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 21d8bbdc59d6 [SPARK-47867][FOLLOWUP] Fix

(spark) branch master updated: [SPARK-47360][SQL] Collation support: Overlay, FormatString, Length, BitLength, OctetLength, SoundEx, Luhncheck

2024-04-17 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f99b1b1dd14d [SPARK-47360][SQL] Collation

(spark) branch master updated: [SPARK-47416][SQL] Add new functions to CollationBenchmark

2024-04-17 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 1b65b2aebf4e [SPARK-47416][SQL] Add new

(spark) branch master updated: [SPARK-47765][SQL][FOLLOWUP] Disable SET COLLATION when collations are disabled

2024-04-17 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e2e6710fc8ea [SPARK-47765][SQL][FOLLOWUP

(spark) branch master updated (e327c1220abf -> 1b53f122d56c)

2024-04-17 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from e327c1220abf [SPARK-47884][INFRA] Switch ANSI SQL CI job to NON-ANSI SQL CI job add 1b53f122d56c [SPARK-47863

(spark) branch master updated: [SPARK-47822][SQL] Prohibit Hash Expressions from hashing the Variant Data Type

2024-04-17 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4e754f778fdc [SPARK-47822][SQL] Prohibit Hash

(spark) branch master updated (4913c344756d -> 76882d0c13db)

2024-04-17 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 4913c344756d [SPARK-47867][SQL] Support variant in JSON scan add 76882d0c13db [SPARK-47821][SQL] Implement

(spark) branch master updated: [SPARK-47867][SQL] Support variant in JSON scan

2024-04-17 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4913c344756d [SPARK-47867][SQL] Support variant

(spark) branch master updated: [SPARK-47417][SQL] Collation support: Ascii, Chr, Base64, UnBase64, Decode, StringDecode, Encode, ToBinary, FormatNumber, Sentences

2024-04-16 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ee2673f2e948 [SPARK-47417][SQL] Collation

(spark) branch master updated: [SPARK-47356][SQL] Add support for ConcatWs & Elt (all collations)

2024-04-16 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4dad2170b05c [SPARK-47356][SQL] Add support

(spark) branch master updated: [SPARK-47420][SQL] Fix test output

2024-04-15 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 6762d1f8beaf [SPARK-47420][SQL] Fix test output

(spark) branch master updated: [SPARK-47769][SQL] Add schema_of_variant_agg expression

2024-04-15 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 348b1bcff75c [SPARK-47769][SQL] Add

(spark) branch master updated: [SPARK-47463][SQL] Use V2Predicate to wrap expression with return type of boolean

2024-04-15 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new fa3ef03a0734 [SPARK-47463][SQL] Use V2Predicate

(spark) branch master updated (be080703688f -> c5b8e60e0d59)

2024-04-15 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from be080703688f [SPARK-47673][SS] Implementing TTL for ListState add c5b8e60e0d59 [SPARK-46810][DOCS] Align error

(spark) branch master updated (b8354bbe53c0 -> f3a6ca9e2c47)

2024-04-15 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from b8354bbe53c0 [SPARK-47851][CONNECT][DOCS] Document pyspark-connect package add f3a6ca9e2c47 [SPARK-47357][SQL

(spark) branch master updated: [SPARK-47803][SQL] Support cast to variant

2024-04-14 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new dd4c7fc6ae91 [SPARK-47803][SQL] Support cast

(spark) branch master updated: [SPARK-47765][SQL] Add SET COLLATION to parser rules

2024-04-12 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new de00ac8a05ae [SPARK-47765][SQL] Add SET

(spark) branch master updated: [SPARK-47800][SQL] Create new method for identifier to tableIdentifier conversion

2024-04-12 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 27987536be38 [SPARK-47800][SQL] Create new

(spark) branch master updated: [SPARK-47410][SQL] Refactor UTF8String and CollationFactory

2024-04-11 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 31036274fc1c [SPARK-47410][SQL] Refactor

(spark) branch master updated: [SPARK-47617][SQL] Add TPC-DS testing infrastructure for collations

2024-04-11 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 6e371e1df50e [SPARK-47617][SQL] Add TPC-DS

(spark) branch master updated: [SPARK-47736][SQL] Add support for AbstractArrayType

2024-04-11 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a8b919f924db [SPARK-47736][SQL] Add support

(spark) branch master updated: [SPARK-47001][SQL] Pushdown verification in optimizer

2024-04-10 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d0605bf3bf7b [SPARK-47001][SQL] Pushdown

(spark) branch master updated: [SPARK-47274][PYTHON][SQL] Provide more useful context for PySpark DataFrame API errors

2024-04-10 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 86ae0d2bc198 [SPARK-47274][PYTHON][SQL] Provide

(spark) branch master updated (8da9a70f701a -> b637bb92a2f8)

2024-04-10 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 8da9a70f701a [SPARK-47725][INFRA][FOLLOW-UP] Do not run scheduled job in forked repository add b637bb92a2f8

(spark) branch master updated: [SPARK-47693][SQL] Add optimization for lowercase comparison of UTF8String used in UTF8_BINARY_LCASE collation

2024-04-10 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 627f6082edca [SPARK-47693][SQL] Add

(spark) branch master updated: [SPARK-47775][SQL] Support remaining scalar types in the variant spec

2024-04-10 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d817c9a60f51 [SPARK-47775][SQL] Support

(spark) branch master updated: [SPARK-47680][SQL] Add variant_explode expression

2024-04-10 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4cb364e6f615 [SPARK-47680][SQL] Add

(spark) branch master updated: [SPARK-47786] SELECT DISTINCT (*) should not become SELECT DISTINCT struct(*) (revert to previous behavior)

2024-04-09 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e8e7dcce4ac7 [SPARK-47786] SELECT DISTINCT

(spark) branch master updated (08c49637795f -> 319edfdc5cd6)

2024-04-08 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 08c49637795f [SPARK-47770][INFRA] Fix `GenerateMIMAIgnore.isPackagePrivateModule` to return `false` instead

(spark) branch master updated: [SPARK-47504][SQL] Resolve AbstractDataType simpleStrings for StringTypeCollated

2024-04-08 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new abb7b046d50d [SPARK-47504][SQL] Resolve

(spark) branch master updated: [SPARK-47681][SQL] Add schema_of_variant expression

2024-04-08 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 134a13928965 [SPARK-47681][SQL] Add

(spark) branch master updated: [SPARK-47657][SQL] Implement collation filter push down support per file source

2024-04-07 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new eb8e99721714 [SPARK-47657][SQL] Implement

(spark) branch master updated: [SPARK-47713][SQL][CONNECT] Fix a self-join failure

2024-04-07 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 3a39ac231fe4 [SPARK-47713][SQL][CONNECT] Fix

(spark) branch master updated (ad2367c55aeb -> f576b8542f2e)

2024-04-07 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from ad2367c55aeb [MINOR][PYTHON][SS][TESTS] Drop the tables after being used at `test_streaming_foreach_batch` add

(spark) branch master updated (0107435cb39d -> d5620cbe9a2e)

2024-04-04 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 0107435cb39d [SPARK-47734][PYTHON][TESTS] Fix flaky DataFrame.writeStream doctest by stopping streaming query

(spark) branch master updated: [SPARK-47689][SQL][FOLLOWUP] More accurate file path in TASK_WRITE_FAILED error

2024-04-04 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 5f9f5db9f363 [SPARK-47689][SQL][FOLLOWUP] More

(spark) branch master updated: Revert "[SPARK-47708][CONNECT] Do not log gRPC exception to stderr in PySpark

2024-04-04 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 3b8aea39953c Revert "[SPARK-47708][CONNEC

(spark) branch master updated: [SPARK-47081][CONNECT] Support Query Execution Progress

2024-04-03 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f6999df0c7f0 [SPARK-47081][CONNECT] Support

(spark) branch master updated: [SPARK-47210][SQL] Addition of implicit casting without indeterminate support

2024-04-03 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e3aab8c19492 [SPARK-47210][SQL] Addition

(spark) branch master updated: [SPARK-47689][SQL] Do not wrap query execution error during data writing

2024-04-02 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ba98b7ae53f8 [SPARK-47689][SQL] Do not wrap

(spark) branch master updated: [SPARK-47634][SQL] Add legacy support for disabling map key normalization

2024-04-02 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e2e6e09a24db [SPARK-47634][SQL] Add legacy

(spark) branch master updated (43cedc0b3dea -> 1fd308951668)

2024-04-01 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 43cedc0b3dea [SPARK-46812][CONNECT][PYTHON] Make mapInPandas / mapInArrow support ResourceProfile add

(spark) branch master updated: [SPARK-46840][SQL][TESTS] Add `CollationBenchmark`

2024-04-01 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e9f204ae9306 [SPARK-46840][SQL][TESTS] Add

(spark) branch master updated: [SPARK-47569][SQL] Disallow comparing variant

2024-04-01 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new cf02b1a60d9d [SPARK-47569][SQL] Disallow

(spark) branch master updated (a5ca5867298f -> 535734e3901f)

2024-04-01 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from a5ca5867298f [SPARK-47654][INFRA] Structured logging framework: support log concatenation add 535734e3901f

(spark) branch master updated: [SPARK-47572][SQL] Enforce Window partitionSpec is orderable

2024-03-29 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 609bd4839e5d [SPARK-47572][SQL] Enforce Window

(spark) branch master updated (a57f94b03e30 -> b3146721552f)

2024-03-28 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from a57f94b03e30 [SPARK-47638][PS][CONNECT] Skip column name validation in PS add b3146721552f [SPARK-47511][SQL

(spark) branch master updated (fde7a7f3d06b -> 41cbd56ba725)

2024-03-28 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from fde7a7f3d06b [SPARK-47546][SQL][FOLLOWUP] Improve validation when reading Variant from Parquet using non-vectorized

(spark) branch master updated: [SPARK-47559][SQL] Codegen Support for variant `parse_json`

2024-03-28 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8c4d6764674f [SPARK-47559][SQL] Codegen Support

(spark) branch master updated: [SPARK-47546][SQL] Improve validation when reading Variant from Parquet

2024-03-27 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f2492ddbfe9d [SPARK-47546][SQL] Improve

(spark) branch master updated: [SPARK-47563][SQL] Add map normalization on creation

2024-03-27 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 87449c3f1d65 [SPARK-47563][SQL] Add map

(spark) branch master updated (b540cc538614 -> d57164a5cab9)

2024-03-27 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from b540cc538614 [SPARK-47611][SQL] Cleanup dead code in MySQLDialect.getCatalystType add d57164a5cab9 [SPARK-47430

(spark) branch master updated: [SPARK-46575][SQL][FOLLOWUP] Add back `HiveThriftServer2.startWithContext(SQLContext)` method for compatibility

2024-03-27 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f9eb3f3c13bf [SPARK-46575][SQL][FOLLOWUP] Add

(spark) branch branch-3.5 updated: [SPARK-47561][SQL] Fix analyzer rule order issues about Alias

2024-03-26 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new 8bcbf7701388 [SPARK-47561][SQL] Fix

(spark) branch master updated: [SPARK-47431][SQL] Add session level default Collation

2024-03-26 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 6ee662c28ffb [SPARK-47431][SQL] Add session

(spark) branch master updated (0054a12a013f -> acf13d6515f7)

2024-03-25 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 0054a12a013f Revert "[SPARK-47450][INFRA][R] Use R 4.3.3 in `windows` R GitHub Action job" add ac

(spark) branch master updated: [SPARK-47497][SQL][FOLLOWUP] Add a UT for `nested structure` for the function `to_csv`

2024-03-25 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 0340f805fdd2 [SPARK-47497][SQL][FOLLOWUP] Add

(spark) branch master updated (1b55fd3ee107 -> b2f6474848fc)

2024-03-25 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 1b55fd3ee107 [SPARK-47539][SQL][FOLLOWUP] Fix UT about `variant` add b2f6474848fc [SPARK-46743][SQL] Count bug

(spark) branch master updated: [SPARK-47451][SQL] Support to_json(variant).

2024-03-25 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4a1f2419e243 [SPARK-47451][SQL] Support to_json

(spark) branch master updated (057acf986d78 -> 7b575d137a1a)

2024-03-21 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 057acf986d78 [SPARK-47512][SS] Tag operation type used with RocksDB state store instance lock acquisition/release

(spark) branch master updated: Revert "[SPARK-47007][SQL][PYTHON][R][CONNECT] Add the `map_sort` function"

2024-03-20 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new bb3e27581887 Revert "[SPARK-47007][SQL][P

(spark) branch master updated: [SPARK-46990][SQL] Fix loading empty Avro files emitted by event-hubs

2024-03-20 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 76260807eef2 [SPARK-46990][SQL] Fix loading

(spark) branch master updated (a3c04ec11456 -> 8762e256d164)

2024-03-20 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from a3c04ec11456 [SPARK-47478][SQL][TESTS] Improve test coverage for mysql bool synonyms add 8762e256d164 [SPARK

(spark) branch master updated (e01ed0da22f2 -> 681b41f0808e)

2024-03-18 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from e01ed0da22f2 [SPARK-47345][SQL][TESTS][FOLLOW-UP] Rename JSON to XML within XmlFunctionsSuite add 681b41f0808e

(spark) branch master updated: [SPARK-45891][DOCS] Update README with more details

2024-03-17 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 310dd5294267 [SPARK-45891][DOCS] Update README

(spark) branch master updated (fe0aa1edff04 -> 7eea705d3015)

2024-03-14 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from fe0aa1edff04 [SPARK-47402][BUILD] Upgrade `ZooKeeper` to 3.9.2 add 7eea705d3015 [SPARK-47366][SQL] Implement

(spark) branch branch-3.3 updated: [SPARK-47385] Fix tuple encoders with Option inputs

2024-03-14 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.3 by this push: new 45ba9224602e [SPARK-47385] Fix tuple

(spark) branch branch-3.4 updated: [SPARK-47385] Fix tuple encoders with Option inputs

2024-03-14 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.4 by this push: new 645a769e4c28 [SPARK-47385] Fix tuple

(spark) branch branch-3.5 updated: [SPARK-47385] Fix tuple encoders with Option inputs

2024-03-14 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.5 by this push: new e3317a7cc66c [SPARK-47385] Fix tuple

(spark) branch master updated (e9802116b047 -> 9986462811f1)

2024-03-14 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from e9802116b047 [SPARK-47374][CONNECT][DOCS] Fix connect-repl `usage prompt` & `docs link` add 9986462811f1 [S

(spark) branch master updated: [SPARK-47270][SQL] Dataset.isEmpty projects CommandResults locally

2024-03-11 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f350b760ea11 [SPARK-47270][SQL] Dataset.isEmpty

(spark) branch master updated (c0a8cf9cca08 -> 50131054b818)

2024-03-08 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from c0a8cf9cca08 [SPARK-47079][PYTHON][DOCS][FOLLOWUP] Add `VariantType` to API references add 50131054b818 [SPARK

(spark) branch master updated (456d246badb8 -> 0f9164201ff0)

2024-03-07 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 456d246badb8 [SPARK-47248][SQL][COLLATION] Improved string function support: contains add 0f9164201ff0 [SPARK

(spark) branch master updated (7a429aa84a5e -> 456d246badb8)

2024-03-07 Thread wenchen
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 7a429aa84a5e [MINOR][DOCS][PYTHON] Fix documentation typo in takeSample method add 456d246badb8 [SPARK-47248

  1   2   3   4   5   6   7   8   9   10   >