[spark] branch master updated: [SPARK-40724][PS][FOLLOW-UP] Simplify `corrwith` with method `inline`

2022-10-12 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 45d537ddeba [SPARK-40724][PS][FOLLOW-UP

[spark] branch master updated (cb53e34343b -> 18f1f53d303)

2022-10-12 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from cb53e34343b [MINOR][BUILD] Add `dist`dir to `fileset` of`maven-clean-plugin` add 18f1f53d303 [SPARK-38774][PS

[spark] branch master updated (67c6408f133 -> f8d68b00071)

2022-10-10 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 67c6408f133 [SPARK-40534][CONNECT] Extend the support for Join with different join types add f8d68b00071

[spark] branch master updated (d323fa8fc07 -> 76a7c5a3625)

2022-10-10 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from d323fa8fc07 [SPARK-40448][CONNECT][FOLLOWUP] Use more suitable variable name and fix code style add

[spark] branch master updated (e2176338c9b -> 03b055fa4e5)

2022-10-05 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from e2176338c9b [SPARK-40665][CONNECT] Avoid embedding Spark Connect in the Apache Spark binary release add

[spark] branch master updated (77f5c8442b1 -> 7bcf4b9b8d0)

2022-09-29 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 77f5c8442b1 [SPARK-40577][PS] Fix `CategoricalIndex.append` to match pandas 1.5.0 add 7bcf4b9b8d0 [SPARK-40606

[spark] branch master updated: [SPARK-40589][PS][TEST] Fix test for `DataFrame.corr_with` skip the pandas regression

2022-09-29 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e617503c3f0 [SPARK-40589][PS][TEST] Fix test

[spark] branch master updated (ab49dc21e43 -> 728f7e9841c)

2022-09-29 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from ab49dc21e43 [SPARK-39853][CORE] Support stage level task resource profile for standalone cluster when dynamic

[spark] branch master updated (31aadc4687c -> 7e5a87f0128)

2022-09-28 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 31aadc4687c [SPARK-40580][PS][DOCS] Update the document for `DataFrame.to_orc` add 7e5a87f0128 [SPARK-40604

[spark] branch master updated (38599e9a368 -> c28740a204c)

2022-09-28 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 38599e9a368 [SPARK-40509][SS][PYTHON] Add example for applyInPandasWithState add c28740a204c [SPARK-40592][PS

[spark] branch master updated: [SPARK-40575][DOCS] Add badges for PySpark downloads

2022-09-28 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8e0a332bf0e [SPARK-40575][DOCS] Add badges

[spark] branch master updated (f2ba6b55c1d -> 311a855884c)

2022-09-27 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from f2ba6b55c1d [SPARK-40573][PS] Make `ddof` in `GroupBy.std`, `GroupBy.var` and `GroupBy.sem` accept arbitary

[spark] branch master updated (072575c9e6f -> f2ba6b55c1d)

2022-09-27 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 072575c9e6f [SPARK-40557][CONNECT] Update generated proto files for Spark Connect add f2ba6b55c1d [SPARK-40573

[spark] branch master updated: [SPARK-40561][PS] Implement `min_count` in `GroupBy.min`

2022-09-26 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 211ce40888d [SPARK-40561][PS] Implement

[spark] branch master updated (b4014eb13a1 -> 0deba9fdd1a)

2022-09-26 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from b4014eb13a1 [SPARK-40330][PS] Implement `Series.searchsorted` add 0deba9fdd1a [SPARK-40554][PS] Make `ddof

[spark] branch master updated: [SPARK-40334][PS] Implement `GroupBy.prod`

2022-09-25 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c01e524c298 [SPARK-40334][PS] Implement

[spark] branch master updated: [SPARK-40543][PS][SQL] Make `ddof` in `DataFrame.var` and `Series.var` accept arbitary integers

2022-09-23 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new def8cca7d89 [SPARK-40543][PS][SQL] Make `ddof

[spark] branch master updated: [SPARK-40542][PS][SQL] Make `ddof` in `DataFrame.std` and `Series.std` accept arbitary integers

2022-09-22 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 83167e56ff9 [SPARK-40542][PS][SQL] Make `ddof

[spark] branch master updated (e5b4b32b2cd -> 1476a9f96e5)

2022-09-22 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from e5b4b32b2cd [SPARK-40434][SS][PYTHON][FOLLOWUP] Address review comments add 1476a9f96e5 [SPARK-40510][PS

[spark] branch master updated (603dc509821 -> 2a6017a5b1d)

2022-09-21 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 603dc509821 [SPARK-40434][SS][PYTHON] Implement applyInPandasWithState in PySpark add 2a6017a5b1d [SPARK-40327

[spark] branch master updated (3921e689e82 -> c6f4526be5e)

2022-09-21 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 3921e689e82 [SPARK-40332][PS][DOCS][FOLLOWUP] Fix wrong underline length add c6f4526be5e [SPARK-40498][PS

[spark] branch master updated (a031aaa487e -> 3921e689e82)

2022-09-21 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from a031aaa487e [SPARK-40496][SQL] Fix configs to control "enableDateTimeParsingFallback" add 3921e689

[spark] branch master updated (2aeb8d74c45 -> eee6e45ed17)

2022-09-20 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 2aeb8d74c45 [MINOR][DOCS][PYTHON] Document datetime.timedelta <> DayTimeIntervalType add eee6e45ed17

[spark] branch master updated: [SPARK-40447][PS] Implement `kendall` correlation in `DataFrame.corr`

2022-09-16 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 5b2bd1c9c0c [SPARK-40447][PS] Implement

[spark] branch master updated (4e0fea2393b -> 4e5ece2be34)

2022-09-16 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 4e0fea2393b [SPARK-40169][SQL] Don't pushdown Parquet filters with no reference to data schema add 4e5ece2be34

[spark] branch master updated: [SPARK-40196][PYTHON][PS][FOLLOWUP] Skip SparkFunctionsTests.test_repeat

2022-09-16 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new cd8c8746c34 [SPARK-40196][PYTHON][PS][FOLLOWUP

[spark] branch master updated: [SPARK-40440][PS][DOCS] Fix wrong reference and content in PS windows related doc

2022-09-15 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 3d14b745773 [SPARK-40440][PS][DOCS] Fix wrong

[spark] branch master updated (ea6857abff8 -> 1c46c87ddb1)

2022-09-14 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from ea6857abff8 [SPARK-40426][SQL] Return a map from SparkThrowable.getMessageParameters add 1c46c87ddb1 [SPARK

[spark] branch master updated: [SPARK-40399][PS] Make `pearson` correlation in `DataFrame.corr` support missing values and `min_periods `

2022-09-13 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ae08787f5c5 [SPARK-40399][PS] Make `pearson

[spark] branch master updated: [SPARK-40386][PS][SQL] Implement `ddof` in `DataFrame.cov`

2022-09-12 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f92b4941c63 [SPARK-40386][PS][SQL] Implement

[spark] branch master updated: [SPARK-40332][PS] Implement `GroupBy.quantile`

2022-09-08 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 6577c43852d [SPARK-40332][PS] Implement

[spark] branch master updated: [SPARK-40383][INFRA] Pin `mypy==0.920` in dev/requirements.txt

2022-09-08 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f8854184a76 [SPARK-40383][INFRA] Pin `mypy

[spark] branch master updated: [SPARK-40333][PS] Implement `GroupBy.nth`

2022-09-08 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4d73552abf3 [SPARK-40333][PS] Implement

[spark] branch master updated: [SPARK-40265][PS] Fix the inconsistent behavior for Index.intersection

2022-09-05 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8482ec9e5d8 [SPARK-40265][PS] Fix

[spark] branch master updated: [SPARK-40301][PYTHON] Add parameter validations in pyspark.rdd

2022-09-04 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c14320497d5 [SPARK-40301][PYTHON] Add

[spark] branch master updated: [SPARK-40305][PS] Implement Groupby.sem

2022-09-04 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new dde94a68b85 [SPARK-40305][PS] Implement

[spark] branch master updated: [SPARK-39284][FOLLOW] Add Groupby.mad to API references

2022-09-02 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 2ef2ad27faa [SPARK-39284][FOLLOW] Add

[spark] branch master updated (fd0498f81df -> b61bfde61d3)

2022-09-02 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from fd0498f81df [SPARK-40304][K8S][TESTS] Add `decomTestTag` to K8s Integration Test add b61bfde61d3 [SPARK-40210

[spark] branch master updated: [SPARK-40276][CORE] Reduce the result size of RDD.takeOrdered

2022-08-31 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a027db1dc03 [SPARK-40276][CORE] Reduce

[spark] branch master updated (6e62b93f3d1 -> 6c3c9575cf0)

2022-08-31 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 6e62b93f3d1 [SPARK-39896][SQL] UnwrapCastInBinaryComparison should work when the literal of In/InSet downcast

[spark] branch master updated: [SPARK-40271][PYTHON] Support list type for `pyspark.sql.functions.lit`

2022-08-30 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 65d89f8e897 [SPARK-40271][PYTHON] Support list

[spark] branch master updated (ca17135b288 -> e0cb2eb104e)

2022-08-30 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from ca17135b288 [SPARK-34777][UI] Fix StagePage input size/records not show when records greater than zero add

[spark] branch master updated (527ddece8fd -> 375b4e70029)

2022-08-29 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 527ddece8fd [SPARK-40247][SQL] Fix BitSet equality check add 375b4e70029 [SPARK-40243][DOCS] Enhance Hive UDF

[spark] branch master updated (f555a0d80e1 -> 4dd20ceb38b)

2022-08-27 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from f555a0d80e1 [SPARK-40240][PYTHON] PySpark rdd.takeSample should correctly validate `num > maxSampleSize`

[spark] branch master updated: [SPARK-40240][PYTHON] PySpark rdd.takeSample should correctly validate `num > maxSampleSize`

2022-08-27 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f555a0d80e1 [SPARK-40240][PYTHON] PySpark

[spark] branch master updated: [SPARK-40214][PYTHON][SQL] add 'get' to functions

2022-08-25 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 295e98d29b3 [SPARK-40214][PYTHON][SQL] add

[spark] branch master updated: [SPARK-39734][SPARK-36259][SPARK-39733][SPARK-37348][PYTHON] Functions Parity between PySpark and SQL

2022-08-10 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f8b15395cf3 [SPARK-39734][SPARK-36259][SPARK

[spark] branch master updated (527cce5dfde -> b012cb722f6)

2022-08-08 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 527cce5dfde [SPARK-40006][PYTHON][DOCS] Make pyspark.sql.group examples self-contained add b012cb722f6 [SPARK

[spark] branch master updated (1fed903f408 -> 0eef968efa4)

2022-08-08 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 1fed903f408 [SPARK-40004][CORE] Remove redundant `LevelDB.get` in `RemoteBlockPushResolver` add 0eef968efa4

[spark] branch master updated: [SPARK-39939][PYTHON][PS] return self.copy during calling shift with period == 0

2022-08-03 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c9eba123990 [SPARK-39939][PYTHON][PS] return

[spark] branch master updated: [SPARK-39877][PYTHON] Add unpivot to PySpark DataFrame API

2022-07-31 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8585fafab86 [SPARK-39877][PYTHON] Add unpivot

[spark] branch master updated: [SPARK-39823][SQL][PYTHON] Rename Dataset.as as Dataset.to and add DataFrame.to in PySpark

2022-07-26 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 91b95056806 [SPARK-39823][SQL][PYTHON] Rename

[spark] branch master updated: [SPARK-39760][PYTHON] Support Varchar in PySpark

2022-07-18 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 08808fb5079 [SPARK-39760][PYTHON] Support

[spark] branch master updated: [SPARK-39723][R] Implement functionExists/getFunc in SparkR for 3L namespace

2022-07-11 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new aa51da42908 [SPARK-39723][R] Implement

[spark] branch master updated: [SPARK-39719][R] Implement databaseExists/getDatabase in SparkR support 3L namespace

2022-07-11 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d5e9c5801cb [SPARK-39719][R] Implement

[spark] branch master updated: [SPARK-39720][R] Implement tableExists/getTable in SparkR for 3L namespace

2022-07-10 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c2f8f555dd7 [SPARK-39720][R] Implement

[spark] branch master updated: [SPARK-39716][R] Make currentDatabase/setCurrentDatabase/listCatalogs in SparkR support 3L namespace

2022-07-08 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 14ddcfcc44f [SPARK-39716][R] Make

[spark] branch master updated: [SPARK-39579][PYTHON][FOLLOWUP] fix functionExists(functionName, dbName) when dbName is not None

2022-07-05 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 1100d75f53c [SPARK-39579][PYTHON][FOLLOWUP

[spark] branch master updated: [SPARK-39646][SQL] Make setCurrentDatabase compatible with 3 layer namespace

2022-07-01 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new cbb4e7da692 [SPARK-39646][SQL] Make

[spark] branch master updated (309d5882bdc -> ed1a3402d2d)

2022-06-30 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 309d5882bdc [MINOR] Make the 'sep' description better in read_csv of pyspark p… add ed1a3402d2d [SPARK-39598

[spark-website] branch asf-site updated: Organization update (#401)

2022-06-29 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/spark-website.git The following commit(s) were added to refs/heads/asf-site by this push: new c2ed369e7 Organization update

[spark] branch master updated: [SPARK-39446][MLLIB][FOLLOWUP] Modify ranking metrics for java and python

2022-06-29 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new feae21c6445 [SPARK-39446][MLLIB][FOLLOWUP

[spark] branch master updated: [SPARK-39615][SQL] Make listColumns be compatible with 3 layer namespace

2022-06-28 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 1f15f2c6ad7 [SPARK-39615][SQL] Make

[spark] branch master updated (8f744783531 -> e1020a241a0)

2022-06-25 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 8f744783531 [SPARK-39596][INFRA] Install `ggplot2` for GitHub Action linter job add e1020a241a0 [SPARK-39483

[spark] branch master updated: [SPARK-39284][PS] Implement Groupby.mad

2022-06-04 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d793c5c6858 [SPARK-39284][PS] Implement

[spark] branch master updated: [SPARK-39228][PYTHON][PS] Implement `skipna` of `Series.argmax`

2022-05-26 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 2fd76994860 [SPARK-39228][PYTHON][PS

[spark] branch master updated: [SPARK-39300][PS] Move pandasSkewness and pandasKurtosis into pandas.spark.functions

2022-05-26 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 283aa9941bb [SPARK-39300][PS] Move

[spark] branch master updated: [SPARK-39268][SQL] AttachDistributedSequenceExec do not checkpoint childRDD with single partition

2022-05-25 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f673ebd8afc [SPARK-39268][SQL

[spark] branch master updated: [SPARK-39246][PS] Implement Groupby.skew

2022-05-21 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d165de8c04c [SPARK-39246][PS] Implement

[spark] branch master updated (49562f41678 -> 291d155b3c5)

2022-05-21 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 49562f41678 [SPARK-39167][SQL] Throw an exception w/ an error class for multiple rows from a subquery used

[spark] branch master updated (2349f74866a -> a24dfd697c7)

2022-05-07 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from 2349f74866a [SPARK-39121][K8S][DOCS] Fix format error on running-on-kubernetes doc add a24dfd697c7 [SPARK

[spark] branch master updated (c1c3f4f -> 669c625)

2022-03-31 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from c1c3f4f [SPARK-38679][SQL][TESTS][FOLLOW-UP] Add numPartitions parameter to TaskContextImpl

[spark] branch master updated (3858bf0 -> b902936)

2022-03-24 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 3858bf0 [SPARK-38063][SQL] Support split_part Function add b902936 [SPARK-38588][ML] Validate input dataset

[spark] branch master updated (a342214 -> 5bb001b)

2022-03-14 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from a342214 [SPARK-38535][SQL] Add the `datetimeUnit` enum and use it in `TIMESTAMPADD/DIFF` add 5bb001b [SPARK

[spark] branch master updated (8e44791 -> 2844a18)

2022-03-14 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 8e44791 [SPARK-38504][SQL] Cannot read TimestampNTZ as TimestampLTZ add 2844a18 [SPARK-38360][SQL][AVRO][SS

[spark] branch master updated: [SPARK-35707][ML] optimize sparse GEMM by skipping bound checking

2021-06-15 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 5c96d64 [SPARK-35707][ML] optimize sparse

[spark] branch master updated: [SPARK-35666][ML] gemv skip array shape checking

2021-06-15 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 2802ac3 [SPARK-35666][ML] gemv skip array

[spark] branch master updated (2a56cc3 -> 8c4b535)

2021-06-14 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 2a56cc3 [SPARK-35761][PYTHON] Use type-annotation based pandas_udf or avoid specifying udf types to suppress

[spark] branch master updated (d8e37a8 -> ffc61c6)

2021-06-06 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from d8e37a8 [SPARK-35100][ML][FOLLOWUP] AFT cleanup add ffc61c6 [SPARK-35619][ML] Refactor LinearRegression

[spark] branch master updated (50f7686 -> d8e37a8)

2021-06-06 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 50f7686 [SPARK-35599][PYTHON] Adjust `check_exact` parameter for older pd.testing add d8e37a8 [SPARK-35100

[spark] branch master updated (dbf0b50 -> c2de0a6)

2021-06-01 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from dbf0b50 [SPARK-35560][SQL] Remove redundant subexpression evaluation in nested subexpressions add c2de0a6

[spark] branch master updated (bcac733 -> 1f150b9)

2021-04-24 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from bcac733 [SPARK-35200][CORE] Avoid to recompute the pending speculative tasks in the ExecutorAllocationManager

[spark] branch master updated (c5fd94f -> 47da944)

2021-03-21 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from c5fd94f [SPARK-34772][TESTS][FOLLOWUP] Disable a test case using Hive 1.2.1 in Java9+ environment add

[spark] branch master updated (961c851 -> 5f1af69)

2021-02-04 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 961c851 [SPARK-34346][CORE][SQL] io.file.buffer.size set by spark.buffer.size will override by loading hive

[spark] branch master updated (a8eb443 -> e0251ac)

2021-01-31 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from a8eb443 [SPARK-34299][SQL] Clean up ResolveSessionCatalog's isTempView and isTempFunction add e0251ac

[spark] branch master updated (3c68670 -> 2c4e4f8)

2021-01-26 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 3c68670 [SPARK-34220][ML] BucketedRandomProjectionLSH transform optimization add 2c4e4f8 [SPARK-34189][ML

[spark] branch master updated (56e9426 -> 3c68670)

2021-01-26 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 56e9426 [SPARK-33518][ML][FOLLOWUP] MatrixFactorizationModel use GEMV add 3c68670 [SPARK-34220][ML

[spark] branch master updated (abf7e81 -> 56e9426)

2021-01-26 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from abf7e81 [SPARK-33212][FOLLOW-UP][BUILD] Bring back duplicate dependency check and add more strict Hadoop version

[spark] branch master updated (c8c70d5 -> 7c9b756)

2021-01-20 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from c8c70d5 [MINOR][TESTS] Increase tolerance to 0.2 for NaiveBayesSuite add 7c9b756 [SPARK-34047][ML] tree

[spark] branch master updated (6bd7a62 -> 7ff9ff1)

2021-01-11 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 6bd7a62 [SPARK-33711][K8S] Avoid race condition between POD lifecycle manager and scheduler backend add

[spark] branch branch-3.0 updated: [MINOR][3.1][3.0] Improve flaky NaiveBayes test

2021-01-11 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a commit to branch branch-3.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.0 by this push: new 4cbc177 [MINOR][3.1][3.0] Improve

[spark] branch branch-3.1 updated (59b6a71 -> d33f0d4)

2021-01-11 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch branch-3.1 in repository https://gitbox.apache.org/repos/asf/spark.git. from 59b6a71 [SPARK-31952][SQL] Fix incorrect memory spill metric when doing Aggregate add d33f0d4 [MINOR

[spark] branch master updated (3e5e086 -> 11fac23)

2021-01-10 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 3e5e086 [SPARK-34053][INFRA] Cancel the previous build add 11fac23 [MINOR] Improve flaky NaiveBayes test

[spark] branch master updated (b2a7930 -> ebd8b93)

2020-12-07 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from b2a7930 [SPARK-33680][SQL][TESTS][FOLLOWUP] Fix more test suites to have explicit confs add ebd8b93 [SPARK

[spark] branch master updated (02508b6 -> e4d1c10)

2020-12-07 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 02508b6 [SPARK-33621][SQL] Add a way to inject data source rewrite rules add e4d1c10 [SPARK-32320][PYSPARK

[spark] branch master updated (4f96670 -> 90d4d7d)

2020-12-02 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 4f96670 [SPARK-31953][SS] Add Spark Structured Streaming History Server Support add 90d4d7d [SPARK-33610

[spark] branch master updated (aeb3649 -> 8016123)

2020-11-30 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from aeb3649 [SPARK-33613][PYTHON][TESTS] Replace deprecated APIs in pyspark tests add 8016123 [SPARK-33592] Fix

[spark] branch revert-30327-adaptively_blockify_linear_svc_II created (now 0d22864)

2020-11-11 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch revert-30327-adaptively_blockify_linear_svc_II in repository https://gitbox.apache.org/repos/asf/spark.git. at 0d22864 Revert "[WIP] Test (#30327)" No new revisions

[spark] branch revert-30327-adaptively_blockify_linear_svc_II created (now 0d22864)

2020-11-11 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch revert-30327-adaptively_blockify_linear_svc_II in repository https://gitbox.apache.org/repos/asf/spark.git. at 0d22864 Revert "[WIP] Test (#30327)" No new revisions

[spark] branch master updated (9d58a2f -> 61ee5d8)

2020-11-11 Thread ruifengz
This is an automated email from the ASF dual-hosted git repository. ruifengz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 9d58a2f [MINOR][GRAPHX] Correct typos in the sub-modules: graphx, external, and examples add 61ee5d8 [WIP

<    3   4   5   6   7   8   9   10   >