spark git commit: [SPARK-25363][SQL] Fix schema pruning in where clause by ignoring unnecessary root fields

2018-09-12 Thread dbtsai
Repository: spark Updated Branches: refs/heads/branch-2.4 071babbab -> 4c1428fa2 [SPARK-25363][SQL] Fix schema pruning in where clause by ignoring unnecessary root fields ## What changes were proposed in this pull request? Schema pruning doesn't work if nested column is used in where clause.

spark git commit: [SPARK-25406][SQL] For ParquetSchemaPruningSuite.scala, move calls to `withSQLConf` inside calls to `test`

2018-09-13 Thread dbtsai
Repository: spark Updated Branches: refs/heads/master 45c4ebc81 -> a7e5aa6cd [SPARK-25406][SQL] For ParquetSchemaPruningSuite.scala, move calls to `withSQLConf` inside calls to `test` (Link to Jira: https://issues.apache.org/jira/browse/SPARK-25406) ## What changes were proposed in this pull

spark git commit: [SPARK-25406][SQL] For ParquetSchemaPruningSuite.scala, move calls to `withSQLConf` inside calls to `test`

2018-09-13 Thread dbtsai
Repository: spark Updated Branches: refs/heads/branch-2.4 cc19f424b -> 35a84baa5 [SPARK-25406][SQL] For ParquetSchemaPruningSuite.scala, move calls to `withSQLConf` inside calls to `test` (Link to Jira: https://issues.apache.org/jira/browse/SPARK-25406) ## What changes were proposed in this

spark-website git commit: Update committer page

2018-04-13 Thread dbtsai
Repository: spark-website Updated Branches: refs/heads/asf-site 658467248 -> 69b595481 Update committer page Author: DB Tsai Closes #113 from dbtsai/changeAffiliation. Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/sp

spark git commit: [Spark-24024][ML] Fix poisson deviance calculations in GLM to handle y = 0

2018-04-23 Thread dbtsai
Repository: spark Updated Branches: refs/heads/master afbdf4273 -> 293a0f29e [Spark-24024][ML] Fix poisson deviance calculations in GLM to handle y = 0 ## What changes were proposed in this pull request? It is reported by Spark users that the deviance calculation for poisson regression does

spark git commit: [SPARK-11237][ML] Add pmml export for k-means in Spark ML

2018-04-23 Thread dbtsai
Repository: spark Updated Branches: refs/heads/master 770add81c -> e82cb6834 [SPARK-11237][ML] Add pmml export for k-means in Spark ML ## What changes were proposed in this pull request? Adding PMML export to Spark ML's KMeans Model. ## How was this patch tested? New unit test for Spark ML

spark git commit: [SPARK-24181][SQL] Better error message for writing sorted data

2018-05-09 Thread dbtsai
nstead. ## How was this patch tested? More tests in `DataFrameReaderWriterSuite.scala` Author: DB Tsai Closes #21235 from dbtsai/fixException. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/6ea582e3 Tree: http://git-wip-u

spark git commit: [SPARK-24371][SQL] Added isInCollection in DataFrame API for Scala and Java.

2018-05-29 Thread dbtsai
;"".stripMargin ``` ## How was this patch tested? Several unit tests are added. Author: DB Tsai Closes #21416 from dbtsai/optimize-set. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/900bc1f7 Tree: http:/

spark git commit: [SPARK-24419][BUILD] Upgrade SBT to 0.13.17 with Scala 2.10.7 for JDK9+

2018-05-30 Thread dbtsai
ing tests Author: DB Tsai Closes #21458 from dbtsai/sbt. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/9e7bad0e Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/9e7bad0e Diff: http://git-wip-us.apache.org/repos/

spark git commit: [SPARK-24412][SQL] Adding docs about automagical type casting in `isin` and `isInCollection` APIs

2018-06-08 Thread dbtsai
Repository: spark Updated Branches: refs/heads/master f433ef786 -> 36a340913 [SPARK-24412][SQL] Adding docs about automagical type casting in `isin` and `isInCollection` APIs ## What changes were proposed in this pull request? Update documentation for `isInCollection` API to clealy explain th

spark git commit: [SPARK-10231] [MLLIB] update @Since annotation for mllib.classification

2015-08-25 Thread dbtsai
in constructors 2. correct some versions 3. remove `Since` on `toString` MechCoder dbtsai Author: Xiangrui Meng Closes #8421 from mengxr/SPARK-10231 and squashes the following commits: b2dce80 [Xiangrui Meng] update @Since annotation for mllib.classification Project: http://git-wip-us.apache.org/re

spark git commit: [SPARK-10231] [MLLIB] update @Since annotation for mllib.classification

2015-08-25 Thread dbtsai
in constructors 2. correct some versions 3. remove `Since` on `toString` MechCoder dbtsai Author: Xiangrui Meng Closes #8421 from mengxr/SPARK-10231 and squashes the following commits: b2dce80 [Xiangrui Meng] update @Since annotation for mllib.classification (cherry picked from com

spark git commit: [SPARK-10239] [SPARK-10244] [MLLIB] update since versions in mllib.pmml and mllib.util

2015-08-25 Thread dbtsai
Repository: spark Updated Branches: refs/heads/master 920590787 -> 00ae4be97 [SPARK-10239] [SPARK-10244] [MLLIB] update since versions in mllib.pmml and mllib.util Same as #8421 but for `mllib.pmml` and `mllib.util`. cc dbtsai Author: Xiangrui Meng Closes #8430 from mengxr/SPARK-10

spark git commit: [SPARK-10239] [SPARK-10244] [MLLIB] update since versions in mllib.pmml and mllib.util

2015-08-25 Thread dbtsai
Repository: spark Updated Branches: refs/heads/branch-1.5 055387c08 -> 6f05b7aeb [SPARK-10239] [SPARK-10244] [MLLIB] update since versions in mllib.pmml and mllib.util Same as #8421 but for `mllib.pmml` and `mllib.util`. cc dbtsai Author: Xiangrui Meng Closes #8430 from mengxr/SP

spark git commit: [SPARK-10238] [MLLIB] update since versions in mllib.linalg

2015-08-25 Thread dbtsai
Repository: spark Updated Branches: refs/heads/master 8668ead2e -> ab431f8a9 [SPARK-10238] [MLLIB] update since versions in mllib.linalg Same as #8421 but for `mllib.linalg`. cc dbtsai Author: Xiangrui Meng Closes #8440 from mengxr/SPARK-10238 and squashes the following commits: b384

spark git commit: [SPARK-10238] [MLLIB] update since versions in mllib.linalg

2015-08-25 Thread dbtsai
Repository: spark Updated Branches: refs/heads/branch-1.5 af98e51f2 -> 46750b912 [SPARK-10238] [MLLIB] update since versions in mllib.linalg Same as #8421 but for `mllib.linalg`. cc dbtsai Author: Xiangrui Meng Closes #8440 from mengxr/SPARK-10238 and squashes the following comm

spark git commit: [SPARK-10235] [MLLIB] update since versions in mllib.regression

2015-08-25 Thread dbtsai
Repository: spark Updated Branches: refs/heads/master fb7e12fe2 -> 4657fa1f3 [SPARK-10235] [MLLIB] update since versions in mllib.regression Same as #8421 but for `mllib.regression`. cc freeman-lab dbtsai Author: Xiangrui Meng Closes #8426 from mengxr/SPARK-10235 and squashes

spark git commit: [SPARK-10235] [MLLIB] update since versions in mllib.regression

2015-08-25 Thread dbtsai
Repository: spark Updated Branches: refs/heads/branch-1.5 6d8ebc801 -> 08d390f45 [SPARK-10235] [MLLIB] update since versions in mllib.regression Same as #8421 but for `mllib.regression`. cc freeman-lab dbtsai Author: Xiangrui Meng Closes #8426 from mengxr/SPARK-10235 and squashes

spark git commit: [SPARK-10236] [MLLIB] update since versions in mllib.feature

2015-08-25 Thread dbtsai
Repository: spark Updated Branches: refs/heads/branch-1.5 08d390f45 -> 21a10a86d [SPARK-10236] [MLLIB] update since versions in mllib.feature Same as #8421 but for `mllib.feature`. cc dbtsai Author: Xiangrui Meng Closes #8449 from mengxr/SPARK-10236.feature and squashes the follow

spark git commit: [SPARK-10236] [MLLIB] update since versions in mllib.feature

2015-08-25 Thread dbtsai
Repository: spark Updated Branches: refs/heads/master 4657fa1f3 -> 321d77596 [SPARK-10236] [MLLIB] update since versions in mllib.feature Same as #8421 but for `mllib.feature`. cc dbtsai Author: Xiangrui Meng Closes #8449 from mengxr/SPARK-10236.feature and squashes the following comm

spark git commit: [SPARK-10336][example] fix not being able to set intercept in LR example

2015-08-28 Thread dbtsai
Repository: spark Updated Branches: refs/heads/master c53c902fa -> 45723214e [SPARK-10336][example] fix not being able to set intercept in LR example `fitIntercept` is a command line option but not set in the main program. dbtsai Author: Shuo Xiang Closes #8510 from coderxiang/interc

spark git commit: [SPARK-10336][example] fix not being able to set intercept in LR example

2015-08-28 Thread dbtsai
Repository: spark Updated Branches: refs/heads/branch-1.5 ccda27a9b -> 9c58f6441 [SPARK-10336][example] fix not being able to set intercept in LR example `fitIntercept` is a command line option but not set in the main program. dbtsai Author: Shuo Xiang Closes #8510 from coderxi

spark git commit: [SPARK-9642] [ML] LinearRegression should supported weighted data

2015-09-21 Thread dbtsai
Repository: spark Updated Branches: refs/heads/master ca9fe540f -> 331f0b10f [SPARK-9642] [ML] LinearRegression should supported weighted data In many modeling application, data points are not necessarily sampled with equal probabilities. Linear regression should support weighting which accou

spark git commit: [SPARK-10668] [ML] Use WeightedLeastSquares in LinearRegression with L…

2015-10-19 Thread dbtsai
Repository: spark Updated Branches: refs/heads/master dfa41e63b -> 4c33a34ba [SPARK-10668] [ML] Use WeightedLeastSquares in LinearRegression with L… …2 regularization if the number of features is small Author: lewuathe Author: Lewuathe Author: Kai Sasaki Author: Lewuathe Closes #8884

[spark] branch branch-3.0 updated: [SPARK-31027][SQL] Refactor DataSourceStrategy to be more extendable

2020-03-04 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch branch-3.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.0 by this push: new 70c86e6 [SPARK-31027][SQL] Refactor

[spark] branch branch-3.0 updated: [SPARK-31027][SQL] Refactor DataSourceStrategy to be more extendable

2020-03-04 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch branch-3.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.0 by this push: new 70c86e6 [SPARK-31027][SQL] Refactor

[spark] branch master updated (8d5ef2f -> fe126a6)

2020-03-05 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 8d5ef2f [SPARK-31052][TEST][CORE] Fix flaky test "DAGSchedulerSuite.shuffle fetch failed on speculative task

[spark] branch branch-3.0 updated: [SPARK-31058][SQL][TEST-HIVE1.2] Consolidate the implementation of `quoteIfNeeded`

2020-03-05 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch branch-3.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.0 by this push: new 853f69a [SPARK-31058][SQL][TEST-HIVE1.2

[spark] branch master updated (cba17e0 -> 7911f95)

2020-03-06 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from cba17e0 [SPARK-30899][SQL] CreateArray/CreateMap's data type should not depend on SQLConf.get add 79

[spark] branch master updated (cba17e0 -> 7911f95)

2020-03-06 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from cba17e0 [SPARK-30899][SQL] CreateArray/CreateMap's data type should not depend on SQLConf.get add 79

[spark] branch branch-3.0 updated: [SPARK-31064][SQL] New Parquet Predicate Filter APIs with multi-part Identifier Support

2020-03-06 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch branch-3.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.0 by this push: new fc45b27 [SPARK-31064][SQL] New Parquet

[spark] branch branch-3.0 updated: [SPARK-31064][SQL] New Parquet Predicate Filter APIs with multi-part Identifier Support

2020-03-06 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch branch-3.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.0 by this push: new fc45b27 [SPARK-31064][SQL] New Parquet

[spark] branch branch-3.0 updated: [SPARK-31064][SQL] New Parquet Predicate Filter APIs with multi-part Identifier Support

2020-03-06 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch branch-3.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.0 by this push: new fc45b27 [SPARK-31064][SQL] New Parquet

[spark] branch master updated (fd0b228 -> dba525c)

2020-03-31 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from fd0b228 [SPARK-31290][R] Add back the deprecated R APIs add dba525c [SPARK-31313][K8S][TEST] Add `m01` node

[spark] branch master updated: [SPARK-31364][SQL][TESTS] Benchmark Parquet Nested Field Predicate Pushdown

2020-04-24 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 6a57616 [SPARK-31364][SQL][TESTS] Benchmark

[spark] branch master updated (249b214 -> 6a57616)

2020-04-24 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 249b214 [SPARK-20732][CORE] Decommission cache blocks to other executors when an executor is decommissioned

[spark] branch branch-3.0 updated: [SPARK-31364][SQL][TESTS] Benchmark Parquet Nested Field Predicate Pushdown

2020-04-24 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch branch-3.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.0 by this push: new f499f45 [SPARK-31364][SQL][TESTS

[spark] branch branch-3.0 updated: [SPARK-31364][SQL][TESTS] Benchmark Parquet Nested Field Predicate Pushdown

2020-04-24 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch branch-3.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.0 by this push: new f499f45 [SPARK-31364][SQL][TESTS

[spark] branch master updated: [SPARK-31582][YARN] Being able to not populate Hadoop classpath

2020-04-29 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ecfee82 [SPARK-31582][YARN] Being able to not

[spark] branch master updated (226301a -> ecfee82)

2020-04-29 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 226301a [SPARK-29339][R][FOLLOW-UP] Remove requireNamespace1 workaround for arrow add ecfee82 [SPARK-31582

[spark] branch branch-3.0 updated: [SPARK-31582][YARN] Being able to not populate Hadoop classpath

2020-04-29 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch branch-3.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.0 by this push: new 9ccf828 [SPARK-31582][YARN] Being able

[spark] branch branch-3.0 updated: [SPARK-31582][YARN] Being able to not populate Hadoop classpath

2020-04-29 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch branch-3.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.0 by this push: new 9ccf828 [SPARK-31582][YARN] Being able

[spark] branch branch-2.4 updated (4be3390 -> 3b17ad3)

2020-04-29 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git. from 4be3390 [SPARK-31519][SQL][2.4] Datetime functions in having aggregate expressions returns the wrong result

[spark] branch master updated (6994c64 -> 07209f3e)

2020-05-12 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 6994c64 [SPARK-31387] Handle unknown operation/session ID in HiveThriftServer2Listener add 07209f3e [SPARK

[spark] branch branch-3.0 updated: [SPARK-31683][CORE] Make Prometheus output consistent with DropWizard 4.1 result

2020-05-12 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch branch-3.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.0 by this push: new e892a01 [SPARK-31683][CORE] Make

[spark] branch branch-2.4 updated (fdbd32e -> 281c591)

2020-05-19 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git. from fdbd32e [SPARK-31692][SQL] Pass hadoop confs specifed via Spark confs to URLStreamHandlerfactory add

[spark] branch branch-2.4 updated: [SPARK-31399][CORE][2.4] Support indylambda Scala closure in ClosureCleaner

2020-05-19 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.4 by this push: new 281c591 [SPARK-31399][CORE][2.4

[spark] branch master updated (979593d -> 367d94a)

2020-06-02 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 979593d [SPARK-31566][SQL][DOCS] Add SQL Rest API Documentation add 367d94a [SPARK-31876][BUILD] Upgrade to

[spark] branch master updated (979593d -> 367d94a)

2020-06-02 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 979593d [SPARK-31566][SQL][DOCS] Add SQL Rest API Documentation add 367d94a [SPARK-31876][BUILD] Upgrade to

[spark] branch master updated (979593d -> 367d94a)

2020-06-02 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 979593d [SPARK-31566][SQL][DOCS] Add SQL Rest API Documentation add 367d94a [SPARK-31876][BUILD] Upgrade to

[spark] branch master updated (979593d -> 367d94a)

2020-06-02 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 979593d [SPARK-31566][SQL][DOCS] Add SQL Rest API Documentation add 367d94a [SPARK-31876][BUILD] Upgrade to

[spark] branch master updated (979593d -> 367d94a)

2020-06-02 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 979593d [SPARK-31566][SQL][DOCS] Add SQL Rest API Documentation add 367d94a [SPARK-31876][BUILD] Upgrade to

[spark] branch master updated (4badef3 -> 9b79251)

2020-06-17 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 4badef3 [SPARK-32000][CORE][TESTS] Fix the flaky test for partially launched task in barrier-mode add 9b79251

[spark] branch master updated (4badef3 -> 9b79251)

2020-06-17 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 4badef3 [SPARK-32000][CORE][TESTS] Fix the flaky test for partially launched task in barrier-mode add 9b79251

[spark] branch master updated (4badef3 -> 9b79251)

2020-06-17 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 4badef3 [SPARK-32000][CORE][TESTS] Fix the flaky test for partially launched task in barrier-mode add 9b79251

[spark] branch master updated (4badef3 -> 9b79251)

2020-06-17 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 4badef3 [SPARK-32000][CORE][TESTS] Fix the flaky test for partially launched task in barrier-mode add 9b79251

[spark] branch master updated (a025a89 -> 50911df)

2020-07-29 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from a025a89 [SPARK-32332][SQL] Support columnar exchanges add 50911df [SPARK-32397][BUILD] Allow specifying of

[spark] branch master updated (a025a89 -> 50911df)

2020-07-29 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from a025a89 [SPARK-32332][SQL] Support columnar exchanges add 50911df [SPARK-32397][BUILD] Allow specifying of

[spark] branch branch-3.0 updated: [SPARK-32397][BUILD] Allow specifying of time for build to keep time consistent between modules

2020-07-29 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch branch-3.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.0 by this push: new d00e104 [SPARK-32397][BUILD] Allow

[spark] branch branch-2.4 updated: [SPARK-32397][BUILD] Allow specifying of time for build to keep time consistent between modules

2020-07-29 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.4 by this push: new 4a8f692 [SPARK-32397][BUILD] Allow

[spark] branch master updated (a025a89 -> 50911df)

2020-07-29 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from a025a89 [SPARK-32332][SQL] Support columnar exchanges add 50911df [SPARK-32397][BUILD] Allow specifying of

[spark] branch branch-3.0 updated: [SPARK-32397][BUILD] Allow specifying of time for build to keep time consistent between modules

2020-07-29 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch branch-3.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.0 by this push: new d00e104 [SPARK-32397][BUILD] Allow

[spark] branch branch-2.4 updated: [SPARK-32397][BUILD] Allow specifying of time for build to keep time consistent between modules

2020-07-29 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.4 by this push: new 4a8f692 [SPARK-32397][BUILD] Allow

[spark] branch master updated (a025a89 -> 50911df)

2020-07-29 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from a025a89 [SPARK-32332][SQL] Support columnar exchanges add 50911df [SPARK-32397][BUILD] Allow specifying of

[spark] branch branch-3.0 updated: [SPARK-32397][BUILD] Allow specifying of time for build to keep time consistent between modules

2020-07-29 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch branch-3.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.0 by this push: new d00e104 [SPARK-32397][BUILD] Allow

[spark] branch branch-2.4 updated: [SPARK-32397][BUILD] Allow specifying of time for build to keep time consistent between modules

2020-07-29 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.4 by this push: new 4a8f692 [SPARK-32397][BUILD] Allow

[spark] branch master updated (a025a89 -> 50911df)

2020-07-29 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from a025a89 [SPARK-32332][SQL] Support columnar exchanges add 50911df [SPARK-32397][BUILD] Allow specifying of

[spark] branch branch-3.0 updated: [SPARK-32397][BUILD] Allow specifying of time for build to keep time consistent between modules

2020-07-29 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch branch-3.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.0 by this push: new d00e104 [SPARK-32397][BUILD] Allow

[spark] branch branch-2.4 updated: [SPARK-32397][BUILD] Allow specifying of time for build to keep time consistent between modules

2020-07-29 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.4 by this push: new 4a8f692 [SPARK-32397][BUILD] Allow

[spark] branch branch-3.0 updated: [SPARK-32397][BUILD] Allow specifying of time for build to keep time consistent between modules

2020-07-29 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch branch-3.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.0 by this push: new d00e104 [SPARK-32397][BUILD] Allow

[spark] branch branch-2.4 updated: [SPARK-32397][BUILD] Allow specifying of time for build to keep time consistent between modules

2020-07-29 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.4 by this push: new 4a8f692 [SPARK-32397][BUILD] Allow

[spark] branch master updated (806140d -> 1453a09)

2020-08-31 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 806140d [SPARK-32592][SQL] Make DataFrameReader.table take the specified options add 1453a09 [SPARK-32721

[spark] branch master updated (806140d -> 1453a09)

2020-08-31 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 806140d [SPARK-32592][SQL] Make DataFrameReader.table take the specified options add 1453a09 [SPARK-32721

[spark] branch master updated (806140d -> 1453a09)

2020-08-31 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 806140d [SPARK-32592][SQL] Make DataFrameReader.table take the specified options add 1453a09 [SPARK-32721

[spark] branch master updated (806140d -> 1453a09)

2020-08-31 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 806140d [SPARK-32592][SQL] Make DataFrameReader.table take the specified options add 1453a09 [SPARK-32721

[spark] branch master updated (806140d -> 1453a09)

2020-08-31 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 806140d [SPARK-32592][SQL] Make DataFrameReader.table take the specified options add 1453a09 [SPARK-32721

[spark] branch master updated (a701bc7 -> 94d313b0)

2020-08-31 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from a701bc7 [SPARK-32659][SQL][FOLLOWUP] Improve test for pruning DPP on non-atomic type add 94d313b0 [SPARK-32721

[spark] branch master updated (a701bc7 -> 94d313b0)

2020-08-31 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from a701bc7 [SPARK-32659][SQL][FOLLOWUP] Improve test for pruning DPP on non-atomic type add 94d313b0 [SPARK-32721

[spark] branch master updated (a701bc7 -> 94d313b0)

2020-08-31 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from a701bc7 [SPARK-32659][SQL][FOLLOWUP] Improve test for pruning DPP on non-atomic type add 94d313b0 [SPARK-32721

[spark] branch master updated (a701bc7 -> 94d313b0)

2020-08-31 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from a701bc7 [SPARK-32659][SQL][FOLLOWUP] Improve test for pruning DPP on non-atomic type add 94d313b0 [SPARK-32721

[spark] branch master updated (a701bc7 -> 94d313b0)

2020-08-31 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from a701bc7 [SPARK-32659][SQL][FOLLOWUP] Improve test for pruning DPP on non-atomic type add 94d313b0 [SPARK-32721

[spark] branch master updated (ba13b94 -> cb3fa6c)

2020-10-21 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from ba13b94 [SPARK-33210][SQL] Set the rebasing mode for parquet INT96 type to `EXCEPTION` by default add cb3fa6c

[spark] branch master updated (ba13b94 -> cb3fa6c)

2020-10-21 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from ba13b94 [SPARK-33210][SQL] Set the rebasing mode for parquet INT96 type to `EXCEPTION` by default add cb3fa6c

[spark] branch master updated (ba13b94 -> cb3fa6c)

2020-10-21 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from ba13b94 [SPARK-33210][SQL] Set the rebasing mode for parquet INT96 type to `EXCEPTION` by default add cb3fa6c

[spark] branch master updated (ba13b94 -> cb3fa6c)

2020-10-21 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from ba13b94 [SPARK-33210][SQL] Set the rebasing mode for parquet INT96 type to `EXCEPTION` by default add cb3fa6c

[spark] branch master updated (ba13b94 -> cb3fa6c)

2020-10-21 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from ba13b94 [SPARK-33210][SQL] Set the rebasing mode for parquet INT96 type to `EXCEPTION` by default add cb3fa6c

[spark] branch master updated (1f6e2f5 -> 05c6b8a)

2021-06-29 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 1f6e2f5 Revert "[SPARK-35721][PYTHON] Path level discover for python unittests" add 05c6b8a [S

[spark] branch master updated (3b0dd14 -> 71fe094)

2021-08-11 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 3b0dd14 Update Spark key negotiation protocol add 71fe094 [SPARK-36481][ML] Expose

[spark] branch master updated: [SPARK-36644][SQL] Push down boolean column filter

2021-09-03 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d3e3df1 [SPARK-36644][SQL] Push down boolean

[spark] branch master updated: [SPARK-36726] Upgrade Parquet to 1.12.1

2021-09-15 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a927b08 [SPARK-36726] Upgrade Parquet to 1.12.1

[spark] branch branch-3.2 updated: [SPARK-36726] Upgrade Parquet to 1.12.1

2021-09-15 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch branch-3.2 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.2 by this push: new a7dc824 [SPARK-36726] Upgrade Parquet

[spark] branch master updated: [SPARK-36814][SQL] Make class ColumnarBatch extendable

2021-09-21 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 688b95b [SPARK-36814][SQL] Make class

[spark] branch master updated (e4e64c7 -> d03999a)

2021-09-27 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from e4e64c7 [SPARK-36848][SQL] Migrate ShowCurrentNamespaceStatement to v2 command framework add d03999a [SPARK

spark git commit: [SPARK-25860][SPARK-26107][FOLLOW-UP] Rule ReplaceNullWithFalseInPredicate

2018-11-26 Thread dbtsai
Repository: spark Updated Branches: refs/heads/master 1c487f7d1 -> 85383d29e [SPARK-25860][SPARK-26107][FOLLOW-UP] Rule ReplaceNullWithFalseInPredicate ## What changes were proposed in this pull request? Based on https://github.com/apache/spark/pull/22857 and https://github.com/apache/spark/

[2/2] spark git commit: [SPARK-26133][ML] Remove deprecated OneHotEncoder and rename OneHotEncoderEstimator to OneHotEncoder

2018-11-28 Thread dbtsai
[SPARK-26133][ML] Remove deprecated OneHotEncoder and rename OneHotEncoderEstimator to OneHotEncoder ## What changes were proposed in this pull request? We have deprecated `OneHotEncoder` at Spark 2.3.0 and introduced `OneHotEncoderEstimator`. At 3.0.0, we remove deprecated `OneHotEncoder` and

[1/2] spark git commit: [SPARK-26133][ML] Remove deprecated OneHotEncoder and rename OneHotEncoderEstimator to OneHotEncoder

2018-11-28 Thread dbtsai
Repository: spark Updated Branches: refs/heads/master fa0d4bf69 -> 8bfea86b1 http://git-wip-us.apache.org/repos/asf/spark/blob/8bfea86b/mllib/src/test/scala/org/apache/spark/ml/feature/OneHotEncoderSuite.scala -- diff --git a/

[spark] branch master updated: [SPARK-26551][SQL] Fix schema pruning error when selecting one complex field and having is not null predicate on another one

2019-01-11 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 50ebf3a [SPARK-26551][SQL] Fix schema pruning

[spark] branch branch-2.4 updated: [SPARK-26551][SQL] Fix schema pruning error when selecting one complex field and having is not null predicate on another one

2019-01-11 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.4 by this push: new 0e5b316 [SPARK-26551][SQL] Fix schema

svn commit: r31911 - /dev/spark/v2.2.3-rc1-bin/ /release/spark/spark-2.2.3/

2019-01-11 Thread dbtsai
Author: dbtsai Date: Sat Jan 12 00:14:38 2019 New Revision: 31911 Log: Publish Apache Spark 2.2.3 Added: release/spark/spark-2.2.3/ - copied from r31910, dev/spark/v2.2.3-rc1-bin/ Removed: dev/spark/v2.2.3-rc1-bin

svn commit: r31912 - /release/spark/KEYS

2019-01-11 Thread dbtsai
Author: dbtsai Date: Sat Jan 12 00:38:01 2019 New Revision: 31912 Log: Update KEYS Modified: release/spark/KEYS Modified: release/spark/KEYS == --- release/spark/KEYS (original) +++ release/spark/KEYS Sat Jan 12 00

<    1   2   3   4   >