[spark] branch master updated (929d313 -> 5a7aa6f)

2019-06-23 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 929d313 [SPARK-28059][SQL][TEST] Port int4.sql add 5a7aa6f [SPARK-27100][SQL] Use `Array` instead of `Seq` in

[spark] branch master updated: [SPARK-28118][CORE] Add `spark.eventLog.compression.codec` configuration

2019-06-20 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 47f54b1 [SPARK-28118][CORE] Add

[spark] branch master updated (1e87694 -> a12de29)

2019-05-24 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 1e87694 [SPARK-27677][CORE] Disable by default fetching of disk persisted RDD blocks via external shuffle service

[spark] branch master updated: [SPARK-27762][SQL] Support user provided avro schema for writing fields with different ordering

2019-05-21 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 808d9d0 [SPARK-27762][SQL] Support user

[spark] branch master updated: [SPARK-27493][BUILD][FOLLOWUP] Upgrade ASM to 7.1 in plugins.sbt

2019-04-23 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 810be5d [SPARK-27493][BUILD][FOLLOWUP] Upgrade

[spark-website] branch asf-site updated: Add Spark 2.4.1 link to doc (#189)

2019-04-04 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/spark-website.git The following commit(s) were added to refs/heads/asf-site by this push: new 5266543 Add Spark 2.4.1 link to doc

[spark-website] branch asf-site updated: 2.4.1 official release (#188)

2019-04-04 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/spark-website.git The following commit(s) were added to refs/heads/asf-site by this push: new aba645a 2.4.1 official release

[spark] tag v2.4.1 created (now 5830101)

2019-04-01 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to tag v2.4.1 in repository https://gitbox.apache.org/repos/asf/spark.git. at 5830101 (commit) No new revisions were added by this update

svn commit: r33357 - /dev/spark/v2.3.3-rc2-docs/

2019-04-01 Thread dbtsai
Author: dbtsai Date: Mon Apr 1 07:11:28 2019 New Revision: 33357 Log: Removing RC artifacts. Removed: dev/spark/v2.3.3-rc2-docs/ - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e

svn commit: r33356 - in /dev/spark: v2.4.1-rc2-bin/ v2.4.1-rc2-docs/ v2.4.1-rc5-bin/ v2.4.1-rc5-docs/ v2.4.1-rc6-bin/ v2.4.1-rc6-docs/ v2.4.1-rc8-bin/ v2.4.1-rc8-docs/ v2.4.1-rc9-docs/

2019-04-01 Thread dbtsai
Author: dbtsai Date: Mon Apr 1 07:10:42 2019 New Revision: 33356 Log: Removing RC artifacts. Removed: dev/spark/v2.4.1-rc2-bin/ dev/spark/v2.4.1-rc2-docs/ dev/spark/v2.4.1-rc5-bin/ dev/spark/v2.4.1-rc5-docs/ dev/spark/v2.4.1-rc6-bin/ dev/spark/v2.4.1-rc6-docs/ dev

svn commit: r33355 - /release/spark/KEYS

2019-03-31 Thread dbtsai
Author: dbtsai Date: Mon Apr 1 06:57:57 2019 New Revision: 33355 Log: Update KEYS Modified: release/spark/KEYS Modified: release/spark/KEYS == --- release/spark/KEYS (original) +++ release/spark/KEYS Mon Apr 1 06

svn commit: r33353 - /dev/spark/v2.4.1-rc9-bin/ /release/spark/spark-2.4.1/

2019-03-31 Thread dbtsai
Author: dbtsai Date: Mon Apr 1 06:55:22 2019 New Revision: 33353 Log: (empty) Added: release/spark/spark-2.4.1/ - copied from r33352, dev/spark/v2.4.1-rc9-bin/ Removed: dev/spark/v2.4.1-rc9-bin/ - To unsubscribe

svn commit: r33222 - in /dev/spark/v2.4.1-rc9-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _site/api/java/org/apache/spark

2019-03-26 Thread dbtsai
Author: dbtsai Date: Wed Mar 27 05:46:16 2019 New Revision: 33222 Log: Apache Spark v2.4.1-rc9 docs [This commit notification would consist of 1481 parts, which exceeds the limit of 50 ones, so it was shortened to the summary

svn commit: r33219 - /dev/spark/v2.4.1-rc9-bin/

2019-03-26 Thread dbtsai
Author: dbtsai Date: Wed Mar 27 04:05:32 2019 New Revision: 33219 Log: Apache Spark v2.4.1-rc9 Added: dev/spark/v2.4.1-rc9-bin/ dev/spark/v2.4.1-rc9-bin/SparkR_2.4.1.tar.gz (with props) dev/spark/v2.4.1-rc9-bin/SparkR_2.4.1.tar.gz.asc dev/spark/v2.4.1-rc9-bin/SparkR_2.4.1

[spark] branch branch-2.4 updated (c7fd233 -> f0a3e89)

2019-03-25 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git. from c7fd233 [SPARK-26961][CORE] Enable parallel classloading capability add 5830101 Preparing Spark release

[spark] 01/01: Preparing development version 2.4.2-SNAPSHOT

2019-03-25 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git commit f0a3e89993f0b67d5bf6adc0379b5f7d397ef86a Author: DB Tsai AuthorDate: Tue Mar 26 04:38:38 2019 + Preparing

[spark] tag v2.4.1-rc9 created (now 5830101)

2019-03-25 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to tag v2.4.1-rc9 in repository https://gitbox.apache.org/repos/asf/spark.git. at 5830101 (commit) This tag includes the following new commits: new 5830101 Preparing Spark release v2.4.1-rc9

[spark] 01/01: Preparing Spark release v2.4.1-rc9

2019-03-25 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to tag v2.4.1-rc9 in repository https://gitbox.apache.org/repos/asf/spark.git commit 58301018003931454e93d8a309c7149cf84c279e Author: DB Tsai AuthorDate: Tue Mar 26 04:38:19 2019 + Preparing

[spark] branch branch-2.4 updated: [SPARK-27094][YARN][BRANCH-2.4] Work around RackResolver swallowing thread interrupt.

2019-03-25 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.4 by this push: new 704b75d [SPARK-27094][YARN][BRANCH-2.4

[spark] branch master updated: [SPARK-27197][SQL][TEST] Add ReadNestedSchemaTest for file-based data sources

2019-03-19 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4d52477 [SPARK-27197][SQL][TEST] Add

[spark] branch master updated: [SPARK-27034][SPARK-27123][SQL][FOLLOWUP] Update Nested Schema Pruning BM result with EC2

2019-03-13 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 3221bf4 [SPARK-27034][SPARK-27123][SQL

svn commit: r32897 - in /dev/spark/v2.4.1-rc8-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _site/api/java/org/apache/spark

2019-03-12 Thread dbtsai
Author: dbtsai Date: Wed Mar 13 02:47:08 2019 New Revision: 32897 Log: Apache Spark v2.4.1-rc8 docs [This commit notification would consist of 1478 parts, which exceeds the limit of 50 ones, so it was shortened to the summary

svn commit: r32894 - /dev/spark/v2.4.1-rc8-bin/

2019-03-12 Thread dbtsai
Author: dbtsai Date: Wed Mar 13 01:15:48 2019 New Revision: 32894 Log: Apache Spark v2.4.1-rc8 Added: dev/spark/v2.4.1-rc8-bin/ dev/spark/v2.4.1-rc8-bin/SparkR_2.4.1.tar.gz (with props) dev/spark/v2.4.1-rc8-bin/SparkR_2.4.1.tar.gz.asc dev/spark/v2.4.1-rc8-bin/SparkR_2.4.1

[spark] branch master updated: [SPARK-27123][SQL] Improve CollapseProject to handle projects cross limit/repartition/sample

2019-03-12 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 78314af [SPARK-27123][SQL] Improve

[spark] 01/01: Preparing development version 2.4.2-SNAPSHOT

2019-03-09 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git commit dba5bac66760cf8b47052c94f3d79ffeb00e2eb3 Author: DB Tsai AuthorDate: Sun Mar 10 06:34:15 2019 + Preparing

[spark] branch branch-2.4 updated (a017a1c -> dba5bac)

2019-03-09 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git. from a017a1c [SPARK-27097][CHERRY-PICK 2.4] Avoid embedding platform-dependent offsets literally in whole-stage

[spark] tag v2.4.1-rc8 created (now 746b3dd)

2019-03-09 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to tag v2.4.1-rc8 in repository https://gitbox.apache.org/repos/asf/spark.git. at 746b3dd (commit) This tag includes the following new commits: new 746b3dd Preparing Spark release v2.4.1-rc8

[spark] 01/01: Preparing Spark release v2.4.1-rc8

2019-03-09 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to tag v2.4.1-rc8 in repository https://gitbox.apache.org/repos/asf/spark.git commit 746b3ddee6f7ad3464e326228ea226f5b1f39a41 Author: DB Tsai AuthorDate: Sun Mar 10 06:33:54 2019 + Preparing

[spark] branch branch-2.4 updated: [SPARK-27097][CHERRY-PICK 2.4] Avoid embedding platform-dependent offsets literally in whole-stage generated code

2019-03-09 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.4 by this push: new a017a1c [SPARK-27097][CHERRY-PICK 2.4

[spark] branch master updated: [SPARK-27097] Avoid embedding platform-dependent offsets literally in whole-stage generated code

2019-03-08 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 57ae251 [SPARK-27097] Avoid embedding platform

[spark] 01/01: Preparing development version 2.4.2-SNAPSHOT

2019-03-08 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git commit 0297ff5801274fee19b998c8f7d31218353cb367 Author: DB Tsai AuthorDate: Fri Mar 8 20:38:02 2019 + Preparing

[spark] branch branch-2.4 updated (216eeec -> 0297ff5)

2019-03-08 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git. from 216eeec [SPARK-26604][CORE][BACKPORT-2.4] Clean up channel registration for StreamManager add e87fe15

[spark] tag v2.4.1-rc7 created (now e87fe15)

2019-03-08 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to tag v2.4.1-rc7 in repository https://gitbox.apache.org/repos/asf/spark.git. at e87fe15 (commit) This tag includes the following new commits: new e87fe15 Preparing Spark release v2.4.1-rc7

[spark] 01/01: Preparing Spark release v2.4.1-rc7

2019-03-08 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to tag v2.4.1-rc7 in repository https://gitbox.apache.org/repos/asf/spark.git commit e87fe15c3a9985ce5ca54c24377eb9b530b5c755 Author: DB Tsai AuthorDate: Fri Mar 8 20:37:43 2019 + Preparing Spark

svn commit: r32758 - in /dev/spark/v2.4.1-rc6-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _site/api/java/org/apache/spark

2019-03-04 Thread dbtsai
Author: dbtsai Date: Tue Mar 5 02:11:48 2019 New Revision: 32758 Log: Apache Spark v2.4.1-rc6 docs [This commit notification would consist of 1478 parts, which exceeds the limit of 50 ones, so it was shortened to the summary

svn commit: r32756 - /dev/spark/v2.4.1-rc6-bin/

2019-03-04 Thread dbtsai
Author: dbtsai Date: Tue Mar 5 00:39:26 2019 New Revision: 32756 Log: Apache Spark v2.4.1-rc6 Added: dev/spark/v2.4.1-rc6-bin/ dev/spark/v2.4.1-rc6-bin/SparkR_2.4.1.tar.gz (with props) dev/spark/v2.4.1-rc6-bin/SparkR_2.4.1.tar.gz.asc dev/spark/v2.4.1-rc6-bin/SparkR_2.4.1

svn commit: r32753 - /dev/spark/v2.4.1-rc6-docs/

2019-03-04 Thread dbtsai
Author: dbtsai Date: Mon Mar 4 19:21:24 2019 New Revision: 32753 Log: Remove old rc6 doc build Removed: dev/spark/v2.4.1-rc6-docs/ - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e

svn commit: r32752 - /dev/spark/v2.4.1-rc6-bin/

2019-03-04 Thread dbtsai
Author: dbtsai Date: Mon Mar 4 19:21:02 2019 New Revision: 32752 Log: Remove old rc6 build Removed: dev/spark/v2.4.1-rc6-bin/ - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail

svn commit: r32737 - /dev/spark/KEYS

2019-03-03 Thread dbtsai
Author: dbtsai Date: Mon Mar 4 04:33:15 2019 New Revision: 32737 Log: Update KEYS Modified: dev/spark/KEYS Modified: dev/spark/KEYS == --- dev/spark/KEYS (original) +++ dev/spark/KEYS Mon Mar 4 04:33:15 2019

svn commit: r32723 - in /dev/spark/v2.4.1-rc6-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _site/api/java/org/apache/spark

2019-03-01 Thread dbtsai
Author: dbtsai Date: Sat Mar 2 04:36:34 2019 New Revision: 32723 Log: Apache Spark v2.4.1-rc6 docs [This commit notification would consist of 1478 parts, which exceeds the limit of 50 ones, so it was shortened to the summary

svn commit: r32722 - /dev/spark/v2.4.1-rc6-bin/

2019-03-01 Thread dbtsai
Author: dbtsai Date: Sat Mar 2 03:01:31 2019 New Revision: 32722 Log: Apache Spark v2.4.1-rc6 Added: dev/spark/v2.4.1-rc6-bin/ dev/spark/v2.4.1-rc6-bin/SparkR_2.4.1.tar.gz (with props) dev/spark/v2.4.1-rc6-bin/SparkR_2.4.1.tar.gz.asc dev/spark/v2.4.1-rc6-bin/SparkR_2.4.1

[spark] 01/01: Preparing Spark release v2.4.1-rc6

2019-03-01 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to tag v2.4.1-rc6 in repository https://gitbox.apache.org/repos/asf/spark.git commit 201ec8c9b46f9d037cc2e3a5d9c896b9840ca1bc Author: DB Tsai AuthorDate: Fri Mar 1 20:53:13 2019 + Preparing Spark

[spark] tag v2.4.1-rc6 created (now 201ec8c)

2019-03-01 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to tag v2.4.1-rc6 in repository https://gitbox.apache.org/repos/asf/spark.git. at 201ec8c (commit) This tag includes the following new commits: new 201ec8c Preparing Spark release v2.4.1-rc6

svn commit: r32614 - in /dev/spark/v2.4.1-rc5-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _site/api/java/org/apache/spark

2019-02-22 Thread dbtsai
Author: dbtsai Date: Sat Feb 23 06:52:21 2019 New Revision: 32614 Log: Apache Spark v2.4.1-rc5 docs [This commit notification would consist of 1478 parts, which exceeds the limit of 50 ones, so it was shortened to the summary

svn commit: r32613 - /dev/spark/v2.4.1-rc5-bin/

2019-02-22 Thread dbtsai
Author: dbtsai Date: Sat Feb 23 05:21:02 2019 New Revision: 32613 Log: Apache Spark v2.4.1-rc5 Added: dev/spark/v2.4.1-rc5-bin/ dev/spark/v2.4.1-rc5-bin/SparkR_2.4.1.tar.gz (with props) dev/spark/v2.4.1-rc5-bin/SparkR_2.4.1.tar.gz.asc dev/spark/v2.4.1-rc5-bin/SparkR_2.4.1

[spark] 01/01: Preparing development version 2.4.2-SNAPSHOT

2019-02-22 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git commit 073c47beeb468328dd88b7559d584d098ab6661f Author: DB Tsai AuthorDate: Fri Feb 22 22:54:37 2019 + Preparing

[spark] branch branch-2.4 updated (ef67be3 -> 073c47b)

2019-02-22 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git. from ef67be3 [SPARK-26950][SQL][TEST] Make RandomDataGenerator use Float.NaN or Double.NaN for all NaN values

[spark] tag v2.4.1-rc5 created (now eb2af24)

2019-02-22 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to tag v2.4.1-rc5 in repository https://gitbox.apache.org/repos/asf/spark.git. at eb2af24 (commit) This tag includes the following new commits: new eb2af24 Preparing Spark release v2.4.1-rc5

[spark] 01/01: Preparing Spark release v2.4.1-rc5

2019-02-22 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to tag v2.4.1-rc5 in repository https://gitbox.apache.org/repos/asf/spark.git commit eb2af242260e6f6f2c4ac8fdf11d171333101a4f Author: DB Tsai AuthorDate: Fri Feb 22 22:54:15 2019 + Preparing

[spark] branch master updated: [SPARK-26958][SQL][TEST] Add NestedSchemaPruningBenchmark

2019-02-21 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 6bd995b [SPARK-26958][SQL][TEST] Add

[spark] branch master updated: [SPARK-26958][SQL][TEST] Add NestedSchemaPruningBenchmark

2019-02-21 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 6bd995b [SPARK-26958][SQL][TEST] Add

[spark] branch branch-2.4 updated (d8576301 -> 3282544)

2019-02-21 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git. from d8576301 [R][BACKPORT-2.4] update package description add 79c1f7e Preparing Spark release v2.4.1-rc4

[spark] 01/01: Preparing development version 2.4.2-SNAPSHOT

2019-02-21 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git commit 32825442283fcd4c244c59ad7c4c9331538e790d Author: DB Tsai AuthorDate: Thu Feb 21 23:02:17 2019 + Preparing

[spark] 01/01: Preparing Spark release v2.4.1-rc4

2019-02-21 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to tag v2.4.1-rc4 in repository https://gitbox.apache.org/repos/asf/spark.git commit 79c1f7e89c6c15704d046fa4d334cacce3d19217 Author: DB Tsai AuthorDate: Thu Feb 21 23:01:58 2019 + Preparing

[spark] tag v2.4.1-rc4 created (now 79c1f7e)

2019-02-21 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to tag v2.4.1-rc4 in repository https://gitbox.apache.org/repos/asf/spark.git. at 79c1f7e (commit) This tag includes the following new commits: new 79c1f7e Preparing Spark release v2.4.1-rc4

[spark] 01/01: Preparing development version 2.4.2-SNAPSHOT

2019-02-20 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git commit 0926f49f407201384dd020073b41e7023465b7e9 Author: DB Tsai AuthorDate: Thu Feb 21 00:46:07 2019 + Preparing

[spark] branch branch-2.4 updated (274142b -> 0926f49)

2019-02-20 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git. from 274142b [SPARK-26859][SQL] Fix field writer index bug in non-vectorized ORC deserializer add 061185b

[spark] 01/01: Preparing Spark release v2.4.1-rc3

2019-02-20 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to tag v2.4.1-rc3 in repository https://gitbox.apache.org/repos/asf/spark.git commit 061185b9b872a672e3d58f8bbe819f8f70b33f91 Author: DB Tsai AuthorDate: Thu Feb 21 00:45:49 2019 + Preparing

[spark] tag v2.4.1-rc3 created (now 061185b)

2019-02-20 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to tag v2.4.1-rc3 in repository https://gitbox.apache.org/repos/asf/spark.git. at 061185b (commit) This tag includes the following new commits: new 061185b Preparing Spark release v2.4.1-rc3

svn commit: r32577 - /dev/spark/KEYS

2019-02-20 Thread dbtsai
Author: dbtsai Date: Thu Feb 21 00:41:41 2019 New Revision: 32577 Log: Update KEYS Modified: dev/spark/KEYS Modified: dev/spark/KEYS == --- dev/spark/KEYS (original) +++ dev/spark/KEYS Thu Feb 21 00:41:41 2019

svn commit: r32573 - /dev/spark/KEYS

2019-02-20 Thread dbtsai
Author: dbtsai Date: Wed Feb 20 23:32:09 2019 New Revision: 32573 Log: Update KEYS Modified: dev/spark/KEYS Modified: dev/spark/KEYS == --- dev/spark/KEYS (original) +++ dev/spark/KEYS Wed Feb 20 23:32:09 2019

svn commit: r32567 - in /dev/spark/v2.4.1-rc2-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _site/api/java/org/apache/spark

2019-02-19 Thread dbtsai
Author: dbtsai Date: Wed Feb 20 04:53:36 2019 New Revision: 32567 Log: Apache Spark v2.4.1-rc2 docs [This commit notification would consist of 1478 parts, which exceeds the limit of 50 ones, so it was shortened to the summary

svn commit: r32564 - /dev/spark/v2.4.1-rc2-bin/

2019-02-19 Thread dbtsai
Author: dbtsai Date: Wed Feb 20 03:17:53 2019 New Revision: 32564 Log: Apache Spark v2.4.1-rc2 Added: dev/spark/v2.4.1-rc2-bin/ dev/spark/v2.4.1-rc2-bin/SparkR_2.4.1.tar.gz (with props) dev/spark/v2.4.1-rc2-bin/SparkR_2.4.1.tar.gz.asc dev/spark/v2.4.1-rc2-bin/SparkR_2.4.1

[spark] branch branch-2.4 updated (383b662 -> 4c60056)

2019-02-19 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git. from 383b662 [MINOR][DOCS] Fix the update rule in StreamingKMeansModel documentation add 229ad52 Preparing

[spark] 01/01: Preparing development version 2.4.2-SNAPSHOT

2019-02-19 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git commit 4c60056749fd3892ba3171a268b2432a42ba2966 Author: DB Tsai AuthorDate: Tue Feb 19 21:54:45 2019 + Preparing

[spark] 01/01: Preparing Spark release v2.4.1-rc2

2019-02-19 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to tag v2.4.1-rc2 in repository https://gitbox.apache.org/repos/asf/spark.git commit 229ad524cfd3f74dd7aa5fc9ba841ae223caa960 Author: DB Tsai AuthorDate: Tue Feb 19 21:54:26 2019 + Preparing

[spark] tag v2.4.1-rc2 created (now 229ad52)

2019-02-19 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to tag v2.4.1-rc2 in repository https://gitbox.apache.org/repos/asf/spark.git. at 229ad52 (commit) This tag includes the following new commits: new 229ad52 Preparing Spark release v2.4.1-rc2

[spark] branch branch-2.4 updated (af3c711 -> 351b44d)

2019-02-12 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git. from af3c711 [SPARK-26082][MESOS][FOLLOWUP][BRANCH-2.4] Add UT on fetcher cache option on MesosClusterScheduler

[spark] 01/01: Preparing development version 2.4.2-SNAPSHOT

2019-02-12 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git commit 351b44de026345bee25a445365c55854242185c2 Author: DB Tsai AuthorDate: Tue Feb 12 10:45:14 2019 -0800 Preparing

[spark] 01/01: Preparing Spark release v2.4.1-rc1

2019-02-12 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to tag v2.4.1-rc1 in repository https://gitbox.apache.org/repos/asf/spark.git commit 50eba0e3db55e0b2c22518abba87ea8374809f00 Author: DB Tsai AuthorDate: Tue Feb 12 10:45:06 2019 -0800 Preparing

[spark] tag v2.4.1-rc1 created (now 50eba0e)

2019-02-12 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a change to tag v2.4.1-rc1 in repository https://gitbox.apache.org/repos/asf/spark.git. at 50eba0e (commit) This tag includes the following new commits: new 50eba0e Preparing Spark release v2.4.1-rc1

[spark] branch branch-2.3 updated: [SPARK-26706][SQL][FOLLOWUP] Fix `illegalNumericPrecedence` for ByteType

2019-01-23 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch branch-2.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.3 by this push: new 23e35d4 [SPARK-26706][SQL][FOLLOWUP

[spark] branch branch-2.3 updated: [SPARK-26706][SQL] Fix `illegalNumericPrecedence` for ByteType

2019-01-23 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch branch-2.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.3 by this push: new de3b5c4 [SPARK-26706][SQL] Fix

[spark] branch branch-2.4 updated: [SPARK-26706][SQL] Fix `illegalNumericPrecedence` for ByteType

2019-01-23 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.4 by this push: new 921c22b [SPARK-26706][SQL] Fix

[spark] branch master updated: [SPARK-26706][SQL] Fix `illegalNumericPrecedence` for ByteType

2019-01-23 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 0df29bf [SPARK-26706][SQL] Fix

[spark] branch master updated: [SPARK-26619][SQL] Prune the unused serializers from SerializeFromObject

2019-01-16 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8f17078 [SPARK-26619][SQL] Prune the unused

svn commit: r31923 - in /release/spark/spark-2.2.3: spark-2.2.3-bin-hadoop2.6.tgz.sha spark-2.2.3-bin-hadoop2.6.tgz.sha512

2019-01-12 Thread dbtsai
Author: dbtsai Date: Sat Jan 12 18:28:45 2019 New Revision: 31923 Log: Rename spark-2.2.3-bin-hadoop2.6.tgz.sha to spark-2.2.3-bin-hadoop2.6.tgz.sha512 Added: release/spark/spark-2.2.3/spark-2.2.3-bin-hadoop2.6.tgz.sha512 - copied unchanged from r31922, release/spark/spark-2.2.3/spark

svn commit: r31912 - /release/spark/KEYS

2019-01-11 Thread dbtsai
Author: dbtsai Date: Sat Jan 12 00:38:01 2019 New Revision: 31912 Log: Update KEYS Modified: release/spark/KEYS Modified: release/spark/KEYS == --- release/spark/KEYS (original) +++ release/spark/KEYS Sat Jan 12 00

svn commit: r31911 - /dev/spark/v2.2.3-rc1-bin/ /release/spark/spark-2.2.3/

2019-01-11 Thread dbtsai
Author: dbtsai Date: Sat Jan 12 00:14:38 2019 New Revision: 31911 Log: Publish Apache Spark 2.2.3 Added: release/spark/spark-2.2.3/ - copied from r31910, dev/spark/v2.2.3-rc1-bin/ Removed: dev/spark/v2.2.3-rc1-bin

[spark] branch branch-2.4 updated: [SPARK-26551][SQL] Fix schema pruning error when selecting one complex field and having is not null predicate on another one

2019-01-11 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.4 by this push: new 0e5b316 [SPARK-26551][SQL] Fix schema

[spark] branch master updated: [SPARK-26551][SQL] Fix schema pruning error when selecting one complex field and having is not null predicate on another one

2019-01-11 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 50ebf3a [SPARK-26551][SQL] Fix schema pruning

[1/2] spark git commit: [SPARK-26133][ML] Remove deprecated OneHotEncoder and rename OneHotEncoderEstimator to OneHotEncoder

2018-11-28 Thread dbtsai
Repository: spark Updated Branches: refs/heads/master fa0d4bf69 -> 8bfea86b1 http://git-wip-us.apache.org/repos/asf/spark/blob/8bfea86b/mllib/src/test/scala/org/apache/spark/ml/feature/OneHotEncoderSuite.scala -- diff --git a/

[2/2] spark git commit: [SPARK-26133][ML] Remove deprecated OneHotEncoder and rename OneHotEncoderEstimator to OneHotEncoder

2018-11-28 Thread dbtsai
[SPARK-26133][ML] Remove deprecated OneHotEncoder and rename OneHotEncoderEstimator to OneHotEncoder ## What changes were proposed in this pull request? We have deprecated `OneHotEncoder` at Spark 2.3.0 and introduced `OneHotEncoderEstimator`. At 3.0.0, we remove deprecated `OneHotEncoder` and

spark git commit: [SPARK-25860][SPARK-26107][FOLLOW-UP] Rule ReplaceNullWithFalseInPredicate

2018-11-26 Thread dbtsai
Repository: spark Updated Branches: refs/heads/master 1c487f7d1 -> 85383d29e [SPARK-25860][SPARK-26107][FOLLOW-UP] Rule ReplaceNullWithFalseInPredicate ## What changes were proposed in this pull request? Based on https://github.com/apache/spark/pull/22857 and https://github.com/apache/spark/

spark git commit: [SPARK-25676][FOLLOWUP][BUILD] Fix Scala 2.12 build error

2018-11-07 Thread dbtsai
Repository: spark Updated Branches: refs/heads/master 0025a8397 -> d68f3a726 [SPARK-25676][FOLLOWUP][BUILD] Fix Scala 2.12 build error ## What changes were proposed in this pull request? This PR fixes the Scala-2.12 build. ## How was this patch tested? Manual build with Scala-2.12 profile.

spark git commit: [SPARK-25946][BUILD] Upgrade ASM to 7.x to support JDK11

2018-11-05 Thread dbtsai
rom dbtsai/asm7. Authored-by: DB Tsai Signed-off-by: DB Tsai Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/3ed91c9b Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/3ed91c9b Diff: http://git-wip-us.apache.org/repos/

spark git commit: [SPARK-25764][ML][EXAMPLES] Update BisectingKMeans example to use ClusteringEvaluator

2018-11-05 Thread dbtsai
Repository: spark Updated Branches: refs/heads/master 486acda8c -> 0b5917000 [SPARK-25764][ML][EXAMPLES] Update BisectingKMeans example to use ClusteringEvaluator ## What changes were proposed in this pull request? Using `computeCost` for evaluating a model is a very poor approach. We should

spark git commit: [SPARK-25758][ML] Deprecate computeCost in BisectingKMeans

2018-11-05 Thread dbtsai
Repository: spark Updated Branches: refs/heads/master fc65b4af0 -> fc10c898f [SPARK-25758][ML] Deprecate computeCost in BisectingKMeans ## What changes were proposed in this pull request? The PR proposes to deprecate the `computeCost` method on `BisectingKMeans` in favor of the adoption of `

spark git commit: [SPARK-25860][SQL] Replace Literal(null, _) with FalseLiteral whenever possible

2018-10-31 Thread dbtsai
Repository: spark Updated Branches: refs/heads/master 68dde3481 -> bc9f9b4d6 [SPARK-25860][SQL] Replace Literal(null, _) with FalseLiteral whenever possible ## What changes were proposed in this pull request? This PR proposes a new optimization rule that replaces `Literal(null, _)` with `Fal

spark git commit: [SPARK-25662][SQL][TEST] Refactor DataSourceReadBenchmark to use main method

2018-10-11 Thread dbtsai
Repository: spark Updated Branches: refs/heads/master 83e19d5b8 -> 8115e6b26 [SPARK-25662][SQL][TEST] Refactor DataSourceReadBenchmark to use main method ## What changes were proposed in this pull request? 1. Refactor DataSourceReadBenchmark ## How was this patch tested? Manually tested and

spark git commit: [SPARK-25699][SQL] Partially push down conjunctive predicated in ORC

2018-10-10 Thread dbtsai
Repository: spark Updated Branches: refs/heads/master 8a7872dc2 -> 6df234579 [SPARK-25699][SQL] Partially push down conjunctive predicated in ORC ## What changes were proposed in this pull request? Inspired by https://github.com/apache/spark/pull/22574 . We can partially push down top level c

spark git commit: [SPARK-25559][FOLLOW-UP] Add comments for partial pushdown of conjuncts in Parquet

2018-10-09 Thread dbtsai
Repository: spark Updated Branches: refs/heads/master 3eee9e024 -> faf73dcd3 [SPARK-25559][FOLLOW-UP] Add comments for partial pushdown of conjuncts in Parquet ## What changes were proposed in this pull request? This is a follow up of https://github.com/apache/spark/pull/22574. Renamed the p

spark git commit: [SPARK-24418][FOLLOWUP][DOC] Update docs to show Scala 2.11.12

2018-09-15 Thread dbtsai
Repository: spark Updated Branches: refs/heads/master 02c2963f8 -> bfcf74260 [SPARK-24418][FOLLOWUP][DOC] Update docs to show Scala 2.11.12 ## What changes were proposed in this pull request? SPARK-24418 upgrades Scala to 2.11.12. This PR updates Scala version in docs. - https://spark.apach

spark git commit: [SPARK-24418][FOLLOWUP][DOC] Update docs to show Scala 2.11.12

2018-09-15 Thread dbtsai
Repository: spark Updated Branches: refs/heads/branch-2.4 b839721f3 -> 60af706b4 [SPARK-24418][FOLLOWUP][DOC] Update docs to show Scala 2.11.12 ## What changes were proposed in this pull request? SPARK-24418 upgrades Scala to 2.11.12. This PR updates Scala version in docs. - https://spark.a

spark git commit: [SPARK-25406][SQL] For ParquetSchemaPruningSuite.scala, move calls to `withSQLConf` inside calls to `test`

2018-09-13 Thread dbtsai
Repository: spark Updated Branches: refs/heads/branch-2.4 cc19f424b -> 35a84baa5 [SPARK-25406][SQL] For ParquetSchemaPruningSuite.scala, move calls to `withSQLConf` inside calls to `test` (Link to Jira: https://issues.apache.org/jira/browse/SPARK-25406) ## What changes were proposed in this

spark git commit: [SPARK-25406][SQL] For ParquetSchemaPruningSuite.scala, move calls to `withSQLConf` inside calls to `test`

2018-09-13 Thread dbtsai
Repository: spark Updated Branches: refs/heads/master 45c4ebc81 -> a7e5aa6cd [SPARK-25406][SQL] For ParquetSchemaPruningSuite.scala, move calls to `withSQLConf` inside calls to `test` (Link to Jira: https://issues.apache.org/jira/browse/SPARK-25406) ## What changes were proposed in this pull

spark git commit: [SPARK-25363][SQL] Fix schema pruning in where clause by ignoring unnecessary root fields

2018-09-12 Thread dbtsai
Repository: spark Updated Branches: refs/heads/branch-2.4 071babbab -> 4c1428fa2 [SPARK-25363][SQL] Fix schema pruning in where clause by ignoring unnecessary root fields ## What changes were proposed in this pull request? Schema pruning doesn't work if nested column is used in where clause.

spark git commit: [SPARK-25363][SQL] Fix schema pruning in where clause by ignoring unnecessary root fields

2018-09-12 Thread dbtsai
Repository: spark Updated Branches: refs/heads/master 2f422398b -> 3030b82c8 [SPARK-25363][SQL] Fix schema pruning in where clause by ignoring unnecessary root fields ## What changes were proposed in this pull request? Schema pruning doesn't work if nested column is used in where clause. Fo

spark git commit: [SPARK-24411][SQL] Adding native Java tests for 'isInCollection'

2018-08-30 Thread dbtsai
Repository: spark Updated Branches: refs/heads/master 135ff16a3 -> c685b5f56 [SPARK-24411][SQL] Adding native Java tests for 'isInCollection' ## What changes were proposed in this pull request? `JavaColumnExpressionSuite.java` was added and `org.apache.spark.sql.ColumnExpressionSuite#test("is

spark git commit: [SPARK-25235][SHELL] Merge the REPL code in Scala 2.11 and 2.12 branches

2018-08-28 Thread dbtsai
tch tested? Existing tests. Closes #22246 from dbtsai/repl. Lead-authored-by: DB Tsai Co-authored-by: Liang-Chi Hsieh Signed-off-by: DB Tsai Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/ff8dcc1d Tree: http://git-

<    1   2   3   4   >