spark git commit: [MINOR] [SQL] Ignores Thrift server UISeleniumSuite

2015-05-22 Thread lian
Repository: spark Updated Branches: refs/heads/branch-1.4 bfaf6a094 - 1a284743e [MINOR] [SQL] Ignores Thrift server UISeleniumSuite This Selenium test case has been flaky for a while and led to frequent Jenkins build failure. Let's disable it temporarily until we figure out a proper

spark git commit: [SPARK-7322][SQL] Window functions in DataFrame

2015-05-22 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.4 19e579c55 - bfaf6a094 [SPARK-7322][SQL] Window functions in DataFrame This closes #6104. Author: Cheng Hao hao.ch...@intel.com Author: Reynold Xin r...@databricks.com Closes #6343 from rxin/window-df and squashes the following

spark git commit: [SPARK-7322][SQL] Window functions in DataFrame

2015-05-22 Thread rxin
Repository: spark Updated Branches: refs/heads/master 2728c3df6 - f6f2eeb17 [SPARK-7322][SQL] Window functions in DataFrame This closes #6104. Author: Cheng Hao hao.ch...@intel.com Author: Reynold Xin r...@databricks.com Closes #6343 from rxin/window-df and squashes the following commits:

spark git commit: [MINOR] [SQL] Ignores Thrift server UISeleniumSuite

2015-05-22 Thread lian
Repository: spark Updated Branches: refs/heads/master f6f2eeb17 - 4e5220c31 [MINOR] [SQL] Ignores Thrift server UISeleniumSuite This Selenium test case has been flaky for a while and led to frequent Jenkins build failure. Let's disable it temporarily until we figure out a proper solution.

spark git commit: [SPARK-7766] KryoSerializerInstance reuse is unsafe when auto-reset is disabled

2015-05-22 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master 509d55ab4 - eac00691d [SPARK-7766] KryoSerializerInstance reuse is unsafe when auto-reset is disabled SPARK-3386 / #5606 modified the shuffle write path to re-use serializer instances across multiple calls to DiskBlockObjectWriter. It

spark git commit: [SPARK-7766] KryoSerializerInstance reuse is unsafe when auto-reset is disabled

2015-05-22 Thread joshrosen
Repository: spark Updated Branches: refs/heads/branch-1.4 3b4f9ce85 - 2904d3f8b [SPARK-7766] KryoSerializerInstance reuse is unsafe when auto-reset is disabled SPARK-3386 / #5606 modified the shuffle write path to re-use serializer instances across multiple calls to DiskBlockObjectWriter. It

spark git commit: [SPARK-7758] [SQL] Override more configs to avoid failure when connect to a postgre sql

2015-05-22 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master eac00691d - 31d5d463e [SPARK-7758] [SQL] Override more configs to avoid failure when connect to a postgre sql https://issues.apache.org/jira/browse/SPARK-7758 When initializing `executionHive`, we only masks

spark git commit: [SPARK-7574] [ML] [DOC] User guide for OneVsRest

2015-05-22 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master c63036cd4 - 509d55ab4 [SPARK-7574] [ML] [DOC] User guide for OneVsRest Including Iris Dataset (after shuffling and relabeling 3 - 0 to confirm to 0 - numClasses-1 labeling). Could not find an existing dataset in data/mllib for multiclass

spark git commit: [SPARK-7724] [SQL] Support Intersect/Except in Catalyst DSL.

2015-05-22 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.4 40989cea0 - e18d623d9 [SPARK-7724] [SQL] Support Intersect/Except in Catalyst DSL. Author: Santiago M. Mola sa...@mola.io Closes #6327 from smola/feature/catalyst-dsl-set-ops and squashes the following commits: 11db778 [Santiago M.

spark git commit: [SPARK-7724] [SQL] Support Intersect/Except in Catalyst DSL.

2015-05-22 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 31d5d463e - e4aef91fe [SPARK-7724] [SQL] Support Intersect/Except in Catalyst DSL. Author: Santiago M. Mola sa...@mola.io Closes #6327 from smola/feature/catalyst-dsl-set-ops and squashes the following commits: 11db778 [Santiago M.

spark git commit: [SPARK-7624] Revert [SPARK-4939] revive offers periodically in LocalBackend in 1.3 branch

2015-05-22 Thread davies
Repository: spark Updated Branches: refs/heads/branch-1.3 a64e097f1 - f26e38234 [SPARK-7624] Revert [SPARK-4939] revive offers periodically in LocalBackend in 1.3 branch This reverts commit e196da840978b61b0222a5fc9b59b5511cf04606. Author: Davies Liu dav...@databricks.com Closes #6337 from

spark git commit: [SPARK-7834] [SQL] Better window error messages

2015-05-22 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 821254fb9 - 3c1305107 [SPARK-7834] [SQL] Better window error messages Author: Michael Armbrust mich...@databricks.com Closes #6363 from marmbrus/windowErrors and squashes the following commits: 516b02d [Michael Armbrust] [SPARK-7834]

spark git commit: [SPARK-7834] [SQL] Better window error messages

2015-05-22 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.4 afde4019b - d7660dc2f [SPARK-7834] [SQL] Better window error messages Author: Michael Armbrust mich...@databricks.com Closes #6363 from marmbrus/windowErrors and squashes the following commits: 516b02d [Michael Armbrust] [SPARK-7834]

spark git commit: [SPARK-7830] [DOCS] [MLLIB] Adding logistic regression to the list of Multiclass Classification Supported Methods documentation

2015-05-22 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master 8014e1f6b - 63a5ce75e [SPARK-7830] [DOCS] [MLLIB] Adding logistic regression to the list of Multiclass Classification Supported Methods documentation Added logistic regression to the list of Multiclass Classification Supported Methods in

spark git commit: [SPARK-7830] [DOCS] [MLLIB] Adding logistic regression to the list of Multiclass Classification Supported Methods documentation

2015-05-22 Thread jkbradley
Repository: spark Updated Branches: refs/heads/branch-1.4 17a51c887 - 08464ec63 [SPARK-7830] [DOCS] [MLLIB] Adding logistic regression to the list of Multiclass Classification Supported Methods documentation Added logistic regression to the list of Multiclass Classification Supported

spark git commit: [SPARK-7771] [SPARK-7779] Dynamic allocation: lower default timeouts further

2015-05-22 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master 3c1305107 - 3d8760d76 [SPARK-7771] [SPARK-7779] Dynamic allocation: lower default timeouts further The default add time of 5s is still too slow for small jobs. Also, the current default remove time of 10 minutes seem rather high. This

spark git commit: [SPARK-7771] [SPARK-7779] Dynamic allocation: lower default timeouts further

2015-05-22 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.4 d7660dc2f - 0be6e3b3e [SPARK-7771] [SPARK-7779] Dynamic allocation: lower default timeouts further The default add time of 5s is still too slow for small jobs. Also, the current default remove time of 10 minutes seem rather high. This

spark git commit: [SPARK-7788] Made KinesisReceiver.onStart() non-blocking

2015-05-22 Thread tdas
Repository: spark Updated Branches: refs/heads/master 3d8760d76 - 1c388a998 [SPARK-7788] Made KinesisReceiver.onStart() non-blocking KinesisReceiver calls worker.run() which is a blocking call (while loop) as per source code of kinesis-client library -

spark git commit: [SPARK-7760] add /json back into master worker pages; add test

2015-05-22 Thread joshrosen
Repository: spark Updated Branches: refs/heads/branch-1.4 d6cb04463 - afde4019b [SPARK-7760] add /json back into master worker pages; add test Author: Imran Rashid iras...@cloudera.com Closes #6284 from squito/SPARK-7760 and squashes the following commits: 5e02d8a [Imran Rashid] style;

spark git commit: [SPARK-7795] [CORE] Speed up task scheduling in standalone mode by reusing serializer

2015-05-22 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master 63a5ce75e - a16357413 [SPARK-7795] [CORE] Speed up task scheduling in standalone mode by reusing serializer My experiments with scheduling very short tasks in standalone cluster mode indicated that a significant amount of time was being

spark git commit: [MINOR] Add SparkR to create-release script

2015-05-22 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.4 08464ec63 - 1a134e5d4 [MINOR] Add SparkR to create-release script Enables the SparkR profiles for all the binary builds we create cc pwendell Author: Shivaram Venkataraman shiva...@cs.berkeley.edu Closes #6371 from

spark git commit: [MINOR] Add SparkR to create-release script

2015-05-22 Thread pwendell
Repository: spark Updated Branches: refs/heads/master a16357413 - 017b3404a [MINOR] Add SparkR to create-release script Enables the SparkR profiles for all the binary builds we create cc pwendell Author: Shivaram Venkataraman shiva...@cs.berkeley.edu Closes #6371 from

spark git commit: [SPARK-7578] [ML] [DOC] User guide for spark.ml Normalizer, IDF, StandardScaler

2015-05-22 Thread meng
Repository: spark Updated Branches: refs/heads/master 8f11c6116 - 2728c3df6 [SPARK-7578] [ML] [DOC] User guide for spark.ml Normalizer, IDF, StandardScaler Added user guide sections with code examples. Also added small Java unit tests to test Java example in guide. CC: mengxr Author: Joseph

spark git commit: [SPARK-6743] [SQL] Fix empty projections of cached data

2015-05-22 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 4e5220c31 - 3b68cb043 [SPARK-6743] [SQL] Fix empty projections of cached data Author: Michael Armbrust mich...@databricks.com Closes #6165 from marmbrus/wrongColumn and squashes the following commits: 4fad158 [Michael Armbrust] Merge

spark git commit: [SPARK-6743] [SQL] Fix empty projections of cached data

2015-05-22 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.4 1a284743e - 427dc04c1 [SPARK-6743] [SQL] Fix empty projections of cached data Author: Michael Armbrust mich...@databricks.com Closes #6165 from marmbrus/wrongColumn and squashes the following commits: 4fad158 [Michael Armbrust] Merge

spark git commit: [SPARK-7404] [ML] Add RegressionEvaluator to spark.ml

2015-05-22 Thread meng
Repository: spark Updated Branches: refs/heads/branch-1.4 427dc04c1 - d709d7ceb [SPARK-7404] [ML] Add RegressionEvaluator to spark.ml Author: Ram Sriharsha rsriharsha@hw11853.local Closes #6344 from harsha2010/SPARK-7404 and squashes the following commits: 16b9d77 [Ram Sriharsha] consistent

spark git commit: [SPARK-7404] [ML] Add RegressionEvaluator to spark.ml

2015-05-22 Thread meng
Repository: spark Updated Branches: refs/heads/master 3b68cb043 - f490b3b4c [SPARK-7404] [ML] Add RegressionEvaluator to spark.ml Author: Ram Sriharsha rsriharsha@hw11853.local Closes #6344 from harsha2010/SPARK-7404 and squashes the following commits: 16b9d77 [Ram Sriharsha] consistent

spark git commit: Revert [BUILD] Always run SQL tests in master build.

2015-05-22 Thread pwendell
Repository: spark Updated Branches: refs/heads/master f490b3b4c - c63036cd4 Revert [BUILD] Always run SQL tests in master build. This reverts commit 147b6be3b6d464dfc14836c08e690ab021a600de. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

spark git commit: Revert [BUILD] Always run SQL tests in master build.

2015-05-22 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.4 d709d7ceb - cb1de978f Revert [BUILD] Always run SQL tests in master build. This reverts commit 2be72c99aa51ba46f851348af9fbb4a39923a45a. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: