git commit: [SPARK-3054][STREAMING] Add unit tests for Spark Sink.

2014-08-20 Thread tdas
Repository: spark Updated Branches: refs/heads/branch-1.1 5b22ebf68 - 9b2909955 [SPARK-3054][STREAMING] Add unit tests for Spark Sink. This patch adds unit tests for Spark Sink. It also removes the private[flume] for Spark Sink, since the sink is instantiated from Flume configuration (looks

git commit: SPARK-3092 [SQL]: Always include the thriftserver when -Phive is enabled.

2014-08-20 Thread pwendell
Repository: spark Updated Branches: refs/heads/master 8c5a22269 - f2f26c2a1 SPARK-3092 [SQL]: Always include the thriftserver when -Phive is enabled. Currently we have a separate profile called hive-thriftserver. I originally suggested this in case users did not want to bundle the

git commit: SPARK-3092 [SQL]: Always include the thriftserver when -Phive is enabled.

2014-08-20 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.1 9b2909955 - ca7322dda SPARK-3092 [SQL]: Always include the thriftserver when -Phive is enabled. Currently we have a separate profile called hive-thriftserver. I originally suggested this in case users did not want to bundle the

git commit: [SPARK-3126][SPARK-3127][SQL] Fixed HiveThriftServer2Suite

2014-08-20 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master ceb19830b - cf46e7258 [SPARK-3126][SPARK-3127][SQL] Fixed HiveThriftServer2Suite This PR fixes two issues: 1. Fixes wrongly quoted command line option in `HiveThriftServer2Suite` that makes test cases hang until timeout. 1. Asks

git commit: [SPARK-3126][SPARK-3127][SQL] Fixed HiveThriftServer2Suite

2014-08-20 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.1 ca7322dda - 99ca704ab [SPARK-3126][SPARK-3127][SQL] Fixed HiveThriftServer2Suite This PR fixes two issues: 1. Fixes wrongly quoted command line option in `HiveThriftServer2Suite` that makes test cases hang until timeout. 1. Asks

git commit: [SPARK-2849] Handle driver configs separately in client mode

2014-08-20 Thread pwendell
Repository: spark Updated Branches: refs/heads/master c1ba4cd6b - b3ec51bfd [SPARK-2849] Handle driver configs separately in client mode In client deploy mode, the driver is launched from within `SparkSubmit`'s JVM. This means by the time we parse Spark configs from `spark-defaults.conf`, it

git commit: [SPARK-2849] Handle driver configs separately in client mode

2014-08-20 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.1 25b01fd6b - beb705a47 [SPARK-2849] Handle driver configs separately in client mode In client deploy mode, the driver is launched from within `SparkSubmit`'s JVM. This means by the time we parse Spark configs from

git commit: [SPARK-2298] Encode stage attempt in SparkListener UI.

2014-08-20 Thread pwendell
Repository: spark Updated Branches: refs/heads/master b3ec51bfd - fb60bec34 [SPARK-2298] Encode stage attempt in SparkListener UI. Simple way to reproduce this in the UI: ```scala val f = new java.io.File(/tmp/test) f.delete() sc.parallelize(1 to 2, 2).map(x = (x,x

git commit: [SPARK-2846][SQL] Add configureInputJobPropertiesForStorageHandler to initialization of job conf

2014-08-20 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.1 5f72d7bcf - 64e136a64 [SPARK-2846][SQL] Add configureInputJobPropertiesForStorageHandler to initialization of job conf ...al job conf Author: Alex Liu alex_li...@yahoo.com Closes #1927 from alexliu68/SPARK-SQL-2846 and squashes the

[1/2] git commit: [SPARK-2169] Don't copy appName / basePath everywhere.

2014-08-20 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.1 64e136a64 - dc05282ba [SPARK-2169] Don't copy appName / basePath everywhere. Instead of keeping copies in all pages, just reference the values kept in the base SparkUI instance (by making them available via getters). Author: Marcelo

[1/2] git commit: Revert [maven-release-plugin] prepare for next development iteration

2014-08-20 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.1 dc05282ba - 2bcabcd6a Revert [maven-release-plugin] prepare for next development iteration This reverts commit c204a742a9eb9d3fd318e0f059bd00cbfb8b2c14. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

[2/2] git commit: Revert [maven-release-plugin] prepare release v1.1.0-snapshot1

2014-08-20 Thread pwendell
Revert [maven-release-plugin] prepare release v1.1.0-snapshot1 This reverts commit d428d88418d385d1d04e1b0adcb6b068efe9c7b0. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/2bcabcd6 Tree:

git commit: [SPARK-3140] Clarify confusing PySpark exception message

2014-08-20 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.1 2bcabcd6a - f8bcb12c1 [SPARK-3140] Clarify confusing PySpark exception message We read the py4j port from the stdout of the `bin/spark-submit` subprocess. If there is interference in stdout (e.g. a random echo in `spark-submit`), we

git commit: [SPARK-3143][MLLIB] add tf-idf user guide

2014-08-20 Thread meng
Repository: spark Updated Branches: refs/heads/master ba3c730e3 - e1571874f [SPARK-3143][MLLIB] add tf-idf user guide Moved TF-IDF before Word2Vec because the former is more basic. I also added a link for Word2Vec. atalwalkar Author: Xiangrui Meng m...@databricks.com Closes #2061 from

git commit: [SPARK-2843][MLLIB] add a section about regularization parameter in ALS

2014-08-20 Thread meng
Repository: spark Updated Branches: refs/heads/branch-1.1 1af68caf6 - eba399b3c [SPARK-2843][MLLIB] add a section about regularization parameter in ALS atalwalkar srowen Author: Xiangrui Meng m...@databricks.com Closes #2064 from mengxr/als-doc and squashes the following commits: b2e20ab

[1/2] git commit: [HOTFIX][Streaming] Handle port collisions in flume polling test

2014-08-20 Thread tdas
Repository: spark Updated Branches: refs/heads/branch-1.1 eba399b3c - 44856654c [HOTFIX][Streaming] Handle port collisions in flume polling test This is failing my tests in #1777. @tdas Author: Andrew Or andrewo...@gmail.com Closes #1803 from andrewor14/fix-flaky-streaming-test and squashes

Git Push Summary

2014-08-20 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.1.0-snapshot2 [created] 631b798a5 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org