git commit: SPARK-2294: fix locality inversion bug in TaskManager

2014-08-06 Thread matei
Repository: spark Updated Branches: refs/heads/master 5a826c00c - 63bdb1f41 SPARK-2294: fix locality inversion bug in TaskManager copied from original JIRA (https://issues.apache.org/jira/browse/SPARK-2294): If an executor E is free, a task may be speculatively assigned to E when there are

git commit: SPARK-2294: fix locality inversion bug in TaskManager

2014-08-06 Thread matei
Repository: spark Updated Branches: refs/heads/branch-1.1 048205549 - 1da2fdfab SPARK-2294: fix locality inversion bug in TaskManager copied from original JIRA (https://issues.apache.org/jira/browse/SPARK-2294): If an executor E is free, a task may be speculatively assigned to E when there

git commit: [MLlib] Use this.type as return type in k-means' builder pattern

2014-08-06 Thread meng
Repository: spark Updated Branches: refs/heads/master 63bdb1f41 - c7b52010d [MLlib] Use this.type as return type in k-means' builder pattern to ensure that the return object is itself. Author: DB Tsai dbt...@alpinenow.com Closes #1796 from dbtsai/dbtsai-kmeans and squashes the following

git commit: [MLlib] Use this.type as return type in k-means' builder pattern

2014-08-06 Thread meng
Repository: spark Updated Branches: refs/heads/branch-1.1 1da2fdfab - aec217a58 [MLlib] Use this.type as return type in k-means' builder pattern to ensure that the return object is itself. Author: DB Tsai dbt...@alpinenow.com Closes #1796 from dbtsai/dbtsai-kmeans and squashes the following

git commit: [SPARK-1022][Streaming][HOTFIX] Fixed zookeeper dependency of Kafka

2014-08-06 Thread pwendell
Repository: spark Updated Branches: refs/heads/master c7b52010d - ee7f30856 [SPARK-1022][Streaming][HOTFIX] Fixed zookeeper dependency of Kafka https://github.com/apache/spark/pull/1751 caused maven builds to fail. ``` ~/Apache/spark(branch-1.1|✔) ➤ mvn -U -DskipTests clean install . . .

git commit: [SPARK-2875] [PySpark] [SQL] handle null in schemaRDD()

2014-08-06 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 09f7e4587 - 48789117c [SPARK-2875] [PySpark] [SQL] handle null in schemaRDD() Handle null in schemaRDD during converting them into Python. Author: Davies Liu davies@gmail.com Closes #1802 from davies/json and squashes the following

git commit: [SPARK-2875] [PySpark] [SQL] handle null in schemaRDD()

2014-08-06 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.1 31090e43c - 27a8d4ce3 [SPARK-2875] [PySpark] [SQL] handle null in schemaRDD() Handle null in schemaRDD during converting them into Python. Author: Davies Liu davies@gmail.com Closes #1802 from davies/json and squashes the

git commit: [SPARK-2678][Core][SQL] A workaround for SPARK-2678

2014-08-06 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.1 27a8d4ce3 - cf8e7fd5e [SPARK-2678][Core][SQL] A workaround for SPARK-2678 JIRA issues: - Main: [SPARK-2678](https://issues.apache.org/jira/browse/SPARK-2678) - Related: [SPARK-2874](https://issues.apache.org/jira/browse/SPARK-2874)

git commit: [SPARK-2678][Core][SQL] A workaround for SPARK-2678

2014-08-06 Thread pwendell
Repository: spark Updated Branches: refs/heads/master 48789117c - a6cd31108 [SPARK-2678][Core][SQL] A workaround for SPARK-2678 JIRA issues: - Main: [SPARK-2678](https://issues.apache.org/jira/browse/SPARK-2678) - Related: [SPARK-2874](https://issues.apache.org/jira/browse/SPARK-2874)

git commit: [SPARK-2627] [PySpark] have the build enforce PEP 8 automatically

2014-08-06 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.1 cf8e7fd5e - 4c19614e9 [SPARK-2627] [PySpark] have the build enforce PEP 8 automatically As described in [SPARK-2627](https://issues.apache.org/jira/browse/SPARK-2627), we'd like Python code to automatically be checked for PEP 8

git commit: SPARK-2566. Update ShuffleWriteMetrics incrementally

2014-08-06 Thread pwendell
Repository: spark Updated Branches: refs/heads/master d614967b0 - 4e9823644 SPARK-2566. Update ShuffleWriteMetrics incrementally I haven't tested this out on a cluster yet, but wanted to make sure the approach (passing ShuffleWriteMetrics down to DiskBlockObjectWriter) was ok Author: Sandy

git commit: SPARK-2566. Update ShuffleWriteMetrics incrementally

2014-08-06 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.1 4c19614e9 - a65c9ac11 SPARK-2566. Update ShuffleWriteMetrics incrementally I haven't tested this out on a cluster yet, but wanted to make sure the approach (passing ShuffleWriteMetrics down to DiskBlockObjectWriter) was ok Author:

git commit: [SPARK-2852][MLLIB] API consistency for `mllib.feature`

2014-08-06 Thread meng
Repository: spark Updated Branches: refs/heads/master 4e9823644 - 25cff1019 [SPARK-2852][MLLIB] API consistency for `mllib.feature` This is part of SPARK-2828: 1. added a Java-friendly fit method to Word2Vec with tests 2. change DeveloperApi to Experimental for Normalizer StandardScaler 3.

git commit: [SPARK-2852][MLLIB] API consistency for `mllib.feature`

2014-08-06 Thread meng
Repository: spark Updated Branches: refs/heads/branch-1.1 a65c9ac11 - e654cfdd0 [SPARK-2852][MLLIB] API consistency for `mllib.feature` This is part of SPARK-2828: 1. added a Java-friendly fit method to Word2Vec with tests 2. change DeveloperApi to Experimental for Normalizer StandardScaler

git commit: [PySpark] Add blanklines to Python docstrings so example code renders correctly

2014-08-06 Thread meng
Repository: spark Updated Branches: refs/heads/master 25cff1019 - e537b33c6 [PySpark] Add blanklines to Python docstrings so example code renders correctly Author: RJ Nowling rnowl...@gmail.com Closes #1808 from rnowling/pyspark_docs and squashes the following commits: c06d774 [RJ Nowling]

git commit: [HOTFIX][Streaming] Handle port collisions in flume polling test

2014-08-06 Thread tdas
Repository: spark Updated Branches: refs/heads/master e537b33c6 - c6889d2cb [HOTFIX][Streaming] Handle port collisions in flume polling test This is failing my tests in #1777. @tdas Author: Andrew Or andrewo...@gmail.com Closes #1803 from andrewor14/fix-flaky-streaming-test and squashes the

git commit: SPARK-2882: Spark build now checks local maven cache for dependencies

2014-08-06 Thread pwendell
Repository: spark Updated Branches: refs/heads/master c6889d2cb - 4e008334e SPARK-2882: Spark build now checks local maven cache for dependencies Fixes [SPARK-2882](https://issues.apache.org/jira/browse/SPARK-2882) Author: Gregory Owen greo...@gmail.com Closes #1818 from GregOwen/spark-2882

git commit: SPARK-2882: Spark build now checks local maven cache for dependencies

2014-08-06 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.1 a314e293f - c2ae0b036 SPARK-2882: Spark build now checks local maven cache for dependencies Fixes [SPARK-2882](https://issues.apache.org/jira/browse/SPARK-2882) Author: Gregory Owen greo...@gmail.com Closes #1818 from

git commit: SPARK-2879 [BUILD] Use HTTPS to access Maven Central and other repos

2014-08-06 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.1 3f92ce4e2 - 40284a9a3 SPARK-2879 [BUILD] Use HTTPS to access Maven Central and other repos Maven Central has just now enabled HTTPS access for everyone to Maven Central

git commit: HOTFIX: Support custom Java 7 location

2014-08-06 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.1 40284a9a3 - 53fa0486a HOTFIX: Support custom Java 7 location Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/53fa0486 Tree:

git commit: HOTFIX: Support custom Java 7 location

2014-08-06 Thread pwendell
Repository: spark Updated Branches: refs/heads/master 4201d2711 - a263a7e9f HOTFIX: Support custom Java 7 location Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/a263a7e9 Tree:

git commit: Updating versions for Spark 1.1.0

2014-08-06 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.1 53fa0486a - cf35b56d4 Updating versions for Spark 1.1.0 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/cf35b56d Tree:

git commit: [maven-release-plugin] prepare release v1.1.0-snapshot1

2014-08-06 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.1 cf35b56d4 - d428d8841 [maven-release-plugin] prepare release v1.1.0-snapshot1 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/d428d884 Tree:

git commit: [maven-release-plugin] prepare for next development iteration

2014-08-06 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.1 d428d8841 - c204a742a [maven-release-plugin] prepare for next development iteration Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/c204a742 Tree:

Git Push Summary

2014-08-06 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.1.0-snapshot1 [created] db4a0a5e8 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

git commit: [SPARK-2887] fix bug of countApproxDistinct() when have more than one partition

2014-08-06 Thread pwendell
Repository: spark Updated Branches: refs/heads/master a263a7e9f - ffd1f59a6 [SPARK-2887] fix bug of countApproxDistinct() when have more than one partition fix bug of countApproxDistinct() when have more than one partition Author: Davies Liu davies@gmail.com Closes #1812 from

git commit: [SPARK-2887] fix bug of countApproxDistinct() when have more than one partition

2014-08-06 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.1 c204a742a - cc8a7e97e [SPARK-2887] fix bug of countApproxDistinct() when have more than one partition fix bug of countApproxDistinct() when have more than one partition Author: Davies Liu davies@gmail.com Closes #1812 from