git commit: [SPARK-2157] Enable tight firewall rules for Spark

2014-08-06 Thread pwendell
Repository: spark Updated Branches: refs/heads/master ee7f30856 -> 09f7e4587 [SPARK-2157] Enable tight firewall rules for Spark The goal of this PR is to allow users of Spark to write tight firewall rules for their clusters. This is currently not possible because Spark uses random ports in m

git commit: [SPARK-2157] Enable tight firewall rules for Spark

2014-08-06 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.1 5b4bc84ed -> 31090e43c [SPARK-2157] Enable tight firewall rules for Spark The goal of this PR is to allow users of Spark to write tight firewall rules for their clusters. This is currently not possible because Spark uses random ports

git commit: [SPARK-2875] [PySpark] [SQL] handle null in schemaRDD()

2014-08-06 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 09f7e4587 -> 48789117c [SPARK-2875] [PySpark] [SQL] handle null in schemaRDD() Handle null in schemaRDD during converting them into Python. Author: Davies Liu Closes #1802 from davies/json and squashes the following commits: 88e6b1f [Da

git commit: [SPARK-2875] [PySpark] [SQL] handle null in schemaRDD()

2014-08-06 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.1 31090e43c -> 27a8d4ce3 [SPARK-2875] [PySpark] [SQL] handle null in schemaRDD() Handle null in schemaRDD during converting them into Python. Author: Davies Liu Closes #1802 from davies/json and squashes the following commits: 88e6b1f

git commit: [SPARK-2678][Core][SQL] A workaround for SPARK-2678

2014-08-06 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.1 27a8d4ce3 -> cf8e7fd5e [SPARK-2678][Core][SQL] A workaround for SPARK-2678 JIRA issues: - Main: [SPARK-2678](https://issues.apache.org/jira/browse/SPARK-2678) - Related: [SPARK-2874](https://issues.apache.org/jira/browse/SPARK-2874) R

git commit: [SPARK-2678][Core][SQL] A workaround for SPARK-2678

2014-08-06 Thread pwendell
Repository: spark Updated Branches: refs/heads/master 48789117c -> a6cd31108 [SPARK-2678][Core][SQL] A workaround for SPARK-2678 JIRA issues: - Main: [SPARK-2678](https://issues.apache.org/jira/browse/SPARK-2678) - Related: [SPARK-2874](https://issues.apache.org/jira/browse/SPARK-2874) Relat

git commit: [SPARK-2627] [PySpark] have the build enforce PEP 8 automatically

2014-08-06 Thread rxin
Repository: spark Updated Branches: refs/heads/master a6cd31108 -> d614967b0 [SPARK-2627] [PySpark] have the build enforce PEP 8 automatically As described in [SPARK-2627](https://issues.apache.org/jira/browse/SPARK-2627), we'd like Python code to automatically be checked for PEP 8 compliance

git commit: [SPARK-2627] [PySpark] have the build enforce PEP 8 automatically

2014-08-06 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.1 cf8e7fd5e -> 4c19614e9 [SPARK-2627] [PySpark] have the build enforce PEP 8 automatically As described in [SPARK-2627](https://issues.apache.org/jira/browse/SPARK-2627), we'd like Python code to automatically be checked for PEP 8 compli

git commit: SPARK-2566. Update ShuffleWriteMetrics incrementally

2014-08-06 Thread pwendell
Repository: spark Updated Branches: refs/heads/master d614967b0 -> 4e9823644 SPARK-2566. Update ShuffleWriteMetrics incrementally I haven't tested this out on a cluster yet, but wanted to make sure the approach (passing ShuffleWriteMetrics down to DiskBlockObjectWriter) was ok Author: Sandy

git commit: SPARK-2566. Update ShuffleWriteMetrics incrementally

2014-08-06 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.1 4c19614e9 -> a65c9ac11 SPARK-2566. Update ShuffleWriteMetrics incrementally I haven't tested this out on a cluster yet, but wanted to make sure the approach (passing ShuffleWriteMetrics down to DiskBlockObjectWriter) was ok Author: Sa

git commit: [SPARK-2852][MLLIB] API consistency for `mllib.feature`

2014-08-06 Thread meng
Repository: spark Updated Branches: refs/heads/master 4e9823644 -> 25cff1019 [SPARK-2852][MLLIB] API consistency for `mllib.feature` This is part of SPARK-2828: 1. added a Java-friendly fit method to Word2Vec with tests 2. change DeveloperApi to Experimental for Normalizer & StandardScaler 3.

git commit: [SPARK-2852][MLLIB] API consistency for `mllib.feature`

2014-08-06 Thread meng
Repository: spark Updated Branches: refs/heads/branch-1.1 a65c9ac11 -> e654cfdd0 [SPARK-2852][MLLIB] API consistency for `mllib.feature` This is part of SPARK-2828: 1. added a Java-friendly fit method to Word2Vec with tests 2. change DeveloperApi to Experimental for Normalizer & StandardScale

git commit: [PySpark] Add blanklines to Python docstrings so example code renders correctly

2014-08-06 Thread meng
Repository: spark Updated Branches: refs/heads/master 25cff1019 -> e537b33c6 [PySpark] Add blanklines to Python docstrings so example code renders correctly Author: RJ Nowling Closes #1808 from rnowling/pyspark_docs and squashes the following commits: c06d774 [RJ Nowling] Add blanklines to

git commit: [PySpark] Add blanklines to Python docstrings so example code renders correctly

2014-08-06 Thread meng
Repository: spark Updated Branches: refs/heads/branch-1.1 e654cfdd0 -> a314e293f [PySpark] Add blanklines to Python docstrings so example code renders correctly Author: RJ Nowling Closes #1808 from rnowling/pyspark_docs and squashes the following commits: c06d774 [RJ Nowling] Add blanklines

git commit: [HOTFIX][Streaming] Handle port collisions in flume polling test

2014-08-06 Thread tdas
Repository: spark Updated Branches: refs/heads/master e537b33c6 -> c6889d2cb [HOTFIX][Streaming] Handle port collisions in flume polling test This is failing my tests in #1777. @tdas Author: Andrew Or Closes #1803 from andrewor14/fix-flaky-streaming-test and squashes the following commits:

git commit: SPARK-2882: Spark build now checks local maven cache for dependencies

2014-08-06 Thread pwendell
Repository: spark Updated Branches: refs/heads/master c6889d2cb -> 4e008334e SPARK-2882: Spark build now checks local maven cache for dependencies Fixes [SPARK-2882](https://issues.apache.org/jira/browse/SPARK-2882) Author: Gregory Owen Closes #1818 from GregOwen/spark-2882 and squashes the

git commit: SPARK-2882: Spark build now checks local maven cache for dependencies

2014-08-06 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.1 a314e293f -> c2ae0b036 SPARK-2882: Spark build now checks local maven cache for dependencies Fixes [SPARK-2882](https://issues.apache.org/jira/browse/SPARK-2882) Author: Gregory Owen Closes #1818 from GregOwen/spark-2882 and squashes

git commit: [SPARK-2583] ConnectionManager error reporting

2014-08-06 Thread pwendell
Repository: spark Updated Branches: refs/heads/master 4e008334e -> 17caae48b [SPARK-2583] ConnectionManager error reporting This patch modifies the ConnectionManager so that error messages are sent in reply when uncaught exceptions occur during message processing. This prevents message send

git commit: [SPARK-2583] ConnectionManager error reporting

2014-08-06 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.1 c2ae0b036 -> 3f92ce4e2 [SPARK-2583] ConnectionManager error reporting This patch modifies the ConnectionManager so that error messages are sent in reply when uncaught exceptions occur during message processing. This prevents message

git commit: SPARK-2879 [BUILD] Use HTTPS to access Maven Central and other repos

2014-08-06 Thread pwendell
Repository: spark Updated Branches: refs/heads/master 17caae48b -> 4201d2711 SPARK-2879 [BUILD] Use HTTPS to access Maven Central and other repos Maven Central has just now enabled HTTPS access for everyone to Maven Central (http://central.sonatype.org/articles/2014/Aug/03/https-support-launc

git commit: SPARK-2879 [BUILD] Use HTTPS to access Maven Central and other repos

2014-08-06 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.1 3f92ce4e2 -> 40284a9a3 SPARK-2879 [BUILD] Use HTTPS to access Maven Central and other repos Maven Central has just now enabled HTTPS access for everyone to Maven Central (http://central.sonatype.org/articles/2014/Aug/03/https-support-l

git commit: HOTFIX: Support custom Java 7 location

2014-08-06 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.1 40284a9a3 -> 53fa0486a HOTFIX: Support custom Java 7 location Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/53fa0486 Tree: http://git-wip-us.apache.org/repos/asf/

git commit: HOTFIX: Support custom Java 7 location

2014-08-06 Thread pwendell
Repository: spark Updated Branches: refs/heads/master 4201d2711 -> a263a7e9f HOTFIX: Support custom Java 7 location Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/a263a7e9 Tree: http://git-wip-us.apache.org/repos/asf/spar

git commit: Updating versions for Spark 1.1.0

2014-08-06 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.1 53fa0486a -> cf35b56d4 Updating versions for Spark 1.1.0 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/cf35b56d Tree: http://git-wip-us.apache.org/repos/asf/spark

git commit: [maven-release-plugin] prepare release v1.1.0-snapshot1

2014-08-06 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.1 cf35b56d4 -> d428d8841 [maven-release-plugin] prepare release v1.1.0-snapshot1 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/d428d884 Tree: http://git-wip-us.apac

git commit: [maven-release-plugin] prepare for next development iteration

2014-08-06 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.1 d428d8841 -> c204a742a [maven-release-plugin] prepare for next development iteration Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/c204a742 Tree: http://git-wip-u

Git Push Summary

2014-08-06 Thread pwendell
Repository: spark Updated Tags: refs/tags/v1.1.0-snapshot1 [created] db4a0a5e8 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

git commit: [SPARK-2887] fix bug of countApproxDistinct() when have more than one partition

2014-08-06 Thread pwendell
Repository: spark Updated Branches: refs/heads/master a263a7e9f -> ffd1f59a6 [SPARK-2887] fix bug of countApproxDistinct() when have more than one partition fix bug of countApproxDistinct() when have more than one partition Author: Davies Liu Closes #1812 from davies/approx and squashes the

git commit: [SPARK-2887] fix bug of countApproxDistinct() when have more than one partition

2014-08-06 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.1 c204a742a -> cc8a7e97e [SPARK-2887] fix bug of countApproxDistinct() when have more than one partition fix bug of countApproxDistinct() when have more than one partition Author: Davies Liu Closes #1812 from davies/approx and squashes

git commit: [SPARK-2851] [mllib] DecisionTree Python consistency update

2014-08-06 Thread meng
Repository: spark Updated Branches: refs/heads/master ffd1f59a6 -> 47ccd5e71 [SPARK-2851] [mllib] DecisionTree Python consistency update Added 6 static train methods to match Python API, but without default arguments (but with Python default args noted in docs). Added factory classes for Alg

git commit: [SPARK-2851] [mllib] DecisionTree Python consistency update

2014-08-06 Thread meng
Repository: spark Updated Branches: refs/heads/branch-1.1 cc8a7e97e -> c9f094458 [SPARK-2851] [mllib] DecisionTree Python consistency update Added 6 static train methods to match Python API, but without default arguments (but with Python default args noted in docs). Added factory classes for