git commit: [SPARK-3040] pick up a more proper local ip address for Utils.findLocalIpAddress method

2014-09-15 Thread pwendell
Repository: spark Updated Branches: refs/heads/master ecf0c0293 -> febafefa5 [SPARK-3040] pick up a more proper local ip address for Utils.findLocalIpAddress method Short version: NetworkInterface.getNetworkInterfaces returns ifs in reverse order compared to ifconfig output. It may pick up i

git commit: [SPARK-3433][BUILD] Fix for Mima false-positives with @DeveloperAPI and @Experimental annotations.

2014-09-15 Thread rxin
Repository: spark Updated Branches: refs/heads/master d428ac6a2 -> ecf0c0293 [SPARK-3433][BUILD] Fix for Mima false-positives with @DeveloperAPI and @Experimental annotations. Actually false positive reported was due to mima generator not picking up the new jars in presence of old jars(theor

git commit: [SPARK-3540] Add reboot-slaves functionality to the ec2 script

2014-09-15 Thread rxin
Repository: spark Updated Branches: refs/heads/master 60050f428 -> d428ac6a2 [SPARK-3540] Add reboot-slaves functionality to the ec2 script Tested on a real cluster. Author: Reynold Xin Closes #2404 from rxin/ec2-reboot-slaves and squashes the following commits: 00a2dbd [Reynold Xin] Allow

git commit: [SPARK-1087] Move python traceback utilities into new traceback_utils.py file.

2014-09-15 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master da33acb8b -> 60050f428 [SPARK-1087] Move python traceback utilities into new traceback_utils.py file. Also made some cosmetic cleanups. Author: Aaron Staple Closes #2385 from staple/SPARK-1087 and squashes the following commits: 7b3bb13

git commit: [SPARK-2951] [PySpark] support unpickle array.array for Python 2.6

2014-09-15 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master fdb302f49 -> da33acb8b [SPARK-2951] [PySpark] support unpickle array.array for Python 2.6 Pyrolite can not unpickle array.array which pickled by Python 2.6, this patch fix it by extend Pyrolite. There is a bug in Pyrolite when unpickle ar

git commit: [SPARK-3516] [mllib] DecisionTree: Add minInstancesPerNode, minInfoGain params to example and Python API

2014-09-15 Thread meng
Repository: spark Updated Branches: refs/heads/master 983d6a9c4 -> fdb302f49 [SPARK-3516] [mllib] DecisionTree: Add minInstancesPerNode, minInfoGain params to example and Python API Added minInstancesPerNode, minInfoGain params to: * DecisionTreeRunner.scala example * Python API (tree.py) Al

git commit: [MLlib] Update SVD documentation in IndexedRowMatrix

2014-09-15 Thread meng
Repository: spark Updated Branches: refs/heads/master 3b9312813 -> 983d6a9c4 [MLlib] Update SVD documentation in IndexedRowMatrix Updating this to reflect the newest SVD via ARPACK Author: Reza Zadeh Closes #2389 from rezazadeh/irmdocs and squashes the following commits: 7fa1313 [Reza Zade

git commit: [SPARK-3396][MLLIB] Use SquaredL2Updater in LogisticRegressionWithSGD

2014-09-15 Thread meng
Repository: spark Updated Branches: refs/heads/master 37d925280 -> 3b9312813 [SPARK-3396][MLLIB] Use SquaredL2Updater in LogisticRegressionWithSGD SimpleUpdater ignores the regularizer, which leads to an unregularized LogReg. To enable the common L2 regularizer (and the corresponding regulariz

git commit: [SPARK-2714] DAGScheduler logs jobid when runJob finishes

2014-09-15 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master e59fac1f9 -> 37d925280 [SPARK-2714] DAGScheduler logs jobid when runJob finishes DAGScheduler logs jobid when runJob finishes Author: yantangzhai Closes #1617 from YanTangZhai/SPARK-2714 and squashes the following commits: 0a0243f [yant

git commit: [SPARK-3518] Remove wasted statement in JsonProtocol

2014-09-15 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.1 78887f94a -> 99a6c5e5e [SPARK-3518] Remove wasted statement in JsonProtocol Author: Kousuke Saruta Closes #2380 from sarutak/SPARK-3518 and squashes the following commits: 8a1464e [Kousuke Saruta] Replaced a variable with simple fiel

git commit: [SPARK-3518] Remove wasted statement in JsonProtocol

2014-09-15 Thread pwendell
Repository: spark Updated Branches: refs/heads/master fe2b1d6a2 -> e59fac1f9 [SPARK-3518] Remove wasted statement in JsonProtocol Author: Kousuke Saruta Closes #2380 from sarutak/SPARK-3518 and squashes the following commits: 8a1464e [Kousuke Saruta] Replaced a variable with simple field re

git commit: [SPARK-3425] do not set MaxPermSize for OpenJDK 1.8

2014-09-15 Thread pwendell
Repository: spark Updated Branches: refs/heads/master cc1464446 -> fe2b1d6a2 [SPARK-3425] do not set MaxPermSize for OpenJDK 1.8 Closes #2387 Author: Matthew Farrellee Closes #2301 from mattf/SPARK-3425 and squashes the following commits: 20f3c09 [Matthew Farrellee] [SPARK-3425] do not set

git commit: [SPARK-3410] The priority of shutdownhook for ApplicationMaster should not be integer literal

2014-09-15 Thread tgraves
Repository: spark Updated Branches: refs/heads/master f493f7982 -> cc1464446 [SPARK-3410] The priority of shutdownhook for ApplicationMaster should not be integer literal I think, it need to keep the priority of shutdown hook for ApplicationMaster than the priority of shutdown hook for o.a.h