git commit: [SPARK-3391][EC2] Support attaching up to 8 EBS volumes.

2014-09-05 Thread rxin
Repository: spark Updated Branches: refs/heads/master 1904bac38 - 1725a1a5d [SPARK-3391][EC2] Support attaching up to 8 EBS volumes. Please merge this at the same time as https://github.com/mesos/spark-ec2/pull/66 Author: Reynold Xin r...@apache.org Closes #2260 from rxin/ec2-ebs-vol and

git commit: [Docs] fix minor MLlib case typo

2014-09-05 Thread meng
Repository: spark Updated Branches: refs/heads/master 1725a1a5d - 6a37ed838 [Docs] fix minor MLlib case typo Also make the list of features consistent in style. Author: Nicholas Chammas nicholas.cham...@gmail.com Closes #2278 from nchammas/patch-1 and squashes the following commits:

git commit: [Docs] fix minor MLlib case typo

2014-09-05 Thread meng
Repository: spark Updated Branches: refs/heads/branch-1.1 dbf812022 - 6b128be03 [Docs] fix minor MLlib case typo Also make the list of features consistent in style. Author: Nicholas Chammas nicholas.cham...@gmail.com Closes #2278 from nchammas/patch-1 and squashes the following commits:

git commit: [SPARK-3260] yarn - pass acls along with executor launch

2014-09-05 Thread tgraves
Repository: spark Updated Branches: refs/heads/master 6a37ed838 - 51b53a758 [SPARK-3260] yarn - pass acls along with executor launch Pass along the acl settings when we launch a container so that they can be applied to viewing the logs on a running NodeManager. Author: Thomas Graves

git commit: [SPARK-3375] spark on yarn container allocation issues

2014-09-05 Thread tgraves
Repository: spark Updated Branches: refs/heads/master 51b53a758 - 62c557609 [SPARK-3375] spark on yarn container allocation issues If yarn doesn't get the containers immediately it stops asking for them and the yarn application hangs with never getting any executors. The issue here is that

git commit: [SPARK-3399][PySpark] Test for PySpark should ignore HADOOP_CONF_DIR and YARN_CONF_DIR

2014-09-05 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master 62c557609 - 7ff8c45d7 [SPARK-3399][PySpark] Test for PySpark should ignore HADOOP_CONF_DIR and YARN_CONF_DIR Author: Kousuke Saruta saru...@oss.nttdata.co.jp Closes #2270 from sarutak/SPARK-3399 and squashes the following commits:

git commit: SPARK-3211 .take() is OOM-prone with empty partitions

2014-09-05 Thread matei
Repository: spark Updated Branches: refs/heads/master 7ff8c45d7 - ba5bcadde SPARK-3211 .take() is OOM-prone with empty partitions Instead of jumping straight from 1 partition to all partitions, do exponential growth and double the number of partitions to attempt each time instead. Fix

git commit: [Build] suppress curl/wget progress bars

2014-09-05 Thread adav
Repository: spark Updated Branches: refs/heads/master ba5bcadde - 19f61c165 [Build] suppress curl/wget progress bars In the Jenkins console output, `curl` gives us mountains of `#` symbols as it tries to show its download progress. ![noise from curl in Jenkins