git commit: stop, start and destroy require the EC2_REGION

2014-09-27 Thread rxin
Repository: spark Updated Branches: refs/heads/master d8a9d1d44 - 9e8ced784 stop, start and destroy require the EC2_REGION i.e ./spark-ec2 --region=us-west-1 stop yourclustername Author: Jeff Steinmetz jeffrey.steinm...@gmail.com Closes #2473 from jeffsteinmetz/master and squashes the

git commit: [SPARK-1021] Defer the data-driven computation of partition bounds in so...

2014-09-27 Thread rxin
Repository: spark Updated Branches: refs/heads/master 9e8ced784 - 2d972fd84 [SPARK-1021] Defer the data-driven computation of partition bounds in so... ...rtByKey() until evaluation. Author: Erik Erlandson eerla...@redhat.com Closes #1689 from erikerlandson/spark-1021-pr and squashes the

git commit: Docs : use --total-executor-cores rather than --cores after spark-shell

2014-09-27 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.1 d6ed5abf1 - d9d94e0b0 Docs : use --total-executor-cores rather than --cores after spark-shell Author: CrazyJvm crazy...@gmail.com Closes #2540 from CrazyJvm/standalone-core and squashes the following commits: 66d9fc6 [CrazyJvm] use

git commit: [SPARK-3676][SQL] Fix hive test suite failure due to diffs in JDK 1.6/1.7

2014-09-27 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 66107f46f - 080088105 [SPARK-3676][SQL] Fix hive test suite failure due to diffs in JDK 1.6/1.7 This is a bug in JDK6: http://bugs.java.com/bugdatabase/view_bug.do?bug_id=4428022 this is because jdk get different result to operate

git commit: [SPARK-3680][SQL] Fix bug caused by eager typing of HiveGenericUDFs

2014-09-27 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 080088105 - f0c7e1955 [SPARK-3680][SQL] Fix bug caused by eager typing of HiveGenericUDFs Typing of UDFs should be lazy as it is often not valid to call `dataType` on an expression until after all of its children are `resolved`. Author:

git commit: [SPARK-3389] Add Converter for ease of Parquet reading in PySpark

2014-09-27 Thread matei
Repository: spark Updated Branches: refs/heads/master 5b922bb45 - 248232936 [SPARK-3389] Add Converter for ease of Parquet reading in PySpark https://issues.apache.org/jira/browse/SPARK-3389 Author: Uri Laserson laser...@cloudera.com Closes #2256 from laserson/SPARK-3389 and squashes the

git commit: Minor fix for the previous commit.

2014-09-27 Thread rxin
Repository: spark Updated Branches: refs/heads/master 9966d1a8a - 66e1c40c6 Minor fix for the previous commit. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/66e1c40c Tree: