spark git commit: [SPARK-10710] Remove ability to disable spilling in core and SQL

2015-09-19 Thread rxin
Repository: spark Updated Branches: refs/heads/master e789000b8 -> 2117eea71 [SPARK-10710] Remove ability to disable spilling in core and SQL It does not make much sense to set `spark.shuffle.spill` or `spark.sql.planner.externalSort` to false: I believe that these configurations were

spark git commit: [SPARK-10155] [SQL] Change SqlParser to object to avoid memory leak

2015-09-19 Thread yhuai
Repository: spark Updated Branches: refs/heads/branch-1.5 9b74fecb3 -> 259141976 [SPARK-10155] [SQL] Change SqlParser to object to avoid memory leak Since `scala.util.parsing.combinator.Parsers` is thread-safe since Scala 2.10 (See [SI-4929](https://issues.scala-lang.org/browse/SI-4929)), we

spark git commit: [SPARK-10155] [SQL] Change SqlParser to object to avoid memory leak

2015-09-19 Thread yhuai
Repository: spark Updated Branches: refs/heads/master d83b6aae8 -> e789000b8 [SPARK-10155] [SQL] Change SqlParser to object to avoid memory leak Since `scala.util.parsing.combinator.Parsers` is thread-safe since Scala 2.10 (See [SI-4929](https://issues.scala-lang.org/browse/SI-4929)), we can

spark git commit: [SPARK-10474] [SQL] Aggregation fails to allocate memory for pointer array

2015-09-19 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.5 b3f1e6533 -> 49355d0e0 [SPARK-10474] [SQL] Aggregation fails to allocate memory for pointer array When `TungstenAggregation` hits memory pressure, it switches from hash-based to sort-based aggregation in-place. However, in the process

spark git commit: [SPARK-10474] [SQL] Aggregation fails to allocate memory for pointer array

2015-09-19 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master 22be2ae14 -> 7ff8d68cc [SPARK-10474] [SQL] Aggregation fails to allocate memory for pointer array When `TungstenAggregation` hits memory pressure, it switches from hash-based to sort-based aggregation in-place. However, in the process we

spark git commit: [SPARK-10584] [SQL] [DOC] Documentation about the compatible Hive version is wrong.

2015-09-19 Thread lian
Repository: spark Updated Branches: refs/heads/master 7ff8d68cc -> d507f9c0b [SPARK-10584] [SQL] [DOC] Documentation about the compatible Hive version is wrong. In Spark 1.5.0, Spark SQL is compatible with Hive 0.12.0 through 1.2.1 but the documentation is wrong. /CC yhuai Author: Kousuke

spark git commit: [SPARK-10584] [SQL] [DOC] Documentation about the compatible Hive version is wrong.

2015-09-19 Thread lian
Repository: spark Updated Branches: refs/heads/branch-1.5 49355d0e0 -> aaae67df9 [SPARK-10584] [SQL] [DOC] Documentation about the compatible Hive version is wrong. In Spark 1.5.0, Spark SQL is compatible with Hive 0.12.0 through 1.2.1 but the documentation is wrong. /CC yhuai Author:

spark git commit: Fixed links to the API

2015-09-19 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.5 aaae67df9 -> 9b74fecb3 Fixed links to the API Submitting this change on the master branch as requested in https://github.com/apache/spark/pull/8819#issuecomment-141505941 Author: Alexis Seigneurin

spark git commit: Fixed links to the API

2015-09-19 Thread srowen
Repository: spark Updated Branches: refs/heads/master d507f9c0b -> d83b6aae8 Fixed links to the API Submitting this change on the master branch as requested in https://github.com/apache/spark/pull/8819#issuecomment-141505941 Author: Alexis Seigneurin Closes