spark git commit: [SPARK-16644][SQL] Aggregate should not propagate constraints containing aggregate expressions

2016-07-20 Thread yhuai
Repository: spark Updated Branches: refs/heads/branch-2.0 81004f13f -> a804c9260 [SPARK-16644][SQL] Aggregate should not propagate constraints containing aggregate expressions aggregate expressions can only be executed inside `Aggregate`, if we propagate it up with constraints, the parent op

spark git commit: [SPARK-16644][SQL] Aggregate should not propagate constraints containing aggregate expressions

2016-07-20 Thread yhuai
Repository: spark Updated Branches: refs/heads/master 75a06aa25 -> cfa5ae84e [SPARK-16644][SQL] Aggregate should not propagate constraints containing aggregate expressions ## What changes were proposed in this pull request? aggregate expressions can only be executed inside `Aggregate`, if we

spark git commit: [SPARK-16272][CORE] Allow config values to reference conf, env, system props.

2016-07-20 Thread vanzin
Repository: spark Updated Branches: refs/heads/master e651900bd -> 75a06aa25 [SPARK-16272][CORE] Allow config values to reference conf, env, system props. This allows configuration to be more flexible, for example, when the cluster does not have a homogeneous configuration (e.g. packages are

spark git commit: [SPARK-16344][SQL] Decoding Parquet array of struct with a single field named "element"

2016-07-20 Thread yhuai
Repository: spark Updated Branches: refs/heads/master e3cd5b305 -> e651900bd [SPARK-16344][SQL] Decoding Parquet array of struct with a single field named "element" ## What changes were proposed in this pull request? Due to backward-compatibility reasons, the following Parquet schema is amb

spark git commit: [SPARK-16634][SQL] Workaround JVM bug by moving some code out of ctor.

2016-07-20 Thread vanzin
Repository: spark Updated Branches: refs/heads/branch-2.0 b177e082f -> 81004f13f [SPARK-16634][SQL] Workaround JVM bug by moving some code out of ctor. Some 1.7 JVMs have a bug that is triggered by certain Scala-generated bytecode. GenericArrayData suffers from that and fails to load in certai

spark git commit: [SPARK-16634][SQL] Workaround JVM bug by moving some code out of ctor.

2016-07-20 Thread vanzin
Repository: spark Updated Branches: refs/heads/master b9bab4dcf -> e3cd5b305 [SPARK-16634][SQL] Workaround JVM bug by moving some code out of ctor. Some 1.7 JVMs have a bug that is triggered by certain Scala-generated bytecode. GenericArrayData suffers from that and fails to load in certain JV

spark git commit: [SPARK-15951] Change Executors Page to use datatables to support sorting columns and searching

2016-07-20 Thread tgraves
Repository: spark Updated Branches: refs/heads/master 4b079dc39 -> b9bab4dcf [SPARK-15951] Change Executors Page to use datatables to support sorting columns and searching 1. Create the executorspage-template.html for displaying application information in datables. 2. Added REST API endpoint

spark git commit: [SPARK-16613][CORE] RDD.pipe returns values for empty partitions

2016-07-20 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 83b957e6a -> b177e082f [SPARK-16613][CORE] RDD.pipe returns values for empty partitions ## What changes were proposed in this pull request? Document RDD.pipe semantics; don't execute process for empty input partitions. Note this inclu

spark git commit: [SPARK-16613][CORE] RDD.pipe returns values for empty partitions

2016-07-20 Thread rxin
Repository: spark Updated Branches: refs/heads/master 95abbe537 -> 4b079dc39 [SPARK-16613][CORE] RDD.pipe returns values for empty partitions ## What changes were proposed in this pull request? Document RDD.pipe semantics; don't execute process for empty input partitions. Note this includes

spark git commit: [SPARK-15923][YARN] Spark Application rest api returns 'no such app: …

2016-07-20 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.0 3f6b272db -> 83b957e6a [SPARK-15923][YARN] Spark Application rest api returns 'no such app: … ## What changes were proposed in this pull request? Update monitoring.md. …' Author: Weiqing Yang Closes #14163 from Sherry302/master.

spark git commit: [SPARK-15923][YARN] Spark Application rest api returns 'no such app: …

2016-07-20 Thread srowen
Repository: spark Updated Branches: refs/heads/master 0dc79ffd1 -> 95abbe537 [SPARK-15923][YARN] Spark Application rest api returns 'no such app: … ## What changes were proposed in this pull request? Update monitoring.md. …' Author: Weiqing Yang Closes #14163 from Sherry302/master. P

spark git commit: [SPARK-16440][MLLIB] Destroy broadcasted variables even on driver

2016-07-20 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.0 c2b5b3ca5 -> 3f6b272db [SPARK-16440][MLLIB] Destroy broadcasted variables even on driver ## What changes were proposed in this pull request? Forgotten broadcasted variables were persisted into a previous #PR 14153). This PR turns those

spark git commit: [SPARK-16440][MLLIB] Destroy broadcasted variables even on driver

2016-07-20 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.6 6ea7d4bd3 -> f6e0c1737 [SPARK-16440][MLLIB] Destroy broadcasted variables even on driver ## What changes were proposed in this pull request? Forgotten broadcasted variables were persisted into a previous #PR 14153). This PR turns those

spark git commit: [SPARK-16440][MLLIB] Destroy broadcasted variables even on driver

2016-07-20 Thread srowen
Repository: spark Updated Branches: refs/heads/master 75146be6b -> 0dc79ffd1 [SPARK-16440][MLLIB] Destroy broadcasted variables even on driver ## What changes were proposed in this pull request? Forgotten broadcasted variables were persisted into a previous #PR 14153). This PR turns those `un