spark git commit: [SPARK-12585] [SQL] move numFields to constructor of UnsafeRow

2015-12-30 Thread davies
Repository: spark Updated Branches: refs/heads/master 93b52abca -> e6c77874b [SPARK-12585] [SQL] move numFields to constructor of UnsafeRow Right now, numFields will be passed in by pointTo(), then bitSetWidthInBytes is calculated, making pointTo() a little bit heavy. It should be part of co

spark git commit: House cleaning: close old pull requests.

2015-12-30 Thread rxin
Repository: spark Updated Branches: refs/heads/master c642c3a21 -> 93b52abca House cleaning: close old pull requests. Closes #5400 Closes #5408 Closes #5423 Closes #5668 Closes #6757 Closes #6745 Closes #6613 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-u

spark git commit: Closes #10386 since it was superseded by #10468.

2015-12-30 Thread rxin
Repository: spark Updated Branches: refs/heads/master 7b4452ba9 -> c642c3a21 Closes #10386 since it was superseded by #10468. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/c642c3a2 Tree: http://git-wip-us.apache.org/repo

spark git commit: House cleaning: close open pull requests created before June 1st, 2015

2015-12-30 Thread rxin
Repository: spark Updated Branches: refs/heads/master be33a0cd3 -> 7b4452ba9 House cleaning: close open pull requests created before June 1st, 2015 Closes #5358 Closes #3744 Closes #3677 Closes #3536 Closes #3249 Closes #3221 Closes #2446 Closes #3794 Closes #3815 Closes #3816 Closes #3866 Clo

spark git commit: [SPARK-12561] Remove JobLogger in Spark 2.0.

2015-12-30 Thread rxin
Repository: spark Updated Branches: refs/heads/master 9140d9074 -> be33a0cd3 [SPARK-12561] Remove JobLogger in Spark 2.0. It was research code and has been deprecated since 1.0.0. No one really uses it since they can just use event logging. Author: Reynold Xin Closes #10530 from rxin/SPARK

spark git commit: [SPARK-3873][GRAPHX] Import order fixes.

2015-12-30 Thread rxin
Repository: spark Updated Branches: refs/heads/master fd313 -> 9140d9074 [SPARK-3873][GRAPHX] Import order fixes. There's one warning left, caused by a bug in the checker. Author: Marcelo Vanzin Closes #10537 from vanzin/SPARK-3873-graphx. Project: http://git-wip-us.apache.org/repos/a

spark git commit: [SPARK-3873][YARN] Fix import ordering.

2015-12-30 Thread rxin
Repository: spark Updated Branches: refs/heads/master ee8f8d318 -> fd313 [SPARK-3873][YARN] Fix import ordering. Author: Marcelo Vanzin Closes #10536 from vanzin/SPARK-3873-yarn. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/s

spark git commit: [SPARK-12588] Remove HttpBroadcast in Spark 2.0.

2015-12-30 Thread rxin
Repository: spark Updated Branches: refs/heads/master f76ee109d -> ee8f8d318 [SPARK-12588] Remove HttpBroadcast in Spark 2.0. We switched to TorrentBroadcast in Spark 1.1, and HttpBroadcast has been undocumented since then. It's time to remove it in Spark 2.0. Author: Reynold Xin Closes #1

spark git commit: [SPARK-8641][SPARK-12455][SQL] Native Spark Window functions - Follow-up (docs & tests)

2015-12-30 Thread yhuai
Repository: spark Updated Branches: refs/heads/master b24429796 -> f76ee109d [SPARK-8641][SPARK-12455][SQL] Native Spark Window functions - Follow-up (docs & tests) This PR is a follow-up for PR https://github.com/apache/spark/pull/9819. It adds documentation for the window functions and a c

spark git commit: [SPARK-12399] Display correct error message when accessing REST API with an unknown app Id

2015-12-30 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 5c2682b0c -> b24429796 [SPARK-12399] Display correct error message when accessing REST API with an unknown app Id I got an exception when accessing the below REST API with an unknown application Id. `http://:18080/api/v1/applications/xxx/

spark git commit: [SPARK-12399] Display correct error message when accessing REST API with an unknown app Id

2015-12-30 Thread vanzin
Repository: spark Updated Branches: refs/heads/branch-1.6 8dc654971 -> cd86075b5 [SPARK-12399] Display correct error message when accessing REST API with an unknown app Id I got an exception when accessing the below REST API with an unknown application Id. `http://:18080/api/v1/applications/

spark git commit: [SPARK-12409][SPARK-12387][SPARK-12391][SQL] Support AND/OR/IN/LIKE push-down filters for JDBC

2015-12-30 Thread rxin
Repository: spark Updated Branches: refs/heads/master 27a42c710 -> 5c2682b0c [SPARK-12409][SPARK-12387][SPARK-12391][SQL] Support AND/OR/IN/LIKE push-down filters for JDBC This is rework from #10386 and add more tests and LIKE push-down support. Author: Takeshi YAMAMURO Closes #10468 from

spark git commit: [SPARK-10359] Enumerate dependencies in a file and diff against it for new pull requests

2015-12-30 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master d1ca634db -> 27a42c710 [SPARK-10359] Enumerate dependencies in a file and diff against it for new pull requests This patch adds a new build check which enumerates Spark's resolved runtime classpath and saves it to a file, then diffs again

spark git commit: [SPARK-12300] [SQL] [PYSPARK] fix schema inferance on local collections

2015-12-30 Thread davies
Repository: spark Updated Branches: refs/heads/branch-1.6 c069ffc2b -> 8dc654971 [SPARK-12300] [SQL] [PYSPARK] fix schema inferance on local collections Current schema inference for local python collections halts as soon as there are no NullTypes. This is different than when we specify a samp

spark git commit: [SPARK-12300] [SQL] [PYSPARK] fix schema inferance on local collections

2015-12-30 Thread davies
Repository: spark Updated Branches: refs/heads/master aa48164a4 -> d1ca634db [SPARK-12300] [SQL] [PYSPARK] fix schema inferance on local collections Current schema inference for local python collections halts as soon as there are no NullTypes. This is different than when we specify a sampling

spark git commit: [SPARK-12495][SQL] use true as default value for propagateNull in NewInstance

2015-12-30 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 932cf4424 -> aa48164a4 [SPARK-12495][SQL] use true as default value for propagateNull in NewInstance Most of cases we should propagate null when call `NewInstance`, and so far there is only one case we should stop null propagation: create

spark git commit: [SPARK-12263][DOCS] IllegalStateException: Memory can't be 0 for SPARK_WORKER_MEMORY without unit

2015-12-30 Thread srowen
Repository: spark Updated Branches: refs/heads/master 27af6157f -> 932cf4424 [SPARK-12263][DOCS] IllegalStateException: Memory can't be 0 for SPARK_WORKER_MEMORY without unit Updated the Worker Unit IllegalStateException message to indicate no values less than 1MB instead of 0 to help solve

[1/3] spark git commit: Revert "[SPARK-12362][SQL][WIP] Inline Hive Parser"

2015-12-30 Thread rxin
Repository: spark Updated Branches: refs/heads/master 4f75f785d -> 27af6157f http://git-wip-us.apache.org/repos/asf/spark/blob/27af6157/sql/hive/src/main/java/org/apache/spark/sql/parser/ParseDriver.java -- diff --git a/sql/hi

[2/3] spark git commit: Revert "[SPARK-12362][SQL][WIP] Inline Hive Parser"

2015-12-30 Thread rxin
http://git-wip-us.apache.org/repos/asf/spark/blob/27af6157/sql/hive/src/main/antlr3/org/apache/spark/sql/parser/SparkSqlParser.g -- diff --git a/sql/hive/src/main/antlr3/org/apache/spark/sql/parser/SparkSqlParser.g b/sql/hive/src

[3/3] spark git commit: Revert "[SPARK-12362][SQL][WIP] Inline Hive Parser"

2015-12-30 Thread rxin
Revert "[SPARK-12362][SQL][WIP] Inline Hive Parser" This reverts commit b600bccf41a7b1958e33d8301a19214e6517e388 due to non-deterministic build breaks. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/27af6157 Tree: http://gi