spark git commit: [SPARK-8114][SQL] Remove some wildcard import on TestSQLContext._ round 3.

2015-06-05 Thread rxin
Repository: spark Updated Branches: refs/heads/master eb19d3f75 -> a71be0a36 [SPARK-8114][SQL] Remove some wildcard import on TestSQLContext._ round 3. Author: Reynold Xin Closes #6677 from rxin/test-wildcard and squashes the following commits: 8a17b33 [Reynold Xin] Fixed line length. 66638

spark git commit: [SPARK-6964] [SQL] Support Cancellation in the Thrift Server

2015-06-05 Thread yhuai
Repository: spark Updated Branches: refs/heads/master 6ebe419f3 -> eb19d3f75 [SPARK-6964] [SQL] Support Cancellation in the Thrift Server Support runInBackground in SparkExecuteStatementOperation, and add cancellation Author: Dong Wang Closes #6207 from dongwang218/SPARK-6964-jdbc-cancel an

spark git commit: [SPARK-8114][SQL] Remove some wildcard import on TestSQLContext._ cont'd.

2015-06-05 Thread rxin
Repository: spark Updated Branches: refs/heads/master 356a4a9b9 -> 6ebe419f3 [SPARK-8114][SQL] Remove some wildcard import on TestSQLContext._ cont'd. Fixed the following packages: sql.columnar sql.jdbc sql.json sql.parquet Author: Reynold Xin Closes #6667 from rxin/testsqlcontext_wildcard

spark git commit: [SPARK-7991] [PySpark] Adding support for passing lists to describe.

2015-06-05 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.4 94f65bcce -> 84523fc38 [SPARK-7991] [PySpark] Adding support for passing lists to describe. This is a minor change. Author: amey Closes #6655 from ameyc/JIRA-7991/support-passing-list-to-describe and squashes the following commits:

spark git commit: [SPARK-7991] [PySpark] Adding support for passing lists to describe.

2015-06-05 Thread rxin
Repository: spark Updated Branches: refs/heads/master 4060526cd -> 356a4a9b9 [SPARK-7991] [PySpark] Adding support for passing lists to describe. This is a minor change. Author: amey Closes #6655 from ameyc/JIRA-7991/support-passing-list-to-describe and squashes the following commits: e8a

spark git commit: [SPARK-7747] [SQL] [DOCS] spark.sql.planner.externalSort

2015-06-05 Thread yhuai
Repository: spark Updated Branches: refs/heads/branch-1.4 200c980a1 -> 94f65bcce [SPARK-7747] [SQL] [DOCS] spark.sql.planner.externalSort Add documentation for spark.sql.planner.externalSort Author: Luca Martinetti Closes #6272 from lucamartinetti/docs-externalsort and squashes the followi

spark git commit: [SPARK-7747] [SQL] [DOCS] spark.sql.planner.externalSort

2015-06-05 Thread yhuai
Repository: spark Updated Branches: refs/heads/master 4f16d3fe2 -> 4060526cd [SPARK-7747] [SQL] [DOCS] spark.sql.planner.externalSort Add documentation for spark.sql.planner.externalSort Author: Luca Martinetti Closes #6272 from lucamartinetti/docs-externalsort and squashes the following

spark git commit: [SPARK-8112] [STREAMING] Fix the negative event count issue

2015-06-05 Thread tdas
Repository: spark Updated Branches: refs/heads/branch-1.4 429c65851 -> 200c980a1 [SPARK-8112] [STREAMING] Fix the negative event count issue Author: zsxwing Closes #6659 from zsxwing/SPARK-8112 and squashes the following commits: a5d7da6 [zsxwing] Address comments d255b6e [zsxwing] Fix the

spark git commit: [SPARK-8112] [STREAMING] Fix the negative event count issue

2015-06-05 Thread tdas
Repository: spark Updated Branches: refs/heads/master 3f80bc841 -> 4f16d3fe2 [SPARK-8112] [STREAMING] Fix the negative event count issue Author: zsxwing Closes #6659 from zsxwing/SPARK-8112 and squashes the following commits: a5d7da6 [zsxwing] Address comments d255b6e [zsxwing] Fix the nega

spark git commit: [SPARK-7699] [CORE] Lazy start the scheduler for dynamic allocation

2015-06-05 Thread sandy
Repository: spark Updated Branches: refs/heads/master 0992a0a77 -> 3f80bc841 [SPARK-7699] [CORE] Lazy start the scheduler for dynamic allocation This patch propose to lazy start the scheduler for dynamic allocation to avoid fast ramp down executor numbers is load is less. This implementation

spark git commit: [SPARK-8099] set executor cores into system in yarn-cluster mode

2015-06-05 Thread sandy
Repository: spark Updated Branches: refs/heads/master 4036d05ce -> 0992a0a77 [SPARK-8099] set executor cores into system in yarn-cluster mode Author: Xutingjun Author: xutingjun Closes #6643 from XuTingjun/SPARK-8099 and squashes the following commits: 80b18cd [Xutingjun] change to STANDAL

spark git commit: Revert "[MINOR] [BUILD] Use custom temp directory during build."

2015-06-05 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-1.4 3e3151e75 -> 429c65851 Revert "[MINOR] [BUILD] Use custom temp directory during build." This reverts commit 9b3e4c187123baa22666b8e119ddd55dafecbf89. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us

spark git commit: Revert "[MINOR] [BUILD] Use custom temp directory during build."

2015-06-05 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master 12f5eaeee -> 4036d05ce Revert "[MINOR] [BUILD] Use custom temp directory during build." This reverts commit b16b5434ff44c42e4b3a337f9af147669ba44896. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apa

spark git commit: [SPARK-8085] [SPARKR] Support user-specified schema in read.df

2015-06-05 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-1.4 0ef2e9d35 -> 3e3151e75 [SPARK-8085] [SPARKR] Support user-specified schema in read.df cc davies sun-rui Author: Shivaram Venkataraman Closes #6620 from shivaram/sparkr-read-schema and squashes the following commits: 16a6726 [Shivar

spark git commit: [SPARK-8085] [SPARKR] Support user-specified schema in read.df

2015-06-05 Thread shivaram
Repository: spark Updated Branches: refs/heads/master bc0d76a24 -> 12f5eaeee [SPARK-8085] [SPARKR] Support user-specified schema in read.df cc davies sun-rui Author: Shivaram Venkataraman Closes #6620 from shivaram/sparkr-read-schema and squashes the following commits: 16a6726 [Shivaram V

spark git commit: [SQL] Simplifies binary node pattern matching

2015-06-05 Thread lian
Repository: spark Updated Branches: refs/heads/master 700312e12 -> bc0d76a24 [SQL] Simplifies binary node pattern matching This PR is a simpler version of #2764, and adds `unapply` methods to the following binary nodes for simpler pattern matching: - `BinaryExpression` - `BinaryComparison` -

spark git commit: [SPARK-6324] [CORE] Centralize handling of script usage messages.

2015-06-05 Thread srowen
Repository: spark Updated Branches: refs/heads/master 019dc9f55 -> 700312e12 [SPARK-6324] [CORE] Centralize handling of script usage messages. Reorganize code so that the launcher library handles most of the work of printing usage messages, instead of having an awkward protocol between the lib

spark git commit: [STREAMING] Update streaming-kafka-integration.md

2015-06-05 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.4 9b3e4c187 -> 0ef2e9d35 [STREAMING] Update streaming-kafka-integration.md Fixed the broken links (Examples) in the documentation. Author: Akhil Das Closes # from akhld/patch-2 and squashes the following commits: 2228b83 [Akhil Da

spark git commit: [STREAMING] Update streaming-kafka-integration.md

2015-06-05 Thread srowen
Repository: spark Updated Branches: refs/heads/master b16b5434f -> 019dc9f55 [STREAMING] Update streaming-kafka-integration.md Fixed the broken links (Examples) in the documentation. Author: Akhil Das Closes # from akhld/patch-2 and squashes the following commits: 2228b83 [Akhil Das] U

spark git commit: [MINOR] [BUILD] Use custom temp directory during build.

2015-06-05 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.3 5b96b6933 -> 5185ea9b4 [MINOR] [BUILD] Use custom temp directory during build. Even with all the efforts to cleanup the temp directories created by unit tests, Spark leaves a lot of garbage in /tmp after a test run. This change override

spark git commit: [MINOR] [BUILD] Use custom temp directory during build.

2015-06-05 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-1.4 90cf68638 -> 9b3e4c187 [MINOR] [BUILD] Use custom temp directory during build. Even with all the efforts to cleanup the temp directories created by unit tests, Spark leaves a lot of garbage in /tmp after a test run. This change override

spark git commit: [MINOR] [BUILD] Use custom temp directory during build.

2015-06-05 Thread srowen
Repository: spark Updated Branches: refs/heads/master da20c8ca3 -> b16b5434f [MINOR] [BUILD] Use custom temp directory during build. Even with all the efforts to cleanup the temp directories created by unit tests, Spark leaves a lot of garbage in /tmp after a test run. This change overrides ja

spark git commit: [MINOR] [BUILD] Change link to jenkins builds on github.

2015-06-05 Thread srowen
Repository: spark Updated Branches: refs/heads/master 3a5c4da47 -> da20c8ca3 [MINOR] [BUILD] Change link to jenkins builds on github. Link to the tail of the console log, instead of the full log. That's bound to have the info the user is looking for, and at the same time loads way more quickly

spark git commit: [MINOR] remove unused interpolation var in log message

2015-06-05 Thread rxin
Repository: spark Updated Branches: refs/heads/master 2777ed394 -> 3a5c4da47 [MINOR] remove unused interpolation var in log message Completely trivial but I noticed this wrinkle in a log message today; `$sender` doesn't refer to anything and isn't interpolated here. Author: Sean Owen Close

spark git commit: [MINOR] remove unused interpolation var in log message

2015-06-05 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.4 f02af7c8f -> 90cf68638 [MINOR] remove unused interpolation var in log message Completely trivial but I noticed this wrinkle in a log message today; `$sender` doesn't refer to anything and isn't interpolated here. Author: Sean Owen C