spark git commit: [SPARK-12104][SPARKR] collect() does not handle multiple columns with same name.

Repository: spark Updated Branches: refs/heads/master b6e9963ee -> 5011f264f [SPARK-12104][SPARKR] collect() does not handle multiple columns with same name. Author: Sun Rui Closes #10118 from sun-rui/SPARK-12104. Project:

spark git commit: [SPARK-12104][SPARKR] collect() does not handle multiple columns with same name.

Repository: spark Updated Branches: refs/heads/branch-1.6 9e8a8f71f -> 2d7c4f6af [SPARK-12104][SPARKR] collect() does not handle multiple columns with same name. Author: Sun Rui Closes #10118 from sun-rui/SPARK-12104. (cherry picked from commit

spark git commit: [SPARK-12088][SQL] check connection.isClosed before calling connection…

Repository: spark Updated Branches: refs/heads/branch-1.6 6674fd8aa -> 5826096ac [SPARK-12088][SQL] check connection.isClosed before calling connection… In Java Spec java.sql.Connection, it has boolean getAutoCommit() throws SQLException Throws: SQLException - if a database access error

spark git commit: [SPARK-12088][SQL] check connection.isClosed before calling connection…

Repository: spark Updated Branches: refs/heads/master ec2b6c26c -> 5349851f3 [SPARK-12088][SQL] check connection.isClosed before calling connection… In Java Spec java.sql.Connection, it has boolean getAutoCommit() throws SQLException Throws: SQLException - if a database access error occurs

spark git commit: [SPARK-12116][SPARKR][DOCS] document how to workaround function name conflicts with dplyr

Repository: spark Updated Branches: refs/heads/branch-1.6 84cbed17e -> f7ae62c45 [SPARK-12116][SPARKR][DOCS] document how to workaround function name conflicts with dplyr shivaram Author: felixcheung Closes #10119 from felixcheung/rdocdplyrmasked. (cherry

spark git commit: [SPARK-12116][SPARKR][DOCS] document how to workaround function name conflicts with dplyr

Repository: spark Updated Branches: refs/heads/master 95b3cf125 -> 43c575cb1 [SPARK-12116][SPARKR][DOCS] document how to workaround function name conflicts with dplyr shivaram Author: felixcheung Closes #10119 from felixcheung/rdocdplyrmasked. Project:

spark git commit: [DOCUMENTATION][KAFKA] fix typo in kafka/OffsetRange.scala

Repository: spark Updated Branches: refs/heads/branch-1.6 93b69ec45 -> 84cbed17e [DOCUMENTATION][KAFKA] fix typo in kafka/OffsetRange.scala this is to fix some typo in external/kafka/src/main/scala/org/apache/spark/streaming/kafka/OffsetRange.scala Author: microwishing

spark git commit: [DOCUMENTATION][KAFKA] fix typo in kafka/OffsetRange.scala

Repository: spark Updated Branches: refs/heads/master 7470d9edb -> 95b3cf125 [DOCUMENTATION][KAFKA] fix typo in kafka/OffsetRange.scala this is to fix some typo in external/kafka/src/main/scala/org/apache/spark/streaming/kafka/OffsetRange.scala Author: microwishing

spark git commit: [DOCUMENTATION][MLLIB] typo in mllib doc

Repository: spark Updated Branches: refs/heads/branch-1.6 5826096ac -> 93b69ec45 [DOCUMENTATION][MLLIB] typo in mllib doc \cc mengxr Author: Jeff Zhang Closes #10093 from zjffdu/mllib_typo. (cherry picked from commit 7470d9edbb0a45e714c96b5d55eff30724c0653a)

spark git commit: [DOCUMENTATION][MLLIB] typo in mllib doc

Repository: spark Updated Branches: refs/heads/master 5349851f3 -> 7470d9edb [DOCUMENTATION][MLLIB] typo in mllib doc \cc mengxr Author: Jeff Zhang Closes #10093 from zjffdu/mllib_typo. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

spark git commit: [FLAKY-TEST-FIX][STREAMING][TEST] Make sure StreamingContexts are shutdown after test

Repository: spark Updated Branches: refs/heads/master ad7cea6f7 -> a02d47277 [FLAKY-TEST-FIX][STREAMING][TEST] Make sure StreamingContexts are shutdown after test Author: Tathagata Das Closes #10124 from tdas/InputStreamSuite-flaky-test. Project:

spark git commit: [FLAKY-TEST-FIX][STREAMING][TEST] Make sure StreamingContexts are shutdown after test

Repository: spark Updated Branches: refs/heads/branch-1.6 9d698fc57 -> b1a27d616 [FLAKY-TEST-FIX][STREAMING][TEST] Make sure StreamingContexts are shutdown after test Author: Tathagata Das Closes #10124 from tdas/InputStreamSuite-flaky-test. (cherry picked

spark git commit: [SPARK-12059][CORE] Avoid assertion error when unexpected state transition met in Master

Repository: spark Updated Branches: refs/heads/master 8fa3e474a -> 7bc9e1db2 [SPARK-12059][CORE] Avoid assertion error when unexpected state transition met in Master Downgrade to warning log for unexpected state transition. andrewor14 please review, thanks a lot. Author: jerryshao

spark git commit: [SPARK-12059][CORE] Avoid assertion error when unexpected state transition met in Master

Repository: spark Updated Branches: refs/heads/branch-1.6 f7ae62c45 -> 8865d87f7 [SPARK-12059][CORE] Avoid assertion error when unexpected state transition met in Master Downgrade to warning log for unexpected state transition. andrewor14 please review, thanks a lot. Author: jerryshao

spark git commit: [MINOR][ML] Use coefficients replace weights

Repository: spark Updated Branches: refs/heads/master 688e521c2 -> d576e76bb [MINOR][ML] Use coefficients replace weights Use ```coefficients``` replace ```weights```, I wish they are the last two. mengxr Author: Yanbo Liang Closes #10065 from yanboliang/coefficients.

spark git commit: [MINOR][ML] Use coefficients replace weights

Repository: spark Updated Branches: refs/heads/branch-1.6 bf8b95fa4 -> e0577f542 [MINOR][ML] Use coefficients replace weights Use ```coefficients``` replace ```weights```, I wish they are the last two. mengxr Author: Yanbo Liang Closes #10065 from

spark git commit: [SPARK-12107][EC2] Update spark-ec2 versions

Repository: spark Updated Branches: refs/heads/branch-1.6 e0577f542 -> 9d698fc57 [SPARK-12107][EC2] Update spark-ec2 versions I haven't created a JIRA. If we absolutely need one I'll do it, but I'm fine with not getting mentioned in the release notes if that's the only purpose it'll serve.

spark git commit: [SPARK-12107][EC2] Update spark-ec2 versions

Repository: spark Updated Branches: refs/heads/master d576e76bb -> ad7cea6f7 [SPARK-12107][EC2] Update spark-ec2 versions I haven't created a JIRA. If we absolutely need one I'll do it, but I'm fine with not getting mentioned in the release notes if that's the only purpose it'll serve. cc

spark git commit: [SPARK-12108] Make event logs smaller

Repository: spark Updated Branches: refs/heads/branch-1.6 4c84f6e91 -> bf8b95fa4 [SPARK-12108] Make event logs smaller **Problem.** Event logs in 1.6 were much bigger than 1.5. I ran page rank and the event log size in 1.6 was almost 5x that in 1.5. I did a bisect to find that the RDD

spark git commit: [SPARK-12019][SPARKR] Support character vector for sparkR.init(), check param and fix doc

Repository: spark Updated Branches: refs/heads/master a02d47277 -> 2213441e5 [SPARK-12019][SPARKR] Support character vector for sparkR.init(), check param and fix doc and add tests. Spark submit expects comma-separated list Author: felixcheung Closes #10034 from

spark git commit: [SPARK-12019][SPARKR] Support character vector for sparkR.init(), check param and fix doc

Repository: spark Updated Branches: refs/heads/branch-1.6 b1a27d616 -> 355bd72e0 [SPARK-12019][SPARKR] Support character vector for sparkR.init(), check param and fix doc and add tests. Spark submit expects comma-separated list Author: felixcheung Closes #10034

spark git commit: [SPARK-12101][CORE] Fix thread pools that cannot cache tasks in Worker and AppClient

Repository: spark Updated Branches: refs/heads/branch-1.6 8865d87f7 -> 4c84f6e91 [SPARK-12101][CORE] Fix thread pools that cannot cache tasks in Worker and AppClient `SynchronousQueue` cannot cache any task. This issue is similar to #9978. It's an easy fix. Just use the fixed

spark git commit: [SPARK-12101][CORE] Fix thread pools that cannot cache tasks in Worker and AppClient

Repository: spark Updated Branches: refs/heads/master 7bc9e1db2 -> 649be4fa4 [SPARK-12101][CORE] Fix thread pools that cannot cache tasks in Worker and AppClient `SynchronousQueue` cannot cache any task. This issue is similar to #9978. It's an easy fix. Just use the fixed

spark git commit: [SPARK-12108] Make event logs smaller

Repository: spark Updated Branches: refs/heads/master 649be4fa4 -> 688e521c2 [SPARK-12108] Make event logs smaller **Problem.** Event logs in 1.6 were much bigger than 1.5. I ran page rank and the event log size in 1.6 was almost 5x that in 1.5. I did a bisect to find that the RDD callsite

spark git commit: [SPARK-11206] Support SQL UI on the history server (resubmit)

Repository: spark Updated Branches: refs/heads/master f434f36d5 -> b6e9963ee [SPARK-11206] Support SQL UI on the history server (resubmit) Resubmit #9297 and #9991 On the live web UI, there is a SQL tab which provides valuable information for the SQL query. But once the workload is finished,

spark git commit: [SPARK-12056][CORE] Create a TaskAttemptContext only after calling setConf.

Repository: spark Updated Branches: refs/heads/master 2213441e5 -> f434f36d5 [SPARK-12056][CORE] Create a TaskAttemptContext only after calling setConf. TaskAttemptContext's constructor will clone the configuration instead of referencing it. Calling setConf after creating TaskAttemptContext

spark git commit: [SPARK-12056][CORE] Create a TaskAttemptContext only after calling setConf.

Repository: spark Updated Branches: refs/heads/branch-1.6 355bd72e0 -> 9e8a8f71f [SPARK-12056][CORE] Create a TaskAttemptContext only after calling setConf. TaskAttemptContext's constructor will clone the configuration instead of referencing it. Calling setConf after creating

spark git commit: [SPARK-11314][YARN] add service API and test service for Yarn Cluster schedulers

Repository: spark Updated Branches: refs/heads/master 43c575cb1 -> 8fa3e474a [SPARK-11314][YARN] add service API and test service for Yarn Cluster schedulers This is purely the yarn/src/main and yarn/src/test bits of the YARN ATS integration: the extension model to load and run