spark git commit: [SPARK-12424][ML] The implementation of ParamMap#filter is wrong.

ted to mutable.Map using `asInstanceOf` so we get `ClassCastException`. Also, the return type of Map#filterKeys is not Serializable. It's the issue of Scala (https://issues.scala-lang.org/browse/SI-6654). Author: Kousuke Saruta <saru...@oss.nttdata.co.jp> Closes #10381 from sarutak/SPARK-12424.

spark git commit: [SPARK-12517] add default RDD name for one created via sc.textFile

Repository: spark Updated Branches: refs/heads/master fd50df413 -> 73b70f076 [SPARK-12517] add default RDD name for one created via sc.textFile The feature was first added at commit: 7b877b27053bfb7092e250e01a3b887e1b50a109 but was later removed (probably by mistake) at commit:

spark git commit: [SPARK-12517] add default RDD name for one created via sc.textFile

Repository: spark Updated Branches: refs/heads/branch-1.6 b8da77ef7 -> 1fbcb6e7b [SPARK-12517] add default RDD name for one created via sc.textFile The feature was first added at commit: 7b877b27053bfb7092e250e01a3b887e1b50a109 but was later removed (probably by mistake) at commit:

spark git commit: [SPARK-12502][BUILD][PYTHON] Script /dev/run-tests fails when IBM Java is used

Repository: spark Updated Branches: refs/heads/master ead6abf7e -> 9e85bb71a [SPARK-12502][BUILD][PYTHON] Script /dev/run-tests fails when IBM Java is used fix an exception with IBM JDK by removing update field from a JavaVersion tuple. This is because IBM JDK does not have information on

spark git commit: [SPARK-12502][BUILD][PYTHON] Script /dev/run-tests fails when IBM Java is used

Repository: spark Updated Branches: refs/heads/branch-1.6 b49856ae5 -> 4dd8712c1 [SPARK-12502][BUILD][PYTHON] Script /dev/run-tests fails when IBM Java is used fix an exception with IBM JDK by removing update field from a JavaVersion tuple. This is because IBM JDK does not have information

spark git commit: [SPARK-12413] Fix Mesos ZK persistence

Repository: spark Updated Branches: refs/heads/master 40e52a27c -> 2bebaa39d [SPARK-12413] Fix Mesos ZK persistence I believe this fixes SPARK-12413. I'm currently running an integration test to verify. Author: Michael Gummelt Closes #10366 from

spark git commit: [SPARK-12413] Fix Mesos ZK persistence

Repository: spark Updated Branches: refs/heads/branch-1.6 9177ea383 -> df0231952 [SPARK-12413] Fix Mesos ZK persistence I believe this fixes SPARK-12413. I'm currently running an integration test to verify. Author: Michael Gummelt Closes #10366 from

spark git commit: [SPARK-12345][MESOS] Properly filter out SPARK_HOME in the Mesos REST server

Repository: spark Updated Branches: refs/heads/branch-1.6 1fbca4120 -> 881f2544e [SPARK-12345][MESOS] Properly filter out SPARK_HOME in the Mesos REST server Fix problem with #10332, this one should fix Cluster mode on Mesos Author: Iulian Dragos Closes #10359 from

spark git commit: [SPARK-12345][MESOS] Properly filter out SPARK_HOME in the Mesos REST server

Repository: spark Updated Branches: refs/heads/master 86e405f35 -> 818456881 [SPARK-12345][MESOS] Properly filter out SPARK_HOME in the Mesos REST server Fix problem with #10332, this one should fix Cluster mode on Mesos Author: Iulian Dragos Closes #10359 from

spark git commit: [SPARK-12053][CORE] EventLoggingListener.getLogPath needs 4 parameters

Repository: spark Updated Branches: refs/heads/branch-1.6 0978ec11c -> a8c6d8acc [SPARK-12053][CORE] EventLoggingListener.getLogPath needs 4 parameters ```EventLoggingListener.getLogPath``` needs 4 input arguments:

spark git commit: [SPARK-12053][CORE] EventLoggingListener.getLogPath needs 4 parameters

Repository: spark Updated Branches: refs/heads/master 2c5dee0fb -> a8ceec5e8 [SPARK-12053][CORE] EventLoggingListener.getLogPath needs 4 parameters ```EventLoggingListener.getLogPath``` needs 4 input arguments:

spark git commit: [SPARK-12053][CORE] EventLoggingListener.getLogPath needs 4 parameters

Repository: spark Updated Branches: refs/heads/branch-1.5 7900d192e -> 9b6216171 [SPARK-12053][CORE] EventLoggingListener.getLogPath needs 4 parameters ```EventLoggingListener.getLogPath``` needs 4 input arguments:

spark git commit: [SPARK-2016] [WEBUI] RDD partition table pagination for the RDD Page

Repository: spark Updated Branches: refs/heads/master b211cbc73 - cb7fa0aa9 [SPARK-2016] [WEBUI] RDD partition table pagination for the RDD Page Add pagination for the RDD page to avoid unresponsive UI when the number of the RDD partitions is large. Before:

spark git commit: [SPARK-2016] [WEBUI] RDD partition table pagination for the RDD Page

Repository: spark Updated Branches: refs/heads/branch-1.5 bd9b75213 - 45c8d2bb8 [SPARK-2016] [WEBUI] RDD partition table pagination for the RDD Page Add pagination for the RDD page to avoid unresponsive UI when the number of the RDD partitions is large. Before:

spark git commit: [SPARK-9583] [BUILD] Do not print mvn debug messages to stdout.

Repository: spark Updated Branches: refs/heads/branch-1.5 45c8d2bb8 - f44b27a2b [SPARK-9583] [BUILD] Do not print mvn debug messages to stdout. This allows build/mvn to be used by make-distribution.sh. Author: Marcelo Vanzin van...@cloudera.com Closes #7915 from vanzin/SPARK-9583 and

spark git commit: [SPARK-9583] [BUILD] Do not print mvn debug messages to stdout.

Repository: spark Updated Branches: refs/heads/master cb7fa0aa9 - d702d5373 [SPARK-9583] [BUILD] Do not print mvn debug messages to stdout. This allows build/mvn to be used by make-distribution.sh. Author: Marcelo Vanzin van...@cloudera.com Closes #7915 from vanzin/SPARK-9583 and squashes

spark git commit: [SPARK-9521] [DOCS] Addendum. Require Maven 3.3.3+ in the build

Repository: spark Updated Branches: refs/heads/master 5eb89f67e - 0afa6fbf5 [SPARK-9521] [DOCS] Addendum. Require Maven 3.3.3+ in the build Follow on for #7852: Building Spark doc needs to refer to new Maven requirement too Author: Sean Owen so...@cloudera.com Closes #7905 from

spark git commit: Pregel example type fix

Repository: spark Updated Branches: refs/heads/master aa19c696e - 90006f3c5 Pregel example type fix Pregel example to express single source shortest path from https://spark.apache.org/docs/latest/graphx-programming-guide.html#pregel-api does not work due to incorrect type. The reason is

spark git commit: Pregel example type fix

Repository: spark Updated Branches: refs/heads/branch-1.4 a671dad62 - cfca1c5af Pregel example type fix Pregel example to express single source shortest path from https://spark.apache.org/docs/latest/graphx-programming-guide.html#pregel-api does not work due to incorrect type. The reason is

spark git commit: [SPARK-9052] [SPARKR] Fix comments after curly braces

Repository: spark Updated Branches: refs/heads/master 936a96cb3 - 2bdf9914a [SPARK-9052] [SPARKR] Fix comments after curly braces [[SPARK-9052] Fix comments after curly braces - ASF JIRA](https://issues.apache.org/jira/browse/SPARK-9052) This is the full result of lintr at the

spark git commit: [SPARK-9093] [SPARKR] Fix single-quotes strings in SparkR

Repository: spark Updated Branches: refs/heads/master 3f6d28a5c - 5a3c1ad08 [SPARK-9093] [SPARKR] Fix single-quotes strings in SparkR [[SPARK-9093] Fix single-quotes strings in SparkR - ASF JIRA](https://issues.apache.org/jira/browse/SPARK-9093) This is the result of lintr at the

spark git commit: [SPARK-9012] [WEBUI] Escape Accumulators in the task table

Repository: spark Updated Branches: refs/heads/master 14935d846 - adb33d366 [SPARK-9012] [WEBUI] Escape Accumulators in the task table If running the following codes, the task table will be broken because accumulators aren't escaped. ``` val a = sc.accumulator(1, table) sc.parallelize(1 to

spark git commit: [SPARK-9012] [WEBUI] Escape Accumulators in the task table

Repository: spark Updated Branches: refs/heads/branch-1.4 dce68ad1a - 109399223 [SPARK-9012] [WEBUI] Escape Accumulators in the task table If running the following codes, the task table will be broken because accumulators aren't escaped. ``` val a = sc.accumulator(1, table) sc.parallelize(1

spark git commit: [SPARK-8937] [TEST] A setting `spark.unsafe.exceptionOnMemoryLeak ` is missing in ScalaTest config.

/spark.unsafe.exceptionOnMemoryLeak /systemProperties ... ``` but is absent in the config ScalaTest. Author: Kousuke Saruta saru...@oss.nttdata.co.jp Closes #7308 from sarutak/add-setting-for-memory-leak and squashes the following commits: 95644e7 [Kousuke Saruta] Added a setting for memory leak (cherry picked

spark git commit: [SPARK-8937] [TEST] A setting `spark.unsafe.exceptionOnMemoryLeak ` is missing in ScalaTest config.

/systemProperties ... ``` but is absent in the config ScalaTest. Author: Kousuke Saruta saru...@oss.nttdata.co.jp Closes #7308 from sarutak/add-setting-for-memory-leak and squashes the following commits: 95644e7 [Kousuke Saruta] Added a setting for memory leak Project: http://git

spark git commit: [SPARK-8902] Correctly print hostname in error

Repository: spark Updated Branches: refs/heads/branch-1.4 3f6e6e0e2 - df763495f [SPARK-8902] Correctly print hostname in error With + the strings are separate expressions, and format() is called on the last string before concatenation. (So substitution does not happen.) Without + the string

spark git commit: [DOCS] Fix minor wrong lambda expression example.

, (Integer arg1, String arg2) - arg2 + arg1), - We have an extra `)` here. DataTypes.StringType); ``` Author: Kousuke Saruta saru...@oss.nttdata.co.jp Closes #7187 from sarutak/fix-minor-wrong-lambda-expression and squashes the following commits: a13196d [Kousuke Saruta] Fixed

spark git commit: [DOCS] Fix minor wrong lambda expression example.

, (Integer arg1, String arg2) - arg2 + arg1), - We have an extra `)` here. DataTypes.StringType); ``` Author: Kousuke Saruta saru...@oss.nttdata.co.jp Closes #7187 from sarutak/fix-minor-wrong-lambda-expression and squashes the following commits: a13196d [Kousuke Saruta] Fixed minor

spark git commit: [SPARK-8702] [WEBUI] Avoid massive concating strings in Javascript

Repository: spark Updated Branches: refs/heads/master 660c6cec7 - 630bd5fd8 [SPARK-8702] [WEBUI] Avoid massive concating strings in Javascript When there are massive tasks, such as `sc.parallelize(1 to 10, 1).count()`, the generated JS codes have a lot of string concatenations in

spark git commit: [SPARK-5768] [WEB UI] Fix for incorrect memory in Spark UI

Repository: spark Updated Branches: refs/heads/master c337844ed - 085a7216b [SPARK-5768] [WEB UI] Fix for incorrect memory in Spark UI Fix for incorrect memory in Spark UI as per SPARK-5768 Author: Joshi rekhajo...@gmail.com Author: Rekha Joshi rekhajo...@gmail.com Closes #6972 from

spark git commit: [SPARK-5768] [WEB UI] Fix for incorrect memory in Spark UI

Repository: spark Updated Branches: refs/heads/branch-1.4 0605e0843 - 74001db04 [SPARK-5768] [WEB UI] Fix for incorrect memory in Spark UI Fix for incorrect memory in Spark UI as per SPARK-5768 Author: Joshi rekhajo...@gmail.com Author: Rekha Joshi rekhajo...@gmail.com Closes #6972 from

spark git commit: [SQL] [DOCS] updated the documentation for explode

Repository: spark Updated Branches: refs/heads/branch-1.4 77cb1d5ed - 27693e175 [SQL] [DOCS] updated the documentation for explode the syntax was incorrect in the example in explode Author: lockwobr lockw...@gmail.com Closes #6943 from lockwobr/master and squashes the following commits:

spark git commit: [SQL] [DOCS] updated the documentation for explode

Repository: spark Updated Branches: refs/heads/master 0f92be5b5 - 4f7fbefb8 [SQL] [DOCS] updated the documentation for explode the syntax was incorrect in the example in explode Author: lockwobr lockw...@gmail.com Closes #6943 from lockwobr/master and squashes the following commits:

<    1   2   3