spark git commit: [SPARK-21941] Stop storing unused attemptId in SQLTaskMetrics

2017-09-08 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 31c74fec2 -> 8a5eb5068 [SPARK-21941] Stop storing unused attemptId in SQLTaskMetrics ## What changes were proposed in this pull request? In a driver heap dump containing 390,105 instances of SQLTaskMetrics this would have saved me approxim

spark git commit: [SPARK-19866][ML][PYSPARK] Add local version of Word2Vec findSynonyms for spark.ml: Python API

2017-09-08 Thread holden
Repository: spark Updated Branches: refs/heads/master 8598d03a0 -> 31c74fec2 [SPARK-19866][ML][PYSPARK] Add local version of Word2Vec findSynonyms for spark.ml: Python API https://issues.apache.org/jira/browse/SPARK-19866 ## What changes were proposed in this pull request? Add Python API fo

spark git commit: [SPARK-15243][ML][SQL][PYTHON] Add missing support for unicode in Param methods & functions in dataframe

2017-09-08 Thread holden
Repository: spark Updated Branches: refs/heads/master 8a4f228dc -> 8598d03a0 [SPARK-15243][ML][SQL][PYTHON] Add missing support for unicode in Param methods & functions in dataframe ## What changes were proposed in this pull request? This PR proposes to support unicodes in Param methods in M

spark git commit: [SPARK-21128][R][BACKPORT-2.2] Remove both "spark-warehouse" and "metastore_db" before listing files in R tests

2017-09-08 Thread felixcheung
Repository: spark Updated Branches: refs/heads/branch-2.2 9ae7c96ce -> 987682160 [SPARK-21128][R][BACKPORT-2.2] Remove both "spark-warehouse" and "metastore_db" before listing files in R tests ## What changes were proposed in this pull request? This PR proposes to list the files in test _aft

spark git commit: [SPARK-21946][TEST] fix flaky test: "alter table: rename cached table" in InMemoryCatalogedDDLSuite

2017-09-08 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.2 08cb06af2 -> 9ae7c96ce [SPARK-21946][TEST] fix flaky test: "alter table: rename cached table" in InMemoryCatalogedDDLSuite ## What changes were proposed in this pull request? This PR fixes flaky test `InMemoryCatalogedDDLSuite "alter

spark git commit: [SPARK-21946][TEST] fix flaky test: "alter table: rename cached table" in InMemoryCatalogedDDLSuite

2017-09-08 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 0dfc1ec59 -> 8a4f228dc [SPARK-21946][TEST] fix flaky test: "alter table: rename cached table" in InMemoryCatalogedDDLSuite ## What changes were proposed in this pull request? This PR fixes flaky test `InMemoryCatalogedDDLSuite "alter tabl

spark git commit: [SPARK-21936][SQL][2.2] backward compatibility test framework for HiveExternalCatalog

2017-09-08 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.2 781a1f83c -> 08cb06af2 [SPARK-21936][SQL][2.2] backward compatibility test framework for HiveExternalCatalog backport https://github.com/apache/spark/pull/19148 to 2.2 Author: Wenchen Fan Closes #19163 from cloud-fan/test. Project

spark git commit: [SPARK-21726][SQL][FOLLOW-UP] Check for structural integrity of the plan in Optimzer in test mode

2017-09-08 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master dbb824125 -> 0dfc1ec59 [SPARK-21726][SQL][FOLLOW-UP] Check for structural integrity of the plan in Optimzer in test mode ## What changes were proposed in this pull request? The condition in `Optimizer.isPlanIntegral` is wrong. We should a

[2/5] spark-website git commit: Use HTTPS for all apache.org links

2017-09-08 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/a1f847ef/site/releases/spark-release-2-1-1.html -- diff --git a/site/releases/spark-release-2-1-1.html b/site/releases/spark-release-2-1-1.html index 2f5e4e0..bbfc09d 10064

[4/5] spark-website git commit: Use HTTPS for all apache.org links

2017-09-08 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/a1f847ef/site/news/spark-1-2-2-released.html -- diff --git a/site/news/spark-1-2-2-released.html b/site/news/spark-1-2-2-released.html index e68dd8c..a1f64c7 100644 --- a/s

[1/5] spark-website git commit: Added CVE-2017-12612

2017-09-08 Thread srowen
Repository: spark-website Updated Branches: refs/heads/asf-site 434db70b4 -> a1f847efc Added CVE-2017-12612 Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/6d90ff44 Tree: http://git-wip-us.apache.org/repos/

[3/5] spark-website git commit: Use HTTPS for all apache.org links

2017-09-08 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/a1f847ef/site/news/submit-talks-to-spark-summit-2016.html -- diff --git a/site/news/submit-talks-to-spark-summit-2016.html b/site/news/submit-talks-to-spark-summit-2016.htm

[5/5] spark-website git commit: Use HTTPS for all apache.org links

2017-09-08 Thread srowen
Use HTTPS for all apache.org links Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/a1f847ef Tree: http://git-wip-us.apache.org/repos/asf/spark-website/tree/a1f847ef Diff: http://git-wip-us.apache.org/repos/asf/

spark git commit: [SPARK-21915][ML][PYSPARK] Model 1 and Model 2 ParamMaps Missing

2017-09-08 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.2 4304d0bf0 -> 781a1f83c [SPARK-21915][ML][PYSPARK] Model 1 and Model 2 ParamMaps Missing dongjoon-hyun HyukjinKwon Error in PySpark example code: /examples/src/main/python/ml/estimator_transformer_param_example.py The original Scala co