spark git commit: [SPARK-22535][PYSPARK] Sleep before killing the python worker in PythonRunner.MonitorThread

2017-11-15 Thread ueshin
Repository: spark Updated Branches: refs/heads/master 1e8233541 -> 03f2b7bff [SPARK-22535][PYSPARK] Sleep before killing the python worker in PythonRunner.MonitorThread ## What changes were proposed in this pull request? `PythonRunner.MonitorThread` should give the task a little time to

spark git commit: [SPARK-21842][MESOS] Support Kerberos ticket renewal and creation in Mesos

2017-11-15 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 2014e7a78 -> 1e8233541 [SPARK-21842][MESOS] Support Kerberos ticket renewal and creation in Mesos ## What changes were proposed in this pull request? tl;dr: Add a class, `MesosHadoopDelegationTokenManager` that updates delegation tokens

spark git commit: [SPARK-22479][SQL] Exclude credentials from SaveintoDataSourceCommand.simpleString

2017-11-15 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 39b3f10dd -> 2014e7a78 [SPARK-22479][SQL] Exclude credentials from SaveintoDataSourceCommand.simpleString ## What changes were proposed in this pull request? Do not include jdbc properties which may contain credentials in logging a

spark git commit: [SPARK-20649][CORE] Simplify REST API resource structure.

2017-11-15 Thread irashid
Repository: spark Updated Branches: refs/heads/master bc0848b4c -> 39b3f10dd [SPARK-20649][CORE] Simplify REST API resource structure. With the new UI store, the API resource classes have a lot less code, since there's no need for complicated translations between the UI types and the API

spark git commit: [SPARK-22469][SQL] Accuracy problem in comparison with string and numeric

2017-11-15 Thread lixiao
Repository: spark Updated Branches: refs/heads/master aa88b8dbb -> bc0848b4c [SPARK-22469][SQL] Accuracy problem in comparison with string and numeric ## What changes were proposed in this pull request? This fixes a problem caused by #15880 `select '1.5' > 0.5; // Result is NULL in Spark but

spark git commit: [SPARK-22490][DOC] Add PySpark doc for SparkSession.builder

2017-11-15 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.2 210f2922b -> 3cefddee5 [SPARK-22490][DOC] Add PySpark doc for SparkSession.builder ## What changes were proposed in this pull request? In PySpark API Document,

spark git commit: [SPARK-22490][DOC] Add PySpark doc for SparkSession.builder

2017-11-15 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 7f99a05e6 -> aa88b8dbb [SPARK-22490][DOC] Add PySpark doc for SparkSession.builder ## What changes were proposed in this pull request? In PySpark API Document,

spark git commit: [SPARK-22422][ML] Add Adjusted R2 to RegressionMetrics

2017-11-15 Thread srowen
Repository: spark Updated Branches: refs/heads/master 8f0e88df0 -> 7f99a05e6 [SPARK-22422][ML] Add Adjusted R2 to RegressionMetrics ## What changes were proposed in this pull request? I added adjusted R2 as a regression metric which was implemented in all major statistical analysis tools.

spark-website git commit: Reduce generated HTML differences

2017-11-15 Thread srowen
Repository: spark-website Updated Branches: refs/heads/asf-site d8159e6c0 -> de3e0a792 Reduce generated HTML differences Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/de3e0a79 Tree:

spark-website git commit: And update the site directory

2017-11-15 Thread holden
Repository: spark-website Updated Branches: refs/heads/asf-site 853627da6 -> d8159e6c0 And update the site directory Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/d8159e6c Tree:

spark git commit: [SPARK-20791][PYTHON][FOLLOWUP] Check for unicode column names in createDataFrame with Arrow

2017-11-15 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master dce1610ae -> 8f0e88df0 [SPARK-20791][PYTHON][FOLLOWUP] Check for unicode column names in createDataFrame with Arrow ## What changes were proposed in this pull request? If schema is passed as a list of unicode strings for column names,

spark git commit: [SPARK-22514][SQL] move ColumnVector.Array and ColumnarBatch.Row to individual files

2017-11-15 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 1e6f76059 -> dce1610ae [SPARK-22514][SQL] move ColumnVector.Array and ColumnarBatch.Row to individual files ## What changes were proposed in this pull request? Logically the `Array` doesn't belong to `ColumnVector`, and `Row` doesn't