spark git commit: [SPARK-17025][ML][PYTHON] Persistence for Pipelines with Python-only Stages

2017-08-11 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master b0bdfce9c -> 35db3b9fe [SPARK-17025][ML][PYTHON] Persistence for Pipelines with Python-only Stages ## What changes were proposed in this pull request? Implemented a Python-only persistence framework for pipelines containing stages that ca

spark git commit: [MINOR][BUILD] Download RAT and R version info over HTTPS; use RAT 0.12

2017-08-11 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master da8c59bde -> b0bdfce9c [MINOR][BUILD] Download RAT and R version info over HTTPS; use RAT 0.12 ## What changes were proposed in this pull request? This is trivial, but bugged me. We should download software over HTTPS. And we can use RAT 0

spark git commit: [SPARK-12559][SPARK SUBMIT] fix --packages for stand-alone cluster mode

2017-08-11 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 7f16c6910 -> da8c59bde [SPARK-12559][SPARK SUBMIT] fix --packages for stand-alone cluster mode Fixes --packages flag for the stand-alone case in cluster mode. Adds to the driver classpath the jars that are resolved via ivy along with any o

spark git commit: [SPARK-19122][SQL] Unnecessary shuffle+sort added if join predicates ordering differ from bucketing and sorting order

2017-08-11 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 94439997d -> 7f16c6910 [SPARK-19122][SQL] Unnecessary shuffle+sort added if join predicates ordering differ from bucketing and sorting order ## What changes were proposed in this pull request? Jira : https://issues.apache.org/jira/browse/

spark git commit: [SPARK-21595] Separate thresholds for buffering and spilling in ExternalAppendOnlyUnsafeRowArray

2017-08-11 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/branch-2.2 c90949698 -> 406eb1c2e [SPARK-21595] Separate thresholds for buffering and spilling in ExternalAppendOnlyUnsafeRowArray ## What changes were proposed in this pull request? [SPARK-21595](https://issues.apache.org/jira/browse/SPARK-2159

spark git commit: [SPARK-21595] Separate thresholds for buffering and spilling in ExternalAppendOnlyUnsafeRowArray

2017-08-11 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master 0377338bf -> 94439997d [SPARK-21595] Separate thresholds for buffering and spilling in ExternalAppendOnlyUnsafeRowArray ## What changes were proposed in this pull request? [SPARK-21595](https://issues.apache.org/jira/browse/SPARK-21595) r

spark git commit: [SPARK-21519][SQL] Add an option to the JDBC data source to initialize the target DB environment

2017-08-11 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 2387f1e31 -> 0377338bf [SPARK-21519][SQL] Add an option to the JDBC data source to initialize the target DB environment Add an option to the JDBC data source to initialize the environment of the remote database session ## What changes we

spark git commit: [SPARK-21675][WEBUI] Add a navigation bar at the bottom of the Details for Stage Page

2017-08-11 Thread srowen
Repository: spark Updated Branches: refs/heads/master 584c7f143 -> 2387f1e31 [SPARK-21675][WEBUI] Add a navigation bar at the bottom of the Details for Stage Page ## What changes were proposed in this pull request? 1. In Spark Web UI, the Details for Stage Page don't have a navigation bar at