spark git commit: [SPARK-20038][SQL] FileFormatWriter.ExecuteWriteTask.releaseResources() implementations to be re-entrant

2017-04-13 Thread irashid
Repository: spark Updated Branches: refs/heads/master 8ddf0d2a6 -> 7536e2849 [SPARK-20038][SQL] FileFormatWriter.ExecuteWriteTask.releaseResources() implementations to be re-entrant ## What changes were proposed in this pull request? have the`FileFormatWriter.ExecuteWriteTask.releaseResource

spark git commit: [SPARK-20232][PYTHON] Improve combineByKey docs

2017-04-13 Thread holden
Repository: spark Updated Branches: refs/heads/master fbe4216e1 -> 8ddf0d2a6 [SPARK-20232][PYTHON] Improve combineByKey docs ## What changes were proposed in this pull request? Improve combineByKey documentation: * Add note on memory allocation * Change example code to use different mergeVal

spark git commit: [SPARK-19946][TESTS][BACKPORT-2.1] DebugFilesystem.assertNoOpenStreams should report the open streams to help debugging

2017-04-13 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/branch-2.1 98ae54810 -> bca7ce285 [SPARK-19946][TESTS][BACKPORT-2.1] DebugFilesystem.assertNoOpenStreams should report the open streams to help debugging ## What changes were proposed in this pull request? Backport for PR #17292 DebugFilesystem.a

spark git commit: [SPARK-20233][SQL] Apply star-join filter heuristics to dynamic programming join enumeration

2017-04-13 Thread wenchen
Repository: spark Updated Branches: refs/heads/master a4293c284 -> fbe4216e1 [SPARK-20233][SQL] Apply star-join filter heuristics to dynamic programming join enumeration ## What changes were proposed in this pull request? Implements star-join filter to reduce the search space for dynamic pro

spark git commit: [SPARK-19924][SQL][BACKPORT-2.1] Handle InvocationTargetException for all Hive Shim

2017-04-13 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.1 be36c2f1e -> 98ae54810 [SPARK-19924][SQL][BACKPORT-2.1] Handle InvocationTargetException for all Hive Shim ### What changes were proposed in this pull request? This is to backport the PR https://github.com/apache/spark/pull/17265 to S

spark git commit: [SPARK-20284][CORE] Make {Des, S}erializationStream extend Closeable

2017-04-13 Thread srowen
Repository: spark Updated Branches: refs/heads/master 095d1cb3a -> a4293c284 [SPARK-20284][CORE] Make {Des,S}erializationStream extend Closeable ## What changes were proposed in this pull request? This PR allows to use `SerializationStream` and `DeserializationStream` in try-with-resources.

spark git commit: [SPARK-20265][MLLIB] Improve Prefix'span pre-processing efficiency

2017-04-13 Thread srowen
Repository: spark Updated Branches: refs/heads/master ec68d8f8c -> 095d1cb3a [SPARK-20265][MLLIB] Improve Prefix'span pre-processing efficiency ## What changes were proposed in this pull request? Improve PrefixSpan pre-processing efficency by preventing sequences of zero in the cleaned datab

spark git commit: [SPARK-20189][DSTREAM] Fix spark kinesis testcases to remove deprecated createStream and use Builders

2017-04-13 Thread srowen
Repository: spark Updated Branches: refs/heads/master c5f1cc370 -> ec68d8f8c [SPARK-20189][DSTREAM] Fix spark kinesis testcases to remove deprecated createStream and use Builders ## What changes were proposed in this pull request? The spark-kinesis testcases use the KinesisUtils.createStream