spark git commit: [DOC][PySpark][Streaming] Fix docstring for sphinx

Repository: spark Updated Branches: refs/heads/branch-1.2 8ecabf4b7 - c4abb2eb4 [DOC][PySpark][Streaming] Fix docstring for sphinx This commit should be merged for 1.2 release. cc tdas Author: Ken Takagiwa ugw.gi.wo...@gmail.com Closes #3311 from giwa/patch-3 and squashes the following

spark git commit: [SPARK-4294][Streaming] UnionDStream stream should express the requirements in the same way as TransformedDStream

Repository: spark Updated Branches: refs/heads/branch-1.2 c4abb2eb4 - a250ca369 [SPARK-4294][Streaming] UnionDStream stream should express the requirements in the same way as TransformedDStream In class TransformedDStream: ```scala require(parents.length 0, List of DStreams to transform is

spark git commit: [SPARK-4294][Streaming] UnionDStream stream should express the requirements in the same way as TransformedDStream

Repository: spark Updated Branches: refs/heads/master 73c8ea84a - c3002c4a6 [SPARK-4294][Streaming] UnionDStream stream should express the requirements in the same way as TransformedDStream In class TransformedDStream: ```scala require(parents.length 0, List of DStreams to transform is

spark git commit: [SPARK-4062][Streaming]Add ReliableKafkaReceiver in Spark Streaming Kafka connector

: 5461f1c [Saisai Shao] Merge pull request #8 from tdas/kafka-refactor3 eae4ad6 [Tathagata Das] Refectored KafkaStreamSuiteBased to eliminate KafkaTestUtils and made Java more robust. fab14c7 [Tathagata Das] minor update. 149948b [Tathagata Das] Fixed mistake 14630aa [Tathagata Das] Minor updates. d9a452c

spark git commit: [SPARK-4062][Streaming]Add ReliableKafkaReceiver in Spark Streaming Kafka connector

[Saisai Shao] Merge pull request #8 from tdas/kafka-refactor3 eae4ad6 [Tathagata Das] Refectored KafkaStreamSuiteBased to eliminate KafkaTestUtils and made Java more robust. fab14c7 [Tathagata Das] minor update. 149948b [Tathagata Das] Fixed mistake 14630aa [Tathagata Das] Minor updates. d9a452c

spark git commit: [SPARK-3660][STREAMING] Initial RDD for updateStateByKey transformation

Repository: spark Updated Branches: refs/heads/master 4b736dbab - 36ddeb7bf [SPARK-3660][STREAMING] Initial RDD for updateStateByKey transformation SPARK-3660 : Initial RDD for updateStateByKey transformation I have added a sample StatefulNetworkWordCountWithInitial inspired by

spark git commit: [SPARK-4295][External]Fix exception in SparkSinkSuite

Repository: spark Updated Branches: refs/heads/master ef29a9a9a - f8811a569 [SPARK-4295][External]Fix exception in SparkSinkSuite Handle exception in SparkSinkSuite, please refer to [SPARK-4295] Author: maji2014 ma...@asiainfo.com Closes #3177 from maji2014/spark-4295 and squashes the

spark git commit: [SPARK-2492][Streaming] kafkaReceiver minor changes to align with Kafka 0.8

will introduce issue as mentioned in [SPARK-2383](https://issues.apache.org/jira/browse/SPARK-2383). So Here we change to offer user to API to explicitly reset offset before create Kafka stream, while in the meantime keep the same behavior as Kafka 0.8 for parameter `auto.offset.reset`. @tdas

spark git commit: [Streaming][Minor]Replace some 'if-else' in Clock

Repository: spark Updated Branches: refs/heads/master c8850a3d6 - 6e03de304 [Streaming][Minor]Replace some 'if-else' in Clock Replace some 'if-else' statement by math.min and math.max in Clock.scala Author: huangzhaowei carlmartin...@gmail.com Closes #3088 from SaintBacchus/StreamingClock

spark git commit: SPARK-2548 [STREAMING] JavaRecoverableWordCount is missing

Repository: spark Updated Branches: refs/heads/master ed8bf1eac - 3a02d416c SPARK-2548 [STREAMING] JavaRecoverableWordCount is missing Here's my attempt to re-port `RecoverableNetworkWordCount` to Java, following the example of its Scala and Java siblings. I fixed a few minor doc/formatting

spark git commit: SPARK-2548 [STREAMING] JavaRecoverableWordCount is missing

Repository: spark Updated Branches: refs/heads/branch-1.1 dc38defd2 - cdcf5467a SPARK-2548 [STREAMING] JavaRecoverableWordCount is missing Here's my attempt to re-port `RecoverableNetworkWordCount` to Java, following the example of its Scala and Java siblings. I fixed a few minor

spark git commit: Update RecoverableNetworkWordCount.scala

Repository: spark Updated Branches: refs/heads/master 3a02d416c - 0340c56a9 Update RecoverableNetworkWordCount.scala Trying this example, I missed the moment when the checkpoint was iniciated Author: comcmipi pito...@fns.uniba.sk Closes #2735 from comcmipi/patch-1 and squashes the following

spark git commit: Update RecoverableNetworkWordCount.scala

Repository: spark Updated Branches: refs/heads/branch-1.1 cdcf5467a - 254b13570 Update RecoverableNetworkWordCount.scala Trying this example, I missed the moment when the checkpoint was iniciated Author: comcmipi pito...@fns.uniba.sk Closes #2735 from comcmipi/patch-1 and squashes the

spark git commit: [SPARK-3954][Streaming] Optimization to FileInputDStream

Repository: spark Updated Branches: refs/heads/branch-1.2 f0eb0a79c - 07ba50f7e [SPARK-3954][Streaming] Optimization to FileInputDStream about convert files to RDDS there are 3 loops with files sequence in spark source. loops files sequence: 1.files.map(...) 2.files.zip(fileRDDs)

spark git commit: [SPARK-3954][Streaming] Optimization to FileInputDStream

Repository: spark Updated Branches: refs/heads/master a1fc059b6 - ce6ed2abd [SPARK-3954][Streaming] Optimization to FileInputDStream about convert files to RDDS there are 3 loops with files sequence in spark source. loops files sequence: 1.files.map(...) 2.files.zip(fileRDDs)

spark git commit: [SPARK-3954][Streaming] Optimization to FileInputDStream

Repository: spark Updated Branches: refs/heads/branch-1.1 64945f868 - 3d889dfc1 [SPARK-3954][Streaming] Optimization to FileInputDStream about convert files to RDDS there are 3 loops with files sequence in spark source. loops files sequence: 1.files.map(...) 2.files.zip(fileRDDs)

spark git commit: [SPARK-3495][SPARK-3496] Backporting block replication fixes made in master to branch 1.1

of NioBlockTransferService, which required slight modification to unit tests. Other than that the code is exactly same as in the original PR. Please refer to discussion in the original PR if you have any thoughts. Author: Tathagata Das tathagata.das1...@gmail.com Closes #3191 from tdas/replication-fix-branch

spark git commit: [SPARK-4301] StreamingContext should not allow start() to be called after calling stop()

Repository: spark Updated Branches: refs/heads/master 4af5c7e24 - 7b41b17f3 [SPARK-4301] StreamingContext should not allow start() to be called after calling stop() In Spark 1.0.0+, calling `stop()` on a StreamingContext that has not been started is a no-op which has no side-effects. This

spark git commit: [SPARK-4301] StreamingContext should not allow start() to be called after calling stop()

Repository: spark Updated Branches: refs/heads/branch-1.2 05bffcc02 - 21b9ac062 [SPARK-4301] StreamingContext should not allow start() to be called after calling stop() In Spark 1.0.0+, calling `stop()` on a StreamingContext that has not been started is a no-op which has no side-effects.

spark git commit: [SPARK-4301] StreamingContext should not allow start() to be called after calling stop()

Repository: spark Updated Branches: refs/heads/branch-1.1 4895f6544 - 78cd3ab88 [SPARK-4301] StreamingContext should not allow start() to be called after calling stop() In Spark 1.0.0+, calling `stop()` on a StreamingContext that has not been started is a no-op which has no side-effects.

spark git commit: [SPARK-4301] StreamingContext should not allow start() to be called after calling stop()

Repository: spark Updated Branches: refs/heads/branch-1.0 d4aed266d - 395656c8e [SPARK-4301] StreamingContext should not allow start() to be called after calling stop() In Spark 1.0.0+, calling `stop()` on a StreamingContext that has not been started is a no-op which has no side-effects.

spark git commit: Update JavaCustomReceiver.java

Repository: spark Updated Branches: refs/heads/master d6e555244 - 7c9ec529a Update JavaCustomReceiver.java 数组下标越界 Author: xiao321 1042460...@qq.com Closes #3153 from xiao321/patch-1 and squashes the following commits: 0ed17b5 [xiao321] Update JavaCustomReceiver.java Project:

spark git commit: Update JavaCustomReceiver.java

Repository: spark Updated Branches: refs/heads/branch-1.2 47bd8f302 - 8cefb63c1 Update JavaCustomReceiver.java 数组下标越界 Author: xiao321 1042460...@qq.com Closes #3153 from xiao321/patch-1 and squashes the following commits: 0ed17b5 [xiao321] Update JavaCustomReceiver.java

spark git commit: Update JavaCustomReceiver.java

Repository: spark Updated Branches: refs/heads/branch-1.1 0a40eac25 - 4fb26df87 Update JavaCustomReceiver.java 数组下标越界 Author: xiao321 1042460...@qq.com Closes #3153 from xiao321/patch-1 and squashes the following commits: 0ed17b5 [xiao321] Update JavaCustomReceiver.java

spark git commit: Update JavaCustomReceiver.java

Repository: spark Updated Branches: refs/heads/branch-1.0 76c20cac9 - 18c8c3833 Update JavaCustomReceiver.java 数组下标越界 Author: xiao321 1042460...@qq.com Closes #3153 from xiao321/patch-1 and squashes the following commits: 0ed17b5 [xiao321] Update JavaCustomReceiver.java

git commit: [SPARK-4029][Streaming] Update streaming driver to reliably save and recover received block metadata on driver failures

that tests the driver recovery, by killing and restarting the streaming context, and verifying all the input data gets processed. This has been implemented but not included in this PR yet. A sneak peek of that DriverFailureSuite can be found in this PR (on my personal repo): https://github.com/tdas

git commit: [SPARK-4028][Streaming] ReceivedBlockHandler interface to abstract the functionality of storage of received data

as a write ahead log. Author: Tathagata Das tathagata.das1...@gmail.com Closes #2940 from tdas/driver-ha-rbh and squashes the following commits: 78a4aaa [Tathagata Das] Fixed bug causing test failures. f192f47 [Tathagata Das] Fixed import order. df5f320 [Tathagata Das] Updated code to use

git commit: [SPARK-4027][Streaming] WriteAheadLogBackedBlockRDD to read received either from BlockManager or WAL in HDFS

hshreedha...@apache.org Closes #2931 from tdas/driver-ha-rdd and squashes the following commits: 209e49c [Tathagata Das] Better fix to style issue. 4a5866f [Tathagata Das] Addressed one more comment. ed5fbf0 [Tathagata Das] Minor updates. b0a18b1 [Tathagata Das] Fixed import order. 20aa7c6 [Tathagata

git commit: [SPARK-4026][Streaming] Write ahead log management

HDFS mini cluster. Author: Hari Shreedharan hshreedha...@apache.org Author: Tathagata Das tathagata.das1...@gmail.com Closes #2882 from tdas/driver-ha-wal and squashes the following commits: e4bee20 [Tathagata Das] Removed synchronized, Path.getFileSystem is threadsafe 55514e2 [Tathagata Das

git commit: [SPARK-3912][Streaming] Fixed flakyFlumeStreamSuite

batches. Author: Tathagata Das tathagata.das1...@gmail.com Closes #2773 from tdas/flume-test-fix and squashes the following commits: 93cd7f6 [Tathagata Das] Reimplimented FlumeStreamSuite to be more robust. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip

[2/2] git commit: [SPARK-2377] Python API for Streaming

double check 58591d2 [Ken Takagiwa] reduceByKey is working 0df7111 [Ken Takagiwa] delete old file f485b1d [Ken Takagiwa] fied input of socketTextDStream dd6de81 [Ken Takagiwa] initial commit for socketTextStream 247fd74 [Ken Takagiwa] modified the code base on comment in https://github.com/tdas

git commit: SPARK-2932 [STREAMING] Move MasterFailureTest out of main source directory

Repository: spark Updated Branches: refs/heads/master b8487713d - c3f2a8588 SPARK-2932 [STREAMING] Move MasterFailureTest out of main source directory (HT @vanzin) Whatever the reason was for having this test class in `main`, if there is one, appear to be moot. This may have been a result of

git commit: [SPARK-2419][Streaming][Docs] More updates to the streaming programming guide

: Tathagata Das tathagata.das1...@gmail.com Author: Chris Fregly ch...@fregly.com Closes #2307 from tdas/streaming-doc-fix1 and squashes the following commits: ec40b5d [Tathagata Das] Updated figure with kinesis fdb9c5e [Tathagata Das] Fixed style issues with kinesis guide 036d219 [Chris Fregly] updated

git commit: [SPARK-2419][Streaming][Docs] More updates to the streaming programming guide

: Tathagata Das tathagata.das1...@gmail.com Author: Chris Fregly ch...@fregly.com Closes #2307 from tdas/streaming-doc-fix1 and squashes the following commits: ec40b5d [Tathagata Das] Updated figure with kinesis fdb9c5e [Tathagata Das] Fixed style issues with kinesis guide 036d219 [Chris Fregly

git commit: [SPARK-2419][Streaming][Docs] Updates to the streaming programming guide

tathagata.das1...@gmail.com Author: Jacek Laskowski ja...@japila.pl Closes #2254 from tdas/streaming-doc-fix and squashes the following commits: e45c6d7 [Jacek Laskowski] More fixes from an old PR 5125316 [Tathagata Das] Fixed links dc02f26 [Tathagata Das] Refactored streaming kinesis guide and made

git commit: [SPARK-2419][Streaming][Docs] Updates to the streaming programming guide

tathagata.das1...@gmail.com Author: Jacek Laskowski ja...@japila.pl Closes #2254 from tdas/streaming-doc-fix and squashes the following commits: e45c6d7 [Jacek Laskowski] More fixes from an old PR 5125316 [Tathagata Das] Fixed links dc02f26 [Tathagata Das] Refactored streaming kinesis guide and made many

git commit: [SPARK-1981][Streaming][Hotfix] Fixed docs related to kinesis

Repository: spark Updated Branches: refs/heads/master aa7de128c - e9bb12bea [SPARK-1981][Streaming][Hotfix] Fixed docs related to kinesis - Include kinesis in the unidocs - Hide non-public classes from docs Author: Tathagata Das tathagata.das1...@gmail.com Closes #2239 from tdas/kinesis-doc

git commit: [SPARK-1981][Streaming][Hotfix] Fixed docs related to kinesis

Repository: spark Updated Branches: refs/heads/branch-1.1 9b0cff2d4 - 0c8183cb3 [SPARK-1981][Streaming][Hotfix] Fixed docs related to kinesis - Include kinesis in the unidocs - Hide non-public classes from docs Author: Tathagata Das tathagata.das1...@gmail.com Closes #2239 from tdas/kinesis

git commit: SPARK-2798 [BUILD] Correct several small errors in Flume module pom.xml files

Repository: spark Updated Branches: refs/heads/master 220f41368 - cd30db566 SPARK-2798 [BUILD] Correct several small errors in Flume module pom.xml files (EDIT) Since the scalatest issue was since resolved, this is now about a few small problems in the Flume Sink `pom.xml` - `scalatest` is

git commit: [SPARK-3054][STREAMING] Add unit tests for Spark Sink.

Repository: spark Updated Branches: refs/heads/branch-1.1 5b22ebf68 - 9b2909955 [SPARK-3054][STREAMING] Add unit tests for Spark Sink. This patch adds unit tests for Spark Sink. It also removes the private[flume] for Spark Sink, since the sink is instantiated from Flume configuration (looks

[1/2] git commit: [HOTFIX][Streaming] Handle port collisions in flume polling test

Repository: spark Updated Branches: refs/heads/branch-1.1 eba399b3c - 44856654c [HOTFIX][Streaming] Handle port collisions in flume polling test This is failing my tests in #1777. @tdas Author: Andrew Or andrewo...@gmail.com Closes #1803 from andrewor14/fix-flaky-streaming-test and squashes

git commit: [SPARK-3128][MLLIB] Use streaming test suite for StreamingLR

``streaming`` - Rewrote accuracy and convergence tests to use ``setupStreams`` and ``runStreams`` - Added new test for the accuracy of predictions generated by ``predictOnValue`` These tests should run faster, be easier to extend/maintain, and provide a reference for new tests. mengxr tdas Author

git commit: [SPARK-3128][MLLIB] Use streaming test suite for StreamingLR

``streaming`` - Rewrote accuracy and convergence tests to use ``setupStreams`` and ``runStreams`` - Added new test for the accuracy of predictions generated by ``predictOnValue`` These tests should run faster, be easier to extend/maintain, and provide a reference for new tests. mengxr tdas

git commit: [SPARK-1981] updated streaming-kinesis.md

Repository: spark Updated Branches: refs/heads/master bfa09b01d - 99243288b [SPARK-1981] updated streaming-kinesis.md fixed markup, separated out sections more-clearly, more thorough explanations Author: Chris Fregly ch...@fregly.com Closes #1757 from cfregly/master and squashes the

git commit: [SPARK-1981] updated streaming-kinesis.md

Repository: spark Updated Branches: refs/heads/branch-1.1 4f776dfab - 826356725 [SPARK-1981] updated streaming-kinesis.md fixed markup, separated out sections more-clearly, more thorough explanations Author: Chris Fregly ch...@fregly.com Closes #1757 from cfregly/master and squashes the

git commit: [HOTFIX][STREAMING] Allow the JVM/Netty to decide which port to bind to in Flume Polling Tests.

Repository: spark Updated Branches: refs/heads/master 99243288b - 95470a03a [HOTFIX][STREAMING] Allow the JVM/Netty to decide which port to bind to in Flume Polling Tests. Author: Hari Shreedharan harishreedha...@gmail.com Closes #1820 from harishreedharan/use-free-ports and squashes the

git commit: [HOTFIX][Streaming] Handle port collisions in flume polling test

Repository: spark Updated Branches: refs/heads/master e537b33c6 - c6889d2cb [HOTFIX][Streaming] Handle port collisions in flume polling test This is failing my tests in #1777. @tdas Author: Andrew Or andrewo...@gmail.com Closes #1803 from andrewor14/fix-flaky-streaming-test and squashes

git commit: [SPARK-1022][Streaming] Add Kafka real unit test

. @tdas, would you mind reviewing this PR? Thanks a lot. Author: jerryshao saisai.s...@intel.com Closes #1751 from jerryshao/kafka-unit-test and squashes the following commits: b6a505f [jerryshao] code refactor according to comments 5222330 [jerryshao] Change JavaKafkaStreamSuite to better test

git commit: [SPARK-1022][Streaming] Add Kafka real unit test

issues. @tdas, would you mind reviewing this PR? Thanks a lot. Author: jerryshao saisai.s...@intel.com Closes #1751 from jerryshao/kafka-unit-test and squashes the following commits: b6a505f [jerryshao] code refactor according to comments 5222330 [jerryshao] Change JavaKafkaStreamSuite to better test

svn commit: r1616049 - in /spark: ./ _layouts/ news/_posts/ releases/_posts/ site/ site/docs/ site/docs/1.0.2/ site/docs/1.0.2/api/ site/docs/1.0.2/api/java/ site/docs/1.0.2/api/java/org/ site/docs/1.

Author: tdas Date: Tue Aug 5 23:40:54 2014 New Revision: 1616049 URL: http://svn.apache.org/r1616049 Log: Adding Spark 1.0.2 [This commit notification would consist of 386 parts, which exceeds the limit of 50 ones, so it was shortened to the summary

svn commit: r1616050 - in /spark: news/_posts/2014-08-05-spark-1-0-2-released.md site/news/index.html site/news/spark-1-0-2-released.html

Author: tdas Date: Tue Aug 5 23:43:56 2014 New Revision: 1616050 URL: http://svn.apache.org/r1616050 Log: Small update to Spark 1.0.2. Modified: spark/news/_posts/2014-08-05-spark-1-0-2-released.md spark/site/news/index.html spark/site/news/spark-1-0-2-released.html Modified: spark

svn commit: r6045 - /dev/spark/spark-1.0.2-rc1/

Author: tdas Date: Tue Aug 5 00:19:19 2014 New Revision: 6045 Log: Adding spark-1.0.2-rc1 Added: dev/spark/spark-1.0.2-rc1/ dev/spark/spark-1.0.2-rc1/spark-1.0.2-bin-cdh4.tgz (with props) dev/spark/spark-1.0.2-rc1/spark-1.0.2-bin-cdh4.tgz.asc dev/spark/spark-1.0.2-rc1/spark

Git Push Summary

Repository: spark Updated Tags: refs/tags/v0.7.0-bizo-1 [created] 02b4a0d96 refs/tags/v0.9.1-rc1 [created] 20a2d247a refs/tags/v0.9.1-rc2 [created] 95d70498b refs/tags/v0.9.1-rc3 [created] 931ac8a0e refs/tags/v1.0.0-rc1 [created] c8d0eb980 refs/tags/v1.0.0-rc10 [created] eafc6f6f4

Git Push Summary

Repository: spark Updated Tags: refs/tags/v1.0.0-rc2 [deleted] 327ab1e24 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

Repository: spark Updated Tags: refs/tags/v1.0.0-rc7 [deleted] bc81ecfdc - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

Repository: spark Updated Tags: refs/tags/v1.0.0-rc6 [deleted] aab03f5f9 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

Repository: spark Updated Tags: refs/tags/v1.0.0-rc8 [deleted] 9abe0192a - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

Repository: spark Updated Tags: refs/tags/v1.0.1-rc1 [deleted] 2a9114542 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

Repository: spark Updated Tags: refs/tags/v1.0.0-rc10 [deleted] eafc6f6f4 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

Repository: spark Updated Tags: refs/tags/v0.9.2-rc1 [deleted] 5a3020615 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

Repository: spark Updated Tags: refs/tags/v0.9.1-rc3 [deleted] 931ac8a0e - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

Repository: spark Updated Tags: refs/tags/v0.9.1-rc1 [deleted] 20a2d247a - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

Repository: spark Updated Tags: refs/tags/v0.9.1-rc2 [deleted] 95d70498b - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

Git Push Summary

Repository: spark Updated Tags: refs/tags/v1.0.2-rc1 [deleted] 913e3de6d - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

git commit: Updating version for Spark 1.0.3 development.

Repository: spark Updated Branches: refs/heads/branch-1.0 439cdc581 - 3fbe3447e Updating version for Spark 1.0.3 development. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/3fbe3447 Tree:

svn commit: r6047 - /dev/spark/spark-1.0.2-rc1/ /release/spark/spark-1.0.2/

Author: tdas Date: Tue Aug 5 01:53:43 2014 New Revision: 6047 Log: Moving Spark 1.0.2 from dev to release. Added: release/spark/spark-1.0.2/ - copied from r6046, dev/spark/spark-1.0.2-rc1/ Removed: dev/spark/spark-1.0.2-rc1

[1/2] [SPARK-1981] Add AWS Kinesis streaming support

Repository: spark Updated Branches: refs/heads/master 67bd8e3c2 - 91f9504e6 http://git-wip-us.apache.org/repos/asf/spark/blob/91f9504e/extras/kinesis-asl/src/test/scala/org/apache/spark/streaming/kinesis/KinesisReceiverSuite.scala

[2/2] git commit: [SPARK-1981] Add AWS Kinesis streaming support

[SPARK-1981] Add AWS Kinesis streaming support Author: Chris Fregly ch...@fregly.com Closes #1434 from cfregly/master and squashes the following commits: 4774581 [Chris Fregly] updated docs, renamed retry to retryRandom to be more clear, removed retries around store() method 0393795 [Chris

[2/2] git commit: [SPARK-1981] Add AWS Kinesis streaming support

[SPARK-1981] Add AWS Kinesis streaming support Author: Chris Fregly ch...@fregly.com Closes #1434 from cfregly/master and squashes the following commits: 4774581 [Chris Fregly] updated docs, renamed retry to retryRandom to be more clear, removed retries around store() method 0393795 [Chris

[1/2] [SPARK-1981] Add AWS Kinesis streaming support

Repository: spark Updated Branches: refs/heads/branch-1.1 91de0dc16 - bb0ac6d7c http://git-wip-us.apache.org/repos/asf/spark/blob/bb0ac6d7/extras/kinesis-asl/src/test/scala/org/apache/spark/streaming/kinesis/KinesisReceiverSuite.scala

git commit: [SPARK-2103][Streaming] Change to ClassTag for KafkaInputDStream and fix reflection issue

Repository: spark Updated Branches: refs/heads/master 284771efb - a32f0fb73 [SPARK-2103][Streaming] Change to ClassTag for KafkaInputDStream and fix reflection issue This PR updates previous Manifest for KafkaInputDStream's Decoder to ClassTag, also fix the problem addressed in

git commit: [SPARK-2379] Fix the bug that streaming's receiver may fall into a dead loop

Repository: spark Updated Branches: refs/heads/master f5d9bea20 - b270309d7 [SPARK-2379] Fix the bug that streaming's receiver may fall into a dead loop Author: joyyoj suns...@gmail.com Closes #1694 from joyyoj/SPARK-2379 and squashes the following commits: d73790d [joyyoj] SPARK-2379 Fix

git commit: [SPARK-2379] Fix the bug that streaming's receiver may fall into a dead loop

Repository: spark Updated Branches: refs/heads/branch-1.0 886508d3b - 952e0d698 [SPARK-2379] Fix the bug that streaming's receiver may fall into a dead loop Author: joyyoj suns...@gmail.com Closes #1694 from joyyoj/SPARK-2379 and squashes the following commits: d73790d [joyyoj] SPARK-2379

git commit: [maven-release-plugin] prepare release v1.0.2-rc1

Repository: spark Updated Branches: refs/heads/branch-1.0 797c663ae - 919c87f26 [maven-release-plugin] prepare release v1.0.2-rc1 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/919c87f2 Tree:

Git Push Summary

Repository: spark Updated Tags: refs/tags/v1.0.2-rc1 [created] 86a5fc071

git commit: [maven-release-plugin] prepare for next development iteration

Repository: spark Updated Branches: refs/heads/branch-1.0 919c87f26 - edbd02fc6 [maven-release-plugin] prepare for next development iteration Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/edbd02fc Tree:

[2/2] git commit: Revert [maven-release-plugin] prepare release v1.0.2-rc1

Revert [maven-release-plugin] prepare release v1.0.2-rc1 This reverts commit 919c87f26a2655bfd5ae03958915b6804367c1d6. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/01fc6d88 Tree:

git commit: [maven-release-plugin] prepare release v1.0.2-rc1

Repository: spark Updated Branches: refs/heads/branch-1.0 01fc6d885 - 08f601328 [maven-release-plugin] prepare release v1.0.2-rc1 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/08f60132 Tree:

git commit: [maven-release-plugin] prepare for next development iteration

Repository: spark Updated Branches: refs/heads/branch-1.0 08f601328 - 54df1b8c3 [maven-release-plugin] prepare for next development iteration Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/54df1b8c Tree:

Git Push Summary

Repository: spark Updated Tags: refs/tags/v1.0.2-rc1 [created] 6053ff1be

git commit: Updated CHANGES.txt

Repository: spark Updated Branches: refs/heads/branch-1.0 54df1b8c3 - 76117baa7 Updated CHANGES.txt Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/76117baa Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/76117baa

[1/2] git commit: Revert [maven-release-plugin] prepare for next development iteration

Repository: spark Updated Branches: refs/heads/branch-1.0 76117baa7 - 4be1dbd82 Revert [maven-release-plugin] prepare for next development iteration This reverts commit 54df1b8c31fa2de5b04ee4a5563706b2664f34f3. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

[2/2] git commit: Revert [maven-release-plugin] prepare release v1.0.2-rc1

Revert [maven-release-plugin] prepare release v1.0.2-rc1 This reverts commit 08f601328ad9e7334ef7deb3a9fff1343a3c4f30. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/4be1dbd8 Tree:

Git Push Summary

Repository: spark Updated Tags: refs/tags/v1.0.2-rc1 [deleted] 6053ff1be

git commit: [maven-release-plugin] prepare release v1.0.2-rc1

Repository: spark Updated Branches: refs/heads/branch-1.0 4be1dbd82 - 8fb6f00e1 [maven-release-plugin] prepare release v1.0.2-rc1 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/8fb6f00e Tree:

Git Push Summary

Repository: spark Updated Tags: refs/tags/v1.0.2-rc1 [created] 913e3de6d

git commit: [maven-release-plugin] prepare for next development iteration

Repository: spark Updated Branches: refs/heads/branch-1.0 8fb6f00e1 - 03b684253 [maven-release-plugin] prepare for next development iteration Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/03b68425 Tree:

git commit: [SPARK-2464][Streaming] Fixed Twitter stream stopping bug

caused the Receiver to be restarted. This patch check whether the receiver was stopped or not, and accordingly restarts on exception. Author: Tathagata Das tathagata.das1...@gmail.com Closes #1577 from tdas/twitter-stop and squashes the following commits: 011b525 [Tathagata Das] Fixed Twitter

git commit: [SPARK-2464][Streaming] Fixed Twitter stream stopping bug

. This exception caused the Receiver to be restarted. This patch check whether the receiver was stopped or not, and accordingly restarts on exception. Author: Tathagata Das tathagata.das1...@gmail.com Closes #1577 from tdas/twitter-stop and squashes the following commits: 011b525 [Tathagata Das] Fixed Twitter

[3/3] git commit: Updating versions for 1.0.2 release.

Updating versions for 1.0.2 release. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/70109da2 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/70109da2 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/70109da2

[1/3] git commit: Revert [maven-release-plugin] prepare for next development iteration

Repository: spark Updated Branches: refs/heads/branch-1.0 53b4e0f95 - 70109da21 Revert [maven-release-plugin] prepare for next development iteration This reverts commit baf92a0f2119867b1be540085ebe9f1a1c411ae8. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

git commit: SPARK-1478.2 Fix incorrect NioServerSocketChannelFactory constructor call

Repository: spark Updated Branches: refs/heads/master d988d345d - 1fcd5dcdd SPARK-1478.2 Fix incorrect NioServerSocketChannelFactory constructor call The line break inadvertently means this was interpreted as a call to the no-arg constructor. This doesn't exist in older Netty even. (Also

git commit: [SPARK-1478].3: Upgrade FlumeInputDStream's FlumeReceiver to support FLUME-1915

. Author: tmalaska ted.mala...@cloudera.com Author: Tathagata Das tathagata.das1...@gmail.com Closes #1347 from tdas/FLUME-1915 and squashes the following commits: 96065df [Tathagata Das] Added Mima exclusion for FlumeReceiver. 41d5338 [tmalaska] Address line 57 that was too long 12617e5 [tmalaska

git commit: [SPARK-1341] [Streaming] Throttle BlockGenerator to limit rate of data consumption.

Repository: spark Updated Branches: refs/heads/master 40a8fef4e - 2dd672485 [SPARK-1341] [Streaming] Throttle BlockGenerator to limit rate of data consumption. Author: Issac Buenrostro buenros...@ooyala.com Closes #945 from ibuenros/SPARK-1341-throttle and squashes the following commits:

git commit: [SPARK-1341] [Streaming] Throttle BlockGenerator to limit rate of data consumption.

Repository: spark Updated Branches: refs/heads/branch-1.0 cb443cf6c - ca19cfbcd [SPARK-1341] [Streaming] Throttle BlockGenerator to limit rate of data consumption. Author: Issac Buenrostro buenros...@ooyala.com Closes #945 from ibuenros/SPARK-1341-throttle and squashes the following

git commit: [STREAMING] SPARK-2343: Fix QueueInputDStream with oneAtATime false

Repository: spark Updated Branches: refs/heads/branch-1.0 d569838bc - 21fae6d3e [STREAMING] SPARK-2343: Fix QueueInputDStream with oneAtATime false Fix QueueInputDStream which was not removing dequeued items when used with the oneAtATime flag disabled. Author: Manuel Laflamme

git commit: [SPARK-2362] Fix for newFilesOnly logic in file DStream

Repository: spark Updated Branches: refs/heads/branch-1.0 1c12b0b5c - 885489112 [SPARK-2362] Fix for newFilesOnly logic in file DStream The newFilesOnly logic should be inverted: the logic should be that if the flag newFilesOnly==true then only start reading files older than current time. As

git commit: Streaming programming guide typos

Repository: spark Updated Branches: refs/heads/master d4c30cd99 - fdc4c112e Streaming programming guide typos Fix a bad Java code sample and a broken link in the streaming programming guide. Author: Clément MATHIEU clem...@unportant.info Closes #1286 from

[3/3] git commit: Updated CHANGES.txt

Updated CHANGES.txt Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/caed16e4 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/caed16e4 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/caed16e4 Branch:

[1/3] git commit: Revert [maven-release-plugin] prepare for next development iteration

Repository: spark Updated Branches: refs/heads/branch-1.0 18c77cb53 - caed16e4c Revert [maven-release-plugin] prepare for next development iteration This reverts commit 832dc594e7666f1d402334f8015ce29917d9c888. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

<    3   4   5   6   7   8   9   >