Repository: spark Updated Branches: refs/heads/master 8008f9cb8 -> f599cde69
[SPARK-24507][DOCUMENTATION] Update streaming guide ## What changes were proposed in this pull request? Updated streaming guide for direct stream and link to integration guide. ## How was this patch tested? jekyll build Author: Rekha Joshi <[email protected]> Closes #21683 from rekhajoshm/SPARK-24507. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/f599cde6 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/f599cde6 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/f599cde6 Branch: refs/heads/master Commit: f599cde69506a5aedeeec449cba9a8b5ab128282 Parents: 8008f9c Author: Rekha Joshi <[email protected]> Authored: Mon Jul 2 22:39:00 2018 +0800 Committer: hyukjinkwon <[email protected]> Committed: Mon Jul 2 22:39:00 2018 +0800 ---------------------------------------------------------------------- docs/streaming-programming-guide.md | 2 ++ 1 file changed, 2 insertions(+) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/spark/blob/f599cde6/docs/streaming-programming-guide.md ---------------------------------------------------------------------- diff --git a/docs/streaming-programming-guide.md b/docs/streaming-programming-guide.md index c309592..118b053 100644 --- a/docs/streaming-programming-guide.md +++ b/docs/streaming-programming-guide.md @@ -2176,6 +2176,8 @@ the input data stream (using `inputStream.repartition(<number of partitions>)`). This distributes the received batches of data across the specified number of machines in the cluster before further processing. +For direct stream, please refer to [Spark Streaming + Kafka Integration Guide](streaming-kafka-integration.html) + ### Level of Parallelism in Data Processing {:.no_toc} Cluster resources can be under-utilized if the number of parallel tasks used in any stage of the --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
