Repository: spark Updated Branches: refs/heads/master 3ac609308 -> c57dfaef3
[MINOR][SS][DOCS] Minor doc change for kafka integration ## What changes were proposed in this pull request? Minor change to kafka integration document for structured streaming. ## How was this patch tested? N/A, doc change only. Author: Liang-Chi Hsieh <[email protected]> Closes #18550 from viirya/minor-ss-kafka-doc. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/c57dfaef Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/c57dfaef Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/c57dfaef Branch: refs/heads/master Commit: c57dfaef30dcf04d7c7911da1ac77679492d04c5 Parents: 3ac6093 Author: Liang-Chi Hsieh <[email protected]> Authored: Fri Jul 21 08:43:38 2017 +0100 Committer: Sean Owen <[email protected]> Committed: Fri Jul 21 08:43:38 2017 +0100 ---------------------------------------------------------------------- docs/structured-streaming-kafka-integration.md | 6 ++++++ 1 file changed, 6 insertions(+) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/spark/blob/c57dfaef/docs/structured-streaming-kafka-integration.md ---------------------------------------------------------------------- diff --git a/docs/structured-streaming-kafka-integration.md b/docs/structured-streaming-kafka-integration.md index 217c1a9..bab0be8 100644 --- a/docs/structured-streaming-kafka-integration.md +++ b/docs/structured-streaming-kafka-integration.md @@ -15,6 +15,8 @@ For Scala/Java applications using SBT/Maven project definitions, link your appli For Python applications, you need to add this above library and its dependencies when deploying your application. See the [Deploying](#deploying) subsection below. +For experimenting on `spark-shell`, you need to add this above library and its dependencies too when invoking `spark-shell`. Also see the [Deploying](#deploying) subsection below. + ## Reading Data from Kafka ### Creating a Kafka Source for Streaming Queries @@ -607,5 +609,9 @@ and its dependencies can be directly added to `spark-submit` using `--packages`, ./bin/spark-submit --packages org.apache.spark:spark-sql-kafka-0-10_{{site.SCALA_BINARY_VERSION}}:{{site.SPARK_VERSION_SHORT}} ... +For experimenting on `spark-shell`, you can also use `--packages` to add `spark-sql-kafka-0-10_{{site.SCALA_BINARY_VERSION}}` and its dependencies directly, + + ./bin/spark-shell --packages org.apache.spark:spark-sql-kafka-0-10_{{site.SCALA_BINARY_VERSION}}:{{site.SPARK_VERSION_SHORT}} ... + See [Application Submission Guide](submitting-applications.html) for more details about submitting applications with external dependencies. --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
