Repository: bahir Updated Branches: refs/heads/master e491610d8 -> 49cde19a9
[MINOR] Use jekyll template to describe Spark and Scala version Project: http://git-wip-us.apache.org/repos/asf/bahir/repo Commit: http://git-wip-us.apache.org/repos/asf/bahir/commit/49cde19a Tree: http://git-wip-us.apache.org/repos/asf/bahir/tree/49cde19a Diff: http://git-wip-us.apache.org/repos/asf/bahir/diff/49cde19a Branch: refs/heads/master Commit: 49cde19a95d66bc38230eec71eec6ea51ffa2589 Parents: e491610 Author: Luciano Resende <[email protected]> Authored: Tue Aug 15 13:27:19 2017 -0600 Committer: Luciano Resende <[email protected]> Committed: Wed Aug 16 09:16:51 2017 -0600 ---------------------------------------------------------------------- sql-cloudant/README.md | 16 ++++++++-------- sql-streaming-akka/README.md | 8 ++++---- sql-streaming-mqtt/README.md | 8 ++++---- streaming-akka/README.md | 8 ++++---- streaming-mqtt/README.md | 8 ++++---- streaming-pubsub/README.md | 8 ++++---- streaming-twitter/README.md | 8 ++++---- streaming-zeromq/README.md | 8 ++++---- 8 files changed, 36 insertions(+), 36 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/bahir/blob/49cde19a/sql-cloudant/README.md ---------------------------------------------------------------------- diff --git a/sql-cloudant/README.md b/sql-cloudant/README.md index 4fd1c9c..18118eb 100644 --- a/sql-cloudant/README.md +++ b/sql-cloudant/README.md @@ -12,30 +12,30 @@ clusters, desktop PCs, and mobile devices. Using SBT: - libraryDependencies += "org.apache.bahir" %% "spark-sql-cloudant" % "2.2.0-SNAPSHOT" + libraryDependencies += "org.apache.bahir" %% "spark-sql-cloudant" % "{{site.SPARK_VERSION}}" Using Maven: <dependency> <groupId>org.apache.bahir</groupId> - <artifactId>spark-sql-cloudant_2.11</artifactId> - <version>2.2.0-SNAPSHOT</version> + <artifactId>spark-sql-cloudant_{{site.SCALA_BINARY_VERSION}}</artifactId> + <version>{{site.SPARK_VERSION}}</version> </dependency> This library can also be added to Spark jobs launched through `spark-shell` or `spark-submit` by using the `--packages` command line option. - $ bin/spark-shell --packages org.apache.bahir:spark-sql-cloudant_2.11:2.2.0-SNAPSHOT + $ bin/spark-shell --packages org.apache.bahir:spark-sql-cloudant_{{site.SCALA_BINARY_VERSION}}:{{site.SPARK_VERSION}} Unlike using `--jars`, using `--packages` ensures that this library and its dependencies will be added to the classpath. The `--packages` argument can also be used with `bin/spark-submit`. Submit a job in Python: - spark-submit --master local[4] --packages org.apache.bahir:spark-sql-cloudant_SCALA_VERSION:PACKAGE_VERSION <path to python script> + spark-submit --master local[4] --packages org.apache.bahir:spark-sql-cloudant__{{site.SCALA_BINARY_VERSION}}:{{site.SPARK_VERSION}} <path to python script> Submit a job in Scala: - spark-submit --class "<your class>" --master local[4] --packages org.apache.bahir:spark-sql-cloudant_SCALA_VERSION:PACKAGE_VERSION <path to spark-sql-cloudant jar> + spark-submit --class "<your class>" --master local[4] --packages org.apache.bahir:spark-sql-cloudant__{{site.SCALA_BINARY_VERSION}}:{{site.SPARK_VERSION}} <path to spark-sql-cloudant jar> This library is compiled for Scala 2.11 only, and intends to support Spark 2.0 onwards. @@ -163,7 +163,7 @@ See [CloudantApp.py](examples/python/CloudantApp.py) for examples. Submit job example: ``` -spark-submit --packages org.apache.bahir:spark-sql-cloudant_2.11:2.2.0-SNAPSHOT --conf spark.cloudant.host=ACCOUNT.cloudant.com --conf spark.cloudant.username=USERNAME --conf spark.cloudant.password=PASSWORD sql-cloudant/examples/python/CloudantApp.py +spark-submit --packages org.apache.bahir:spark-sql-cloudant_{{site.SCALA_BINARY_VERSION}}:{{site.SPARK_VERSION}} --conf spark.cloudant.host=ACCOUNT.cloudant.com --conf spark.cloudant.username=USERNAME --conf spark.cloudant.password=PASSWORD sql-cloudant/examples/python/CloudantApp.py ``` #### Using DataFrame In Python @@ -233,7 +233,7 @@ See [CloudantApp.scala](examples/scala/src/main/scala/mytest/spark/CloudantApp.s Submit job example: ``` -spark-submit --class org.apache.spark.examples.sql.cloudant.CloudantApp --packages org.apache.bahir:spark-sql-cloudant_2.11:2.2.0-SNAPSHOT --conf spark.cloudant.host=ACCOUNT.cloudant.com --conf spark.cloudant.username=USERNAME --conf spark.cloudant.password=PASSWORD /path/to/spark-sql-cloudant_2.11-2.2.0-SNAPSHOT-tests.jar +spark-submit --class org.apache.spark.examples.sql.cloudant.CloudantApp --packages org.apache.bahir:spark-sql-cloudant_{{site.SCALA_BINARY_VERSION}}:{{site.SPARK_VERSION}} --conf spark.cloudant.host=ACCOUNT.cloudant.com --conf spark.cloudant.username=USERNAME --conf spark.cloudant.password=PASSWORD /path/to/spark-sql-cloudant_{{site.SCALA_BINARY_VERSION}}-{{site.SPARK_VERSION}}-tests.jar ``` ### Using DataFrame In Scala http://git-wip-us.apache.org/repos/asf/bahir/blob/49cde19a/sql-streaming-akka/README.md ---------------------------------------------------------------------- diff --git a/sql-streaming-akka/README.md b/sql-streaming-akka/README.md index b64a8e2..3d9d17b 100644 --- a/sql-streaming-akka/README.md +++ b/sql-streaming-akka/README.md @@ -4,20 +4,20 @@ A library for reading data from Akka Actors using Spark SQL Streaming ( or Struc Using SBT: - libraryDependencies += "org.apache.bahir" %% "spark-sql-streaming-akka" % "2.2.0-SNAPSHOT" + libraryDependencies += "org.apache.bahir" %% "spark-sql-streaming-akka" % "{{site.SPARK_VERSION}}" Using Maven: <dependency> <groupId>org.apache.bahir</groupId> - <artifactId>spark-sql-streaming-akka_2.11</artifactId> - <version>2.2.0-SNAPSHOT</version> + <artifactId>spark-sql-streaming-akka_{{site.SCALA_BINARY_VERSION}}</artifactId> + <version>{{site.SPARK_VERSION}}</version> </dependency> This library can also be added to Spark jobs launched through `spark-shell` or `spark-submit` by using the `--packages` command line option. For example, to include it when starting the spark shell: - $ bin/spark-shell --packages org.apache.bahir:spark-sql-streaming-akka_2.11:2.2.0-SNAPSHOT + $ bin/spark-shell --packages org.apache.bahir:spark-sql-streaming-akka_{{site.SCALA_BINARY_VERSION}}:{{site.SPARK_VERSION}} Unlike using `--jars`, using `--packages` ensures that this library and its dependencies will be added to the classpath. The `--packages` argument can also be used with `bin/spark-submit`. http://git-wip-us.apache.org/repos/asf/bahir/blob/49cde19a/sql-streaming-mqtt/README.md ---------------------------------------------------------------------- diff --git a/sql-streaming-mqtt/README.md b/sql-streaming-mqtt/README.md index c9ea8cf..2cfbe0f 100644 --- a/sql-streaming-mqtt/README.md +++ b/sql-streaming-mqtt/README.md @@ -4,20 +4,20 @@ A library for reading data from MQTT Servers using Spark SQL Streaming ( or Stru Using SBT: - libraryDependencies += "org.apache.bahir" %% "spark-sql-streaming-mqtt" % "2.1.0-SNAPSHOT" + libraryDependencies += "org.apache.bahir" %% "spark-sql-streaming-mqtt" % "{{site.SPARK_VERSION}}" Using Maven: <dependency> <groupId>org.apache.bahir</groupId> - <artifactId>spark-sql-streaming-mqtt_2.11</artifactId> - <version>2.1.0-SNAPSHOT</version> + <artifactId>spark-sql-streaming-mqtt_{{site.SCALA_BINARY_VERSION}}</artifactId> + <version>{{site.SPARK_VERSION}}</version> </dependency> This library can also be added to Spark jobs launched through `spark-shell` or `spark-submit` by using the `--packages` command line option. For example, to include it when starting the spark shell: - $ bin/spark-shell --packages org.apache.bahir:spark-sql-streaming-mqtt_2.11:2.1.0-SNAPSHOT + $ bin/spark-shell --packages org.apache.bahir:spark-sql-streaming-mqtt_{{site.SCALA_BINARY_VERSION}}:{{site.SPARK_VERSION}} Unlike using `--jars`, using `--packages` ensures that this library and its dependencies will be added to the classpath. The `--packages` argument can also be used with `bin/spark-submit`. http://git-wip-us.apache.org/repos/asf/bahir/blob/49cde19a/streaming-akka/README.md ---------------------------------------------------------------------- diff --git a/streaming-akka/README.md b/streaming-akka/README.md index 9c642aa..f57583e 100644 --- a/streaming-akka/README.md +++ b/streaming-akka/README.md @@ -5,20 +5,20 @@ A library for reading data from Akka Actors using Spark Streaming. Using SBT: - libraryDependencies += "org.apache.bahir" %% "spark-streaming-akka" % "2.1.0-SNAPSHOT" + libraryDependencies += "org.apache.bahir" %% "spark-streaming-akka" % "{{site.SPARK_VERSION}}" Using Maven: <dependency> <groupId>org.apache.bahir</groupId> - <artifactId>spark-streaming-akka_2.11</artifactId> - <version>2.1.0-SNAPSHOT</version> + <artifactId>spark-streaming-akka_{{site.SCALA_BINARY_VERSION}}</artifactId> + <version>{{site.SPARK_VERSION}}</version> </dependency> This library can also be added to Spark jobs launched through `spark-shell` or `spark-submit` by using the `--packages` command line option. For example, to include it when starting the spark shell: - $ bin/spark-shell --packages org.apache.bahir:spark-streaming-akka_2.11:2.1.0-SNAPSHOT + $ bin/spark-shell --packages org.apache.bahir:spark-streaming-akka_{{site.SCALA_BINARY_VERSION}}:{{site.SPARK_VERSION}} Unlike using `--jars`, using `--packages` ensures that this library and its dependencies will be added to the classpath. The `--packages` argument can also be used with `bin/spark-submit`. http://git-wip-us.apache.org/repos/asf/bahir/blob/49cde19a/streaming-mqtt/README.md ---------------------------------------------------------------------- diff --git a/streaming-mqtt/README.md b/streaming-mqtt/README.md index 5117594..644e5fb 100644 --- a/streaming-mqtt/README.md +++ b/streaming-mqtt/README.md @@ -5,20 +5,20 @@ Using SBT: - libraryDependencies += "org.apache.bahir" %% "spark-streaming-mqtt" % "2.1.0-SNAPSHOT" + libraryDependencies += "org.apache.bahir" %% "spark-streaming-mqtt" % "{{site.SPARK_VERSION}}" Using Maven: <dependency> <groupId>org.apache.bahir</groupId> - <artifactId>spark-streaming-mqtt_2.11</artifactId> - <version>2.1.0-SNAPSHOT</version> + <artifactId>spark-streaming-mqtt_{{site.SCALA_BINARY_VERSION}}</artifactId> + <version>{{site.SPARK_VERSION}}</version> </dependency> This library can also be added to Spark jobs launched through `spark-shell` or `spark-submit` by using the `--packages` command line option. For example, to include it when starting the spark shell: - $ bin/spark-shell --packages org.apache.bahir:spark-streaming-mqtt_2.11:2.1.0-SNAPSHOT + $ bin/spark-shell --packages org.apache.bahir:spark-streaming-mqtt_{{site.SCALA_BINARY_VERSION}}:{{site.SPARK_VERSION}} Unlike using `--jars`, using `--packages` ensures that this library and its dependencies will be added to the classpath. The `--packages` argument can also be used with `bin/spark-submit`. http://git-wip-us.apache.org/repos/asf/bahir/blob/49cde19a/streaming-pubsub/README.md ---------------------------------------------------------------------- diff --git a/streaming-pubsub/README.md b/streaming-pubsub/README.md index db207ae..a8f374f 100644 --- a/streaming-pubsub/README.md +++ b/streaming-pubsub/README.md @@ -4,20 +4,20 @@ A library for reading data from [Google Cloud Pub/Sub](https://cloud.google.com/ Using SBT: - libraryDependencies += "org.apache.bahir" %% "spark-streaming-pubsub" % "2.2.0-SNAPSHOT" + libraryDependencies += "org.apache.bahir" %% "spark-streaming-pubsub" % "{{site.SPARK_VERSION}}" Using Maven: <dependency> <groupId>org.apache.bahir</groupId> - <artifactId>spark-streaming-pubsub_2.11</artifactId> - <version>2.2.0-SNAPSHOT</version> + <artifactId>spark-streaming-pubsub_{{site.SCALA_BINARY_VERSION}}</artifactId> + <version>{{site.SPARK_VERSION}}</version> </dependency> This library can also be added to Spark jobs launched through `spark-shell` or `spark-submit` by using the `--packages` command line option. For example, to include it when starting the spark shell: - $ bin/spark-shell --packages org.apache.bahir:spark-streaming-pubsub_2.11:2.2.0-SNAPSHOT + $ bin/spark-shell --packages org.apache.bahir:spark-streaming-pubsub_{{site.SCALA_BINARY_VERSION}}:{{site.SPARK_VERSION}} Unlike using `--jars`, using `--packages` ensures that this library and its dependencies will be added to the classpath. The `--packages` argument can also be used with `bin/spark-submit`. http://git-wip-us.apache.org/repos/asf/bahir/blob/49cde19a/streaming-twitter/README.md ---------------------------------------------------------------------- diff --git a/streaming-twitter/README.md b/streaming-twitter/README.md index 18f228f..0b3d37a 100644 --- a/streaming-twitter/README.md +++ b/streaming-twitter/README.md @@ -5,20 +5,20 @@ A library for reading social data from [twitter](http://twitter.com/) using Spar Using SBT: - libraryDependencies += "org.apache.bahir" %% "spark-streaming-twitter" % "2.1.0-SNAPSHOT" + libraryDependencies += "org.apache.bahir" %% "spark-streaming-twitter" % "{{site.SPARK_VERSION}}" Using Maven: <dependency> <groupId>org.apache.bahir</groupId> - <artifactId>spark-streaming-twitter_2.11</artifactId> - <version>2.1.0-SNAPSHOT</version> + <artifactId>spark-streaming-twitter_{{site.SCALA_BINARY_VERSION}}</artifactId> + <version>{{site.SPARK_VERSION}}</version> </dependency> This library can also be added to Spark jobs launched through `spark-shell` or `spark-submit` by using the `--packages` command line option. For example, to include it when starting the spark shell: - $ bin/spark-shell --packages org.apache.bahir:spark-streaming-twitter_2.11:2.1.0-SNAPSHOT + $ bin/spark-shell --packages org.apache.bahir:spark-streaming-twitter_{{site.SCALA_BINARY_VERSION}}:{{site.SPARK_VERSION}} Unlike using `--jars`, using `--packages` ensures that this library and its dependencies will be added to the classpath. The `--packages` argument can also be used with `bin/spark-submit`. http://git-wip-us.apache.org/repos/asf/bahir/blob/49cde19a/streaming-zeromq/README.md ---------------------------------------------------------------------- diff --git a/streaming-zeromq/README.md b/streaming-zeromq/README.md index 37835e3..952bb4f 100644 --- a/streaming-zeromq/README.md +++ b/streaming-zeromq/README.md @@ -5,20 +5,20 @@ A library for reading data from [ZeroMQ](http://zeromq.org/) using Spark Streami Using SBT: - libraryDependencies += "org.apache.bahir" %% "spark-streaming-zeromq" % "2.1.0-SNAPSHOT" + libraryDependencies += "org.apache.bahir" %% "spark-streaming-zeromq" % "{{site.SPARK_VERSION}}" Using Maven: <dependency> <groupId>org.apache.bahir</groupId> - <artifactId>spark-streaming-zeromq_2.11</artifactId> - <version>2.1.0-SNAPSHOT</version> + <artifactId>spark-streaming-zeromq_{{site.SCALA_BINARY_VERSION}}</artifactId> + <version>{{site.SPARK_VERSION}}</version> </dependency> This library can also be added to Spark jobs launched through `spark-shell` or `spark-submit` by using the `--packages` command line option. For example, to include it when starting the spark shell: - $ bin/spark-shell --packages org.apache.bahir:spark-streaming-zeromq_2.11:2.1.0-SNAPSHOT + $ bin/spark-shell --packages org.apache.bahir:spark-streaming-zeromq_{{site.SCALA_BINARY_VERSION}}:{{site.SPARK_VERSION}} Unlike using `--jars`, using `--packages` ensures that this library and its dependencies will be added to the classpath. The `--packages` argument can also be used with `bin/spark-submit`.
