Repository: bahir-website Updated Branches: refs/heads/asf-site cd7281713 -> 4c605a65c
http://git-wip-us.apache.org/repos/asf/bahir-website/blob/4c605a65/content/docs/spark/current/spark-sql-streaming-mqtt/index.html ---------------------------------------------------------------------- diff --git a/content/docs/spark/current/spark-sql-streaming-mqtt/index.html b/content/docs/spark/current/spark-sql-streaming-mqtt/index.html deleted file mode 100644 index 68b8ea6..0000000 --- a/content/docs/spark/current/spark-sql-streaming-mqtt/index.html +++ /dev/null @@ -1,321 +0,0 @@ - -<!DOCTYPE html> -<html lang="en"> - <head> - <meta charset="utf-8"> - <title>Spark Structured Streaming MQTT</title> - <meta name="description" content="Spark Structured Streaming MQTT"> - <meta name="author" content=""> - - <!-- Enable responsive viewport --> - <meta name="viewport" content="width=device-width, initial-scale=1.0"> - - <!-- Le HTML5 shim, for IE6-8 support of HTML elements --> - <!--[if lt IE 9]> - <script src="http://html5shim.googlecode.com/svn/trunk/html5.js";></script> - <![endif]--> - - <!-- Le styles --> - <link href="/assets/themes/apache-clean/bootstrap/css/bootstrap.css" rel="stylesheet"> - <link href="/assets/themes/apache-clean/css/style.css?body=1" rel="stylesheet" type="text/css"> - <link href="/assets/themes/apache-clean/css/syntax.css" rel="stylesheet" type="text/css" media="screen" /> - <!-- Le fav and touch icons --> - <!-- Update these with your own images - <link rel="shortcut icon" href="images/favicon.ico"> - <link rel="apple-touch-icon" href="images/apple-touch-icon.png"> - <link rel="apple-touch-icon" sizes="72x72" href="images/apple-touch-icon-72x72.png"> - <link rel="apple-touch-icon" sizes="114x114" href="images/apple-touch-icon-114x114.png"> - --> - - <!-- make tables sortable by adding class tag "sortable" to table elements --> - <script src="http://www.kryogenix.org/code/browser/sorttable/sorttable.js";></script> - - - </head> - - <body> - - - -<!-- Navigation --> -<div id="nav-bar"> - <nav id="nav-container" class="navbar navbar-inverse " role="navigation"> - <div class="container"> - <!-- Brand and toggle get grouped for better mobile display --> - - <div class="navbar-header page-scroll"> - <button type="button" class="navbar-toggle" data-toggle="collapse" data-target=".navbar-collapse"> - <span class="sr-only">Toggle navigation</span> - <span class="icon-bar"></span> - <span class="icon-bar"></span> - <span class="icon-bar"></span> - </button> - <a class="navbar-brand page-scroll" href="/#home">Home</a> - </div> - <!-- Collect the nav links, forms, and other content for toggling --> - <nav class="navbar-collapse collapse" role="navigation"> - <ul class="nav navbar-nav"> - - <li id="community"> - - <a href="#" data-toggle="dropdown" class="dropdown-toggle">Community<b class="caret"></b></a> - <ul class="dropdown-menu dropdown-left"> - - - <li><a href="/community" target="_self">Get Involved</a></li> - - - <li><a href="/contributing" target="_self">Contributing</a></li> - - - <li><a href="/contributing-extensions" target="_self">Contributing Extensions</a></li> - - - <li><a href="https://issues.apache.org/jira/browse/BAHIR"; target="_blank">Issue Tracker</a></li> - - - <li><a href="https://github.com/apache/bahir"; target="_blank">Source Code</a></li> - - - <li><a href="/community-members" target="_self">Project Committers</a></li> - - </ul> - - </li> - - <li id="documentation"> - - <a href="#" data-toggle="dropdown" class="dropdown-toggle">Documentation<b class="caret"></b></a> - <ul class="dropdown-menu dropdown-left"> - - - <li><a href="/docs/spark/current/documentation" target="_self">Bahir Spark Extensions - Current</a></li> - - - <li><a href="/docs/spark/2.0.0/documentation" target="_self">Bahir Spark Extensions - 2.0.0</a></li> - - </ul> - - </li> - - <li id="github"> - - - <a href="https://github.com/apache/bahir"; target="_blank">GitHub</a> - - </li> - - <li id="apache"> - - <a href="#" data-toggle="dropdown" class="dropdown-toggle">Apache<b class="caret"></b></a> - <ul class="dropdown-menu dropdown-left"> - - - <li><a href="http://www.apache.org/foundation/how-it-works.html"; target="_blank">Apache Software Foundation</a></li> - - - <li><a href="http://www.apache.org/licenses/"; target="_blank">Apache License</a></li> - - - <li><a href="http://www.apache.org/foundation/sponsorship"; target="_blank">Sponsorship</a></li> - - - <li><a href="http://www.apache.org/foundation/thanks.html"; target="_blank">Thanks</a></li> - - - <li><a href="/privacy-policy" target="_self">Privacy Policy</a></li> - - </ul> - - </li> - - </ul> - </nav><!--/.navbar-collapse --> - <!-- /.navbar-collapse --> - </div> - <!-- /.container --> - </nav> -</div> - - - <div class="container"> - - -<!--<div class="hero-unit Spark Structured Streaming MQTT"> - <h1></h1> -</div> ---> - -<div class="row"> - <div class="col-md-12"> - <!-- - ---> - -<p>A library for reading data from MQTT Servers using Spark SQL Streaming ( or Structured streaming.).</p> - -<h2 id="linking">Linking</h2> - -<p>Using SBT:</p> - -<pre><code>libraryDependencies += "org.apache.bahir" %% "spark-sql-streaming-mqtt" % "2.1.0-SNAPSHOT" -</code></pre> - -<p>Using Maven:</p> - -<pre><code><dependency> - <groupId>org.apache.bahir</groupId> - <artifactId>spark-sql-streaming-mqtt_2.11</artifactId> - <version>2.1.0-SNAPSHOT</version> -</dependency> -</code></pre> - -<p>This library can also be added to Spark jobs launched through <code>spark-shell</code> or <code>spark-submit</code> by using the <code>--packages</code> command line option. -For example, to include it when starting the spark shell:</p> - -<pre><code>$ bin/spark-shell --packages org.apache.bahir:spark-sql-streaming-mqtt_2.11:2.1.0-SNAPSHOT -</code></pre> - -<p>Unlike using <code>--jars</code>, using <code>--packages</code> ensures that this library and its dependencies will be added to the classpath. -The <code>--packages</code> argument can also be used with <code>bin/spark-submit</code>.</p> - -<p>This library is compiled for Scala 2.11 only, and intends to support Spark 2.0 onwards.</p> - -<h2 id="examples">Examples</h2> - -<p>A SQL Stream can be created with data streams received through MQTT Server using,</p> - -<pre><code>sqlContext.readStream - .format("org.apache.bahir.sql.streaming.mqtt.MQTTStreamSourceProvider") - .option("topic", "mytopic") - .load("tcp://localhost:1883") -</code></pre> - -<h2 id="enable-recovering-from-failures">Enable recovering from failures.</h2> - -<p>Setting values for option <code>localStorage</code> and <code>clientId</code> helps in recovering in case of a restart, by restoring the state where it left off before the shutdown.</p> - -<pre><code>sqlContext.readStream - .format("org.apache.bahir.sql.streaming.mqtt.MQTTStreamSourceProvider") - .option("topic", "mytopic") - .option("localStorage", "/path/to/localdir") - .option("clientId", "some-client-id") - .load("tcp://localhost:1883") -</code></pre> - -<h3 id="scala-api">Scala API</h3> - -<p>An example, for scala API to count words from incoming message stream.</p> - -<pre><code>// Create DataFrame representing the stream of input lines from connection to mqtt server -val lines = spark.readStream - .format("org.apache.bahir.sql.streaming.mqtt.MQTTStreamSourceProvider") - .option("topic", topic) - .load(brokerUrl).as[(String, Timestamp)] - -// Split the lines into words -val words = lines.map(_._1).flatMap(_.split(" ")) - -// Generate running word count -val wordCounts = words.groupBy("value").count() - -// Start running the query that prints the running counts to the console -val query = wordCounts.writeStream - .outputMode("complete") - .format("console") - .start() - -query.awaitTermination() -</code></pre> - -<p>Please see <code>MQTTStreamWordCount.scala</code> for full example.</p> - -<h3 id="java-api">Java API</h3> - -<p>An example, for Java API to count words from incoming message stream.</p> - -<pre><code>// Create DataFrame representing the stream of input lines from connection to mqtt server. -Dataset<String> lines = spark - .readStream() - .format("org.apache.bahir.sql.streaming.mqtt.MQTTStreamSourceProvider") - .option("topic", topic) - .load(brokerUrl).select("value").as(Encoders.STRING()); - -// Split the lines into words -Dataset<String> words = lines.flatMap(new FlatMapFunction<String, String>() { - @Override - public Iterator<String> call(String x) { - return Arrays.asList(x.split(" ")).iterator(); - } -}, Encoders.STRING()); - -// Generate running word count -Dataset<Row> wordCounts = words.groupBy("value").count(); - -// Start running the query that prints the running counts to the console -StreamingQuery query = wordCounts.writeStream() - .outputMode("complete") - .format("console") - .start(); - -query.awaitTermination(); -</code></pre> - -<p>Please see <code>JavaMQTTStreamWordCount.java</code> for full example.</p> - - - </div> -</div> - - - - <hr> - - <!-- <p>© 2016 </p>--> - <footer class="site-footer"> - <div class="wrapper"> - <div class="footer-col-wrapper"> - - <div style="text-align:center;"> - - <div> - Copyright © 2016 <a href="http://www.apache.org";>The Apache Software Foundation</a>. - Licensed under the <a href="http://www.apache.org/licenses/LICENSE-2.0";>Apache License, Version - 2.0</a>. - <br> - - Apache and the Apache Feather logo are trademarks of The Apache Software Foundation. - - </div> - </div> - </div> - </div> -</footer> - - </div> - - - - - <script type="text/javascript"> - (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){ - (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o), - m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m) - })(window,document,'script','//www.google-analytics.com/analytics.js','ga'); - - ga('create', 'UA-79140859-1', 'bahir.apache.org'); - ga('require', 'linkid', 'linkid.js'); - ga('send', 'pageview'); - -</script> - - - - <script src="/assets/themes/apache-clean/jquery/jquery-2.1.1.min.js"></script> - - <script src="/assets/themes/apache-clean/bootstrap/js/bootstrap.min.js"></script> - - - </body> -</html> - http://git-wip-us.apache.org/repos/asf/bahir-website/blob/4c605a65/content/docs/spark/current/spark-streaming-akka.template ---------------------------------------------------------------------- diff --git a/content/docs/spark/current/spark-streaming-akka.template b/content/docs/spark/current/spark-streaming-akka.template index a186641..bffb3ab 100644 --- a/content/docs/spark/current/spark-streaming-akka.template +++ b/content/docs/spark/current/spark-streaming-akka.template @@ -1,4 +1,5 @@ + <!DOCTYPE html> <html lang="en"> <head> @@ -92,6 +93,9 @@ <li><a href="/docs/spark/current/documentation" target="_self">Bahir Spark Extensions - Current</a></li> + <li><a href="/docs/spark/2.0.1/documentation" target="_self">Bahir Spark Extensions - 2.0.1</a></li> + + <li><a href="/docs/spark/2.0.0/documentation" target="_self">Bahir Spark Extensions - 2.0.0</a></li> </ul> @@ -141,6 +145,7 @@ <div class="container"> + <!--<div class="hero-unit Spark Streaming Akka"> <h1></h1> </div> @@ -154,6 +159,7 @@ + </div> </div> http://git-wip-us.apache.org/repos/asf/bahir-website/blob/4c605a65/content/docs/spark/current/spark-streaming-akka/index.html ---------------------------------------------------------------------- diff --git a/content/docs/spark/current/spark-streaming-akka/index.html b/content/docs/spark/current/spark-streaming-akka/index.html deleted file mode 100644 index 5cd1cda..0000000 --- a/content/docs/spark/current/spark-streaming-akka/index.html +++ /dev/null @@ -1,277 +0,0 @@ - -<!DOCTYPE html> -<html lang="en"> - <head> - <meta charset="utf-8"> - <title>Spark Streaming Akka</title> - <meta name="description" content="Spark Streaming Akka"> - <meta name="author" content=""> - - <!-- Enable responsive viewport --> - <meta name="viewport" content="width=device-width, initial-scale=1.0"> - - <!-- Le HTML5 shim, for IE6-8 support of HTML elements --> - <!--[if lt IE 9]> - <script src="http://html5shim.googlecode.com/svn/trunk/html5.js";></script> - <![endif]--> - - <!-- Le styles --> - <link href="/assets/themes/apache-clean/bootstrap/css/bootstrap.css" rel="stylesheet"> - <link href="/assets/themes/apache-clean/css/style.css?body=1" rel="stylesheet" type="text/css"> - <link href="/assets/themes/apache-clean/css/syntax.css" rel="stylesheet" type="text/css" media="screen" /> - <!-- Le fav and touch icons --> - <!-- Update these with your own images - <link rel="shortcut icon" href="images/favicon.ico"> - <link rel="apple-touch-icon" href="images/apple-touch-icon.png"> - <link rel="apple-touch-icon" sizes="72x72" href="images/apple-touch-icon-72x72.png"> - <link rel="apple-touch-icon" sizes="114x114" href="images/apple-touch-icon-114x114.png"> - --> - - <!-- make tables sortable by adding class tag "sortable" to table elements --> - <script src="http://www.kryogenix.org/code/browser/sorttable/sorttable.js";></script> - - - </head> - - <body> - - - -<!-- Navigation --> -<div id="nav-bar"> - <nav id="nav-container" class="navbar navbar-inverse " role="navigation"> - <div class="container"> - <!-- Brand and toggle get grouped for better mobile display --> - - <div class="navbar-header page-scroll"> - <button type="button" class="navbar-toggle" data-toggle="collapse" data-target=".navbar-collapse"> - <span class="sr-only">Toggle navigation</span> - <span class="icon-bar"></span> - <span class="icon-bar"></span> - <span class="icon-bar"></span> - </button> - <a class="navbar-brand page-scroll" href="/#home">Home</a> - </div> - <!-- Collect the nav links, forms, and other content for toggling --> - <nav class="navbar-collapse collapse" role="navigation"> - <ul class="nav navbar-nav"> - - <li id="community"> - - <a href="#" data-toggle="dropdown" class="dropdown-toggle">Community<b class="caret"></b></a> - <ul class="dropdown-menu dropdown-left"> - - - <li><a href="/community" target="_self">Get Involved</a></li> - - - <li><a href="/contributing" target="_self">Contributing</a></li> - - - <li><a href="/contributing-extensions" target="_self">Contributing Extensions</a></li> - - - <li><a href="https://issues.apache.org/jira/browse/BAHIR"; target="_blank">Issue Tracker</a></li> - - - <li><a href="https://github.com/apache/bahir"; target="_blank">Source Code</a></li> - - - <li><a href="/community-members" target="_self">Project Committers</a></li> - - </ul> - - </li> - - <li id="documentation"> - - <a href="#" data-toggle="dropdown" class="dropdown-toggle">Documentation<b class="caret"></b></a> - <ul class="dropdown-menu dropdown-left"> - - - <li><a href="/docs/spark/current/documentation" target="_self">Bahir Spark Extensions - Current</a></li> - - - <li><a href="/docs/spark/2.0.0/documentation" target="_self">Bahir Spark Extensions - 2.0.0</a></li> - - </ul> - - </li> - - <li id="github"> - - - <a href="https://github.com/apache/bahir"; target="_blank">GitHub</a> - - </li> - - <li id="apache"> - - <a href="#" data-toggle="dropdown" class="dropdown-toggle">Apache<b class="caret"></b></a> - <ul class="dropdown-menu dropdown-left"> - - - <li><a href="http://www.apache.org/foundation/how-it-works.html"; target="_blank">Apache Software Foundation</a></li> - - - <li><a href="http://www.apache.org/licenses/"; target="_blank">Apache License</a></li> - - - <li><a href="http://www.apache.org/foundation/sponsorship"; target="_blank">Sponsorship</a></li> - - - <li><a href="http://www.apache.org/foundation/thanks.html"; target="_blank">Thanks</a></li> - - - <li><a href="/privacy-policy" target="_self">Privacy Policy</a></li> - - </ul> - - </li> - - </ul> - </nav><!--/.navbar-collapse --> - <!-- /.navbar-collapse --> - </div> - <!-- /.container --> - </nav> -</div> - - - <div class="container"> - - -<!--<div class="hero-unit Spark Streaming Akka"> - <h1></h1> -</div> ---> - -<div class="row"> - <div class="col-md-12"> - <!-- - ---> - -<p>A library for reading data from Akka Actors using Spark Streaming.</p> - -<h2 id="linking">Linking</h2> - -<p>Using SBT:</p> - -<pre><code>libraryDependencies += "org.apache.bahir" %% "spark-streaming-akka" % "2.1.0-SNAPSHOT" -</code></pre> - -<p>Using Maven:</p> - -<pre><code><dependency> - <groupId>org.apache.bahir</groupId> - <artifactId>spark-streaming-akka_2.11</artifactId> - <version>2.1.0-SNAPSHOT</version> -</dependency> -</code></pre> - -<p>This library can also be added to Spark jobs launched through <code>spark-shell</code> or <code>spark-submit</code> by using the <code>--packages</code> command line option. -For example, to include it when starting the spark shell:</p> - -<pre><code>$ bin/spark-shell --packages org.apache.bahir:spark-streaming_akka_2.11:2.1.0-SNAPSHOT -</code></pre> - -<p>Unlike using <code>--jars</code>, using <code>--packages</code> ensures that this library and its dependencies will be added to the classpath. -The <code>--packages</code> argument can also be used with <code>bin/spark-submit</code>.</p> - -<p>This library is cross-published for Scala 2.10 and Scala 2.11, so users should replace the proper Scala version (2.10 or 2.11) in the commands listed above.</p> - -<h2 id="examples">Examples</h2> - -<p>DStreams can be created with data streams received through Akka actors by using <code>AkkaUtils.createStream(ssc, actorProps, actor-name)</code>.</p> - -<h3 id="scala-api">Scala API</h3> - -<p>You need to extend <code>ActorReceiver</code> so as to store received data into Spark using <code>store(...)</code> methods. The supervisor strategy of -this actor can be configured to handle failures, etc.</p> - -<pre><code>class CustomActor extends ActorReceiver { - def receive = { - case data: String => store(data) - } -} - -// A new input stream can be created with this custom actor as -val ssc: StreamingContext = ... -val lines = AkkaUtils.createStream[String](ssc, Props[CustomActor](), "CustomReceiver") -</code></pre> - -<h3 id="java-api">Java API</h3> - -<p>You need to extend <code>JavaActorReceiver</code> so as to store received data into Spark using <code>store(...)</code> methods. The supervisor strategy of -this actor can be configured to handle failures, etc.</p> - -<pre><code>class CustomActor extends JavaActorReceiver { - @Override - public void onReceive(Object msg) throws Exception { - store((String) msg); - } -} - -// A new input stream can be created with this custom actor as -JavaStreamingContext jssc = ...; -JavaDStream<String> lines = AkkaUtils.<String>createStream(jssc, Props.create(CustomActor.class), "CustomReceiver"); -</code></pre> - -<p>See end-to-end examples at <a href="https://github.com/apache/bahir/tree/master/streaming-akka/examples";>Akka Examples</a></p> - - </div> -</div> - - - - <hr> - - <!-- <p>© 2016 </p>--> - <footer class="site-footer"> - <div class="wrapper"> - <div class="footer-col-wrapper"> - - <div style="text-align:center;"> - - <div> - Copyright © 2016 <a href="http://www.apache.org";>The Apache Software Foundation</a>. - Licensed under the <a href="http://www.apache.org/licenses/LICENSE-2.0";>Apache License, Version - 2.0</a>. - <br> - - Apache and the Apache Feather logo are trademarks of The Apache Software Foundation. - - </div> - </div> - </div> - </div> -</footer> - - </div> - - - - - <script type="text/javascript"> - (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){ - (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o), - m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m) - })(window,document,'script','//www.google-analytics.com/analytics.js','ga'); - - ga('create', 'UA-79140859-1', 'bahir.apache.org'); - ga('require', 'linkid', 'linkid.js'); - ga('send', 'pageview'); - -</script> - - - - <script src="/assets/themes/apache-clean/jquery/jquery-2.1.1.min.js"></script> - - <script src="/assets/themes/apache-clean/bootstrap/js/bootstrap.min.js"></script> - - - </body> -</html> - http://git-wip-us.apache.org/repos/asf/bahir-website/blob/4c605a65/content/docs/spark/current/spark-streaming-mqtt.template ---------------------------------------------------------------------- diff --git a/content/docs/spark/current/spark-streaming-mqtt.template b/content/docs/spark/current/spark-streaming-mqtt.template index 33c4d29..58462b7 100644 --- a/content/docs/spark/current/spark-streaming-mqtt.template +++ b/content/docs/spark/current/spark-streaming-mqtt.template @@ -1,4 +1,5 @@ + <!DOCTYPE html> <html lang="en"> <head> @@ -92,6 +93,9 @@ <li><a href="/docs/spark/current/documentation" target="_self">Bahir Spark Extensions - Current</a></li> + <li><a href="/docs/spark/2.0.1/documentation" target="_self">Bahir Spark Extensions - 2.0.1</a></li> + + <li><a href="/docs/spark/2.0.0/documentation" target="_self">Bahir Spark Extensions - 2.0.0</a></li> </ul> @@ -141,6 +145,7 @@ <div class="container"> + <!--<div class="hero-unit Spark Structured Streaming MQTT"> <h1></h1> </div> @@ -155,6 +160,7 @@ + </div> </div> http://git-wip-us.apache.org/repos/asf/bahir-website/blob/4c605a65/content/docs/spark/current/spark-streaming-mqtt/index.html ---------------------------------------------------------------------- diff --git a/content/docs/spark/current/spark-streaming-mqtt/index.html b/content/docs/spark/current/spark-streaming-mqtt/index.html deleted file mode 100644 index 0c7e98f..0000000 --- a/content/docs/spark/current/spark-streaming-mqtt/index.html +++ /dev/null @@ -1,258 +0,0 @@ - -<!DOCTYPE html> -<html lang="en"> - <head> - <meta charset="utf-8"> - <title>Spark Structured Streaming MQTT</title> - <meta name="description" content="Spark Structured Streaming MQTT"> - <meta name="author" content=""> - - <!-- Enable responsive viewport --> - <meta name="viewport" content="width=device-width, initial-scale=1.0"> - - <!-- Le HTML5 shim, for IE6-8 support of HTML elements --> - <!--[if lt IE 9]> - <script src="http://html5shim.googlecode.com/svn/trunk/html5.js";></script> - <![endif]--> - - <!-- Le styles --> - <link href="/assets/themes/apache-clean/bootstrap/css/bootstrap.css" rel="stylesheet"> - <link href="/assets/themes/apache-clean/css/style.css?body=1" rel="stylesheet" type="text/css"> - <link href="/assets/themes/apache-clean/css/syntax.css" rel="stylesheet" type="text/css" media="screen" /> - <!-- Le fav and touch icons --> - <!-- Update these with your own images - <link rel="shortcut icon" href="images/favicon.ico"> - <link rel="apple-touch-icon" href="images/apple-touch-icon.png"> - <link rel="apple-touch-icon" sizes="72x72" href="images/apple-touch-icon-72x72.png"> - <link rel="apple-touch-icon" sizes="114x114" href="images/apple-touch-icon-114x114.png"> - --> - - <!-- make tables sortable by adding class tag "sortable" to table elements --> - <script src="http://www.kryogenix.org/code/browser/sorttable/sorttable.js";></script> - - - </head> - - <body> - - - -<!-- Navigation --> -<div id="nav-bar"> - <nav id="nav-container" class="navbar navbar-inverse " role="navigation"> - <div class="container"> - <!-- Brand and toggle get grouped for better mobile display --> - - <div class="navbar-header page-scroll"> - <button type="button" class="navbar-toggle" data-toggle="collapse" data-target=".navbar-collapse"> - <span class="sr-only">Toggle navigation</span> - <span class="icon-bar"></span> - <span class="icon-bar"></span> - <span class="icon-bar"></span> - </button> - <a class="navbar-brand page-scroll" href="/#home">Home</a> - </div> - <!-- Collect the nav links, forms, and other content for toggling --> - <nav class="navbar-collapse collapse" role="navigation"> - <ul class="nav navbar-nav"> - - <li id="community"> - - <a href="#" data-toggle="dropdown" class="dropdown-toggle">Community<b class="caret"></b></a> - <ul class="dropdown-menu dropdown-left"> - - - <li><a href="/community" target="_self">Get Involved</a></li> - - - <li><a href="/contributing" target="_self">Contributing</a></li> - - - <li><a href="/contributing-extensions" target="_self">Contributing Extensions</a></li> - - - <li><a href="https://issues.apache.org/jira/browse/BAHIR"; target="_blank">Issue Tracker</a></li> - - - <li><a href="https://github.com/apache/bahir"; target="_blank">Source Code</a></li> - - - <li><a href="/community-members" target="_self">Project Committers</a></li> - - </ul> - - </li> - - <li id="documentation"> - - <a href="#" data-toggle="dropdown" class="dropdown-toggle">Documentation<b class="caret"></b></a> - <ul class="dropdown-menu dropdown-left"> - - - <li><a href="/docs/spark/current/documentation" target="_self">Bahir Spark Extensions - Current</a></li> - - - <li><a href="/docs/spark/2.0.0/documentation" target="_self">Bahir Spark Extensions - 2.0.0</a></li> - - </ul> - - </li> - - <li id="github"> - - - <a href="https://github.com/apache/bahir"; target="_blank">GitHub</a> - - </li> - - <li id="apache"> - - <a href="#" data-toggle="dropdown" class="dropdown-toggle">Apache<b class="caret"></b></a> - <ul class="dropdown-menu dropdown-left"> - - - <li><a href="http://www.apache.org/foundation/how-it-works.html"; target="_blank">Apache Software Foundation</a></li> - - - <li><a href="http://www.apache.org/licenses/"; target="_blank">Apache License</a></li> - - - <li><a href="http://www.apache.org/foundation/sponsorship"; target="_blank">Sponsorship</a></li> - - - <li><a href="http://www.apache.org/foundation/thanks.html"; target="_blank">Thanks</a></li> - - - <li><a href="/privacy-policy" target="_self">Privacy Policy</a></li> - - </ul> - - </li> - - </ul> - </nav><!--/.navbar-collapse --> - <!-- /.navbar-collapse --> - </div> - <!-- /.container --> - </nav> -</div> - - - <div class="container"> - - -<!--<div class="hero-unit Spark Structured Streaming MQTT"> - <h1></h1> -</div> ---> - -<div class="row"> - <div class="col-md-12"> - <!-- - ---> - -<p><a href="http://mqtt.org/";>MQTT</a> is MQTT is a machine-to-machine (M2M)/âInternet of Thingsâ connectivity protocol. It was designed as an extremely lightweight publish/subscribe messaging transport. It is useful for connections with remote locations where a small code footprint is required and/or network bandwidth is at a premium.</p> - -<h2 id="linking">Linking</h2> - -<p>Using SBT:</p> - -<pre><code>libraryDependencies += "org.apache.bahir" %% "spark-streaming-mqtt" % "2.1.0-SNAPSHOT" -</code></pre> - -<p>Using Maven:</p> - -<pre><code><dependency> - <groupId>org.apache.bahir</groupId> - <artifactId>spark-streaming-mqtt_2.11</artifactId> - <version>2.1.0-SNAPSHOT</version> -</dependency> -</code></pre> - -<p>This library can also be added to Spark jobs launched through <code>spark-shell</code> or <code>spark-submit</code> by using the <code>--packages</code> command line option. -For example, to include it when starting the spark shell:</p> - -<pre><code>$ bin/spark-shell --packages org.apache.bahir:spark-streaming_mqtt_2.11:2.1.0-SNAPSHOT -</code></pre> - -<p>Unlike using <code>--jars</code>, using <code>--packages</code> ensures that this library and its dependencies will be added to the classpath. -The <code>--packages</code> argument can also be used with <code>bin/spark-submit</code>.</p> - -<p>This library is cross-published for Scala 2.10 and Scala 2.11, so users should replace the proper Scala version (2.10 or 2.11) in the commands listed above.</p> - -<h2 id="examples">Examples</h2> - -<h3 id="scala-api">Scala API</h3> - -<p>You need to extend <code>ActorReceiver</code> so as to store received data into Spark using <code>store(...)</code> methods. The supervisor strategy of -this actor can be configured to handle failures, etc.</p> - -<pre><code>val lines = MQTTUtils.createStream(ssc, brokerUrl, topic) -</code></pre> - -<h3 id="java-api">Java API</h3> - -<p>You need to extend <code>JavaActorReceiver</code> so as to store received data into Spark using <code>store(...)</code> methods. The supervisor strategy of -this actor can be configured to handle failures, etc.</p> - -<pre><code>JavaDStream<String> lines = MQTTUtils.createStream(jssc, brokerUrl, topic); -</code></pre> - -<p>See end-to-end examples at <a href="https://github.com/apache/bahir/tree/master/streaming-mqtt/examples";>MQTT Examples</a></p> - - </div> -</div> - - - - <hr> - - <!-- <p>© 2016 </p>--> - <footer class="site-footer"> - <div class="wrapper"> - <div class="footer-col-wrapper"> - - <div style="text-align:center;"> - - <div> - Copyright © 2016 <a href="http://www.apache.org";>The Apache Software Foundation</a>. - Licensed under the <a href="http://www.apache.org/licenses/LICENSE-2.0";>Apache License, Version - 2.0</a>. - <br> - - Apache and the Apache Feather logo are trademarks of The Apache Software Foundation. - - </div> - </div> - </div> - </div> -</footer> - - </div> - - - - - <script type="text/javascript"> - (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){ - (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o), - m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m) - })(window,document,'script','//www.google-analytics.com/analytics.js','ga'); - - ga('create', 'UA-79140859-1', 'bahir.apache.org'); - ga('require', 'linkid', 'linkid.js'); - ga('send', 'pageview'); - -</script> - - - - <script src="/assets/themes/apache-clean/jquery/jquery-2.1.1.min.js"></script> - - <script src="/assets/themes/apache-clean/bootstrap/js/bootstrap.min.js"></script> - - - </body> -</html> - http://git-wip-us.apache.org/repos/asf/bahir-website/blob/4c605a65/content/docs/spark/current/spark-streaming-twitter.template ---------------------------------------------------------------------- diff --git a/content/docs/spark/current/spark-streaming-twitter.template b/content/docs/spark/current/spark-streaming-twitter.template index f3247ff..ec80d32 100644 --- a/content/docs/spark/current/spark-streaming-twitter.template +++ b/content/docs/spark/current/spark-streaming-twitter.template @@ -1,4 +1,5 @@ + <!DOCTYPE html> <html lang="en"> <head> @@ -92,6 +93,9 @@ <li><a href="/docs/spark/current/documentation" target="_self">Bahir Spark Extensions - Current</a></li> + <li><a href="/docs/spark/2.0.1/documentation" target="_self">Bahir Spark Extensions - 2.0.1</a></li> + + <li><a href="/docs/spark/2.0.0/documentation" target="_self">Bahir Spark Extensions - 2.0.0</a></li> </ul> @@ -141,6 +145,7 @@ <div class="container"> + <!--<div class="hero-unit Spark Streaming Twitter"> <h1></h1> </div> @@ -154,6 +159,7 @@ + </div> </div> http://git-wip-us.apache.org/repos/asf/bahir-website/blob/4c605a65/content/docs/spark/current/spark-streaming-twitter/index.html ---------------------------------------------------------------------- diff --git a/content/docs/spark/current/spark-streaming-twitter/index.html b/content/docs/spark/current/spark-streaming-twitter/index.html deleted file mode 100644 index f6465e3..0000000 --- a/content/docs/spark/current/spark-streaming-twitter/index.html +++ /dev/null @@ -1,260 +0,0 @@ - -<!DOCTYPE html> -<html lang="en"> - <head> - <meta charset="utf-8"> - <title>Spark Streaming Twitter</title> - <meta name="description" content="Spark Streaming Twitter"> - <meta name="author" content=""> - - <!-- Enable responsive viewport --> - <meta name="viewport" content="width=device-width, initial-scale=1.0"> - - <!-- Le HTML5 shim, for IE6-8 support of HTML elements --> - <!--[if lt IE 9]> - <script src="http://html5shim.googlecode.com/svn/trunk/html5.js";></script> - <![endif]--> - - <!-- Le styles --> - <link href="/assets/themes/apache-clean/bootstrap/css/bootstrap.css" rel="stylesheet"> - <link href="/assets/themes/apache-clean/css/style.css?body=1" rel="stylesheet" type="text/css"> - <link href="/assets/themes/apache-clean/css/syntax.css" rel="stylesheet" type="text/css" media="screen" /> - <!-- Le fav and touch icons --> - <!-- Update these with your own images - <link rel="shortcut icon" href="images/favicon.ico"> - <link rel="apple-touch-icon" href="images/apple-touch-icon.png"> - <link rel="apple-touch-icon" sizes="72x72" href="images/apple-touch-icon-72x72.png"> - <link rel="apple-touch-icon" sizes="114x114" href="images/apple-touch-icon-114x114.png"> - --> - - <!-- make tables sortable by adding class tag "sortable" to table elements --> - <script src="http://www.kryogenix.org/code/browser/sorttable/sorttable.js";></script> - - - </head> - - <body> - - - -<!-- Navigation --> -<div id="nav-bar"> - <nav id="nav-container" class="navbar navbar-inverse " role="navigation"> - <div class="container"> - <!-- Brand and toggle get grouped for better mobile display --> - - <div class="navbar-header page-scroll"> - <button type="button" class="navbar-toggle" data-toggle="collapse" data-target=".navbar-collapse"> - <span class="sr-only">Toggle navigation</span> - <span class="icon-bar"></span> - <span class="icon-bar"></span> - <span class="icon-bar"></span> - </button> - <a class="navbar-brand page-scroll" href="/#home">Home</a> - </div> - <!-- Collect the nav links, forms, and other content for toggling --> - <nav class="navbar-collapse collapse" role="navigation"> - <ul class="nav navbar-nav"> - - <li id="community"> - - <a href="#" data-toggle="dropdown" class="dropdown-toggle">Community<b class="caret"></b></a> - <ul class="dropdown-menu dropdown-left"> - - - <li><a href="/community" target="_self">Get Involved</a></li> - - - <li><a href="/contributing" target="_self">Contributing</a></li> - - - <li><a href="/contributing-extensions" target="_self">Contributing Extensions</a></li> - - - <li><a href="https://issues.apache.org/jira/browse/BAHIR"; target="_blank">Issue Tracker</a></li> - - - <li><a href="https://github.com/apache/bahir"; target="_blank">Source Code</a></li> - - - <li><a href="/community-members" target="_self">Project Committers</a></li> - - </ul> - - </li> - - <li id="documentation"> - - <a href="#" data-toggle="dropdown" class="dropdown-toggle">Documentation<b class="caret"></b></a> - <ul class="dropdown-menu dropdown-left"> - - - <li><a href="/docs/spark/current/documentation" target="_self">Bahir Spark Extensions - Current</a></li> - - - <li><a href="/docs/spark/2.0.0/documentation" target="_self">Bahir Spark Extensions - 2.0.0</a></li> - - </ul> - - </li> - - <li id="github"> - - - <a href="https://github.com/apache/bahir"; target="_blank">GitHub</a> - - </li> - - <li id="apache"> - - <a href="#" data-toggle="dropdown" class="dropdown-toggle">Apache<b class="caret"></b></a> - <ul class="dropdown-menu dropdown-left"> - - - <li><a href="http://www.apache.org/foundation/how-it-works.html"; target="_blank">Apache Software Foundation</a></li> - - - <li><a href="http://www.apache.org/licenses/"; target="_blank">Apache License</a></li> - - - <li><a href="http://www.apache.org/foundation/sponsorship"; target="_blank">Sponsorship</a></li> - - - <li><a href="http://www.apache.org/foundation/thanks.html"; target="_blank">Thanks</a></li> - - - <li><a href="/privacy-policy" target="_self">Privacy Policy</a></li> - - </ul> - - </li> - - </ul> - </nav><!--/.navbar-collapse --> - <!-- /.navbar-collapse --> - </div> - <!-- /.container --> - </nav> -</div> - - - <div class="container"> - - -<!--<div class="hero-unit Spark Streaming Twitter"> - <h1></h1> -</div> ---> - -<div class="row"> - <div class="col-md-12"> - <!-- - ---> - -<p>A library for reading social data from <a href="http://twitter.com/";>twitter</a> using Spark Streaming.</p> - -<h2 id="linking">Linking</h2> - -<p>Using SBT:</p> - -<pre><code>libraryDependencies += "org.apache.bahir" %% "spark-streaming-twitter" % "2.1.0-SNAPSHOT" -</code></pre> - -<p>Using Maven:</p> - -<pre><code><dependency> - <groupId>org.apache.bahir</groupId> - <artifactId>spark-streaming-twitter_2.11</artifactId> - <version>2.1.0-SNAPSHOT</version> -</dependency> -</code></pre> - -<p>This library can also be added to Spark jobs launched through <code>spark-shell</code> or <code>spark-submit</code> by using the <code>--packages</code> command line option. -For example, to include it when starting the spark shell:</p> - -<pre><code>$ bin/spark-shell --packages org.apache.bahir:spark-streaming_twitter_2.11:2.1.0-SNAPSHOT -</code></pre> - -<p>Unlike using <code>--jars</code>, using <code>--packages</code> ensures that this library and its dependencies will be added to the classpath. -The <code>--packages</code> argument can also be used with <code>bin/spark-submit</code>.</p> - -<p>This library is cross-published for Scala 2.10 and Scala 2.11, so users should replace the proper Scala version (2.10 or 2.11) in the commands listed above.</p> - -<h2 id="examples">Examples</h2> - -<p><code>TwitterUtils</code> uses Twitter4j to get the public stream of tweets using <a href="https://dev.twitter.com/docs/streaming-apis";>Twitterâs Streaming API</a>. Authentication information -can be provided by any of the <a href="http://twitter4j.org/en/configuration.html";>methods</a> supported by Twitter4J library. You can import the <code>TwitterUtils</code> class and create a DStream with <code>TwitterUtils.createStream</code> as shown below.</p> - -<h3 id="scala-api">Scala API</h3> - -<pre><code>import org.apache.spark.streaming.twitter._ - -TwitterUtils.createStream(ssc, None) -</code></pre> - -<h3 id="java-api">Java API</h3> - -<pre><code>import org.apache.spark.streaming.twitter.*; - -TwitterUtils.createStream(jssc); -</code></pre> - -<p>You can also either get the public stream, or get the filtered stream based on keywords. -See end-to-end examples at <a href="https://github.com/apache/bahir/tree/master/streaming-twitter/examples";>Twitter Examples</a></p> - - </div> -</div> - - - - <hr> - - <!-- <p>© 2016 </p>--> - <footer class="site-footer"> - <div class="wrapper"> - <div class="footer-col-wrapper"> - - <div style="text-align:center;"> - - <div> - Copyright © 2016 <a href="http://www.apache.org";>The Apache Software Foundation</a>. - Licensed under the <a href="http://www.apache.org/licenses/LICENSE-2.0";>Apache License, Version - 2.0</a>. - <br> - - Apache and the Apache Feather logo are trademarks of The Apache Software Foundation. - - </div> - </div> - </div> - </div> -</footer> - - </div> - - - - - <script type="text/javascript"> - (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){ - (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o), - m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m) - })(window,document,'script','//www.google-analytics.com/analytics.js','ga'); - - ga('create', 'UA-79140859-1', 'bahir.apache.org'); - ga('require', 'linkid', 'linkid.js'); - ga('send', 'pageview'); - -</script> - - - - <script src="/assets/themes/apache-clean/jquery/jquery-2.1.1.min.js"></script> - - <script src="/assets/themes/apache-clean/bootstrap/js/bootstrap.min.js"></script> - - - </body> -</html> - http://git-wip-us.apache.org/repos/asf/bahir-website/blob/4c605a65/content/docs/spark/current/spark-streaming-zeromq.template ---------------------------------------------------------------------- diff --git a/content/docs/spark/current/spark-streaming-zeromq.template b/content/docs/spark/current/spark-streaming-zeromq.template index 058ae12..22480d5 100644 --- a/content/docs/spark/current/spark-streaming-zeromq.template +++ b/content/docs/spark/current/spark-streaming-zeromq.template @@ -1,4 +1,5 @@ + <!DOCTYPE html> <html lang="en"> <head> @@ -92,6 +93,9 @@ <li><a href="/docs/spark/current/documentation" target="_self">Bahir Spark Extensions - Current</a></li> + <li><a href="/docs/spark/2.0.1/documentation" target="_self">Bahir Spark Extensions - 2.0.1</a></li> + + <li><a href="/docs/spark/2.0.0/documentation" target="_self">Bahir Spark Extensions - 2.0.0</a></li> </ul> @@ -141,6 +145,7 @@ <div class="container"> + <!--<div class="hero-unit Spark Streaming ZeroMQ"> <h1></h1> </div> @@ -154,6 +159,7 @@ + </div> </div> http://git-wip-us.apache.org/repos/asf/bahir-website/blob/4c605a65/content/docs/spark/current/spark-streaming-zeromq/index.html ---------------------------------------------------------------------- diff --git a/content/docs/spark/current/spark-streaming-zeromq/index.html b/content/docs/spark/current/spark-streaming-zeromq/index.html deleted file mode 100644 index 4a42f3a..0000000 --- a/content/docs/spark/current/spark-streaming-zeromq/index.html +++ /dev/null @@ -1,252 +0,0 @@ - -<!DOCTYPE html> -<html lang="en"> - <head> - <meta charset="utf-8"> - <title>Spark Streaming ZeroMQ</title> - <meta name="description" content="Spark Streaming ZeroMQ"> - <meta name="author" content=""> - - <!-- Enable responsive viewport --> - <meta name="viewport" content="width=device-width, initial-scale=1.0"> - - <!-- Le HTML5 shim, for IE6-8 support of HTML elements --> - <!--[if lt IE 9]> - <script src="http://html5shim.googlecode.com/svn/trunk/html5.js";></script> - <![endif]--> - - <!-- Le styles --> - <link href="/assets/themes/apache-clean/bootstrap/css/bootstrap.css" rel="stylesheet"> - <link href="/assets/themes/apache-clean/css/style.css?body=1" rel="stylesheet" type="text/css"> - <link href="/assets/themes/apache-clean/css/syntax.css" rel="stylesheet" type="text/css" media="screen" /> - <!-- Le fav and touch icons --> - <!-- Update these with your own images - <link rel="shortcut icon" href="images/favicon.ico"> - <link rel="apple-touch-icon" href="images/apple-touch-icon.png"> - <link rel="apple-touch-icon" sizes="72x72" href="images/apple-touch-icon-72x72.png"> - <link rel="apple-touch-icon" sizes="114x114" href="images/apple-touch-icon-114x114.png"> - --> - - <!-- make tables sortable by adding class tag "sortable" to table elements --> - <script src="http://www.kryogenix.org/code/browser/sorttable/sorttable.js";></script> - - - </head> - - <body> - - - -<!-- Navigation --> -<div id="nav-bar"> - <nav id="nav-container" class="navbar navbar-inverse " role="navigation"> - <div class="container"> - <!-- Brand and toggle get grouped for better mobile display --> - - <div class="navbar-header page-scroll"> - <button type="button" class="navbar-toggle" data-toggle="collapse" data-target=".navbar-collapse"> - <span class="sr-only">Toggle navigation</span> - <span class="icon-bar"></span> - <span class="icon-bar"></span> - <span class="icon-bar"></span> - </button> - <a class="navbar-brand page-scroll" href="/#home">Home</a> - </div> - <!-- Collect the nav links, forms, and other content for toggling --> - <nav class="navbar-collapse collapse" role="navigation"> - <ul class="nav navbar-nav"> - - <li id="community"> - - <a href="#" data-toggle="dropdown" class="dropdown-toggle">Community<b class="caret"></b></a> - <ul class="dropdown-menu dropdown-left"> - - - <li><a href="/community" target="_self">Get Involved</a></li> - - - <li><a href="/contributing" target="_self">Contributing</a></li> - - - <li><a href="/contributing-extensions" target="_self">Contributing Extensions</a></li> - - - <li><a href="https://issues.apache.org/jira/browse/BAHIR"; target="_blank">Issue Tracker</a></li> - - - <li><a href="https://github.com/apache/bahir"; target="_blank">Source Code</a></li> - - - <li><a href="/community-members" target="_self">Project Committers</a></li> - - </ul> - - </li> - - <li id="documentation"> - - <a href="#" data-toggle="dropdown" class="dropdown-toggle">Documentation<b class="caret"></b></a> - <ul class="dropdown-menu dropdown-left"> - - - <li><a href="/docs/spark/current/documentation" target="_self">Bahir Spark Extensions - Current</a></li> - - - <li><a href="/docs/spark/2.0.0/documentation" target="_self">Bahir Spark Extensions - 2.0.0</a></li> - - </ul> - - </li> - - <li id="github"> - - - <a href="https://github.com/apache/bahir"; target="_blank">GitHub</a> - - </li> - - <li id="apache"> - - <a href="#" data-toggle="dropdown" class="dropdown-toggle">Apache<b class="caret"></b></a> - <ul class="dropdown-menu dropdown-left"> - - - <li><a href="http://www.apache.org/foundation/how-it-works.html"; target="_blank">Apache Software Foundation</a></li> - - - <li><a href="http://www.apache.org/licenses/"; target="_blank">Apache License</a></li> - - - <li><a href="http://www.apache.org/foundation/sponsorship"; target="_blank">Sponsorship</a></li> - - - <li><a href="http://www.apache.org/foundation/thanks.html"; target="_blank">Thanks</a></li> - - - <li><a href="/privacy-policy" target="_self">Privacy Policy</a></li> - - </ul> - - </li> - - </ul> - </nav><!--/.navbar-collapse --> - <!-- /.navbar-collapse --> - </div> - <!-- /.container --> - </nav> -</div> - - - <div class="container"> - - -<!--<div class="hero-unit Spark Streaming ZeroMQ"> - <h1></h1> -</div> ---> - -<div class="row"> - <div class="col-md-12"> - <!-- - ---> - -<p>A library for reading data from <a href="http://zeromq.org/";>ZeroMQ</a> using Spark Streaming.</p> - -<h2 id="linking">Linking</h2> - -<p>Using SBT:</p> - -<pre><code>libraryDependencies += "org.apache.bahir" %% "spark-streaming-zeromq" % "2.1.0-SNAPSHOT" -</code></pre> - -<p>Using Maven:</p> - -<pre><code><dependency> - <groupId>org.apache.bahir</groupId> - <artifactId>spark-streaming-zeromq_2.11</artifactId> - <version>2.1.0-SNAPSHOT</version> -</dependency> -</code></pre> - -<p>This library can also be added to Spark jobs launched through <code>spark-shell</code> or <code>spark-submit</code> by using the <code>--packages</code> command line option. -For example, to include it when starting the spark shell:</p> - -<pre><code>$ bin/spark-shell --packages org.apache.bahir:spark-streaming_zeromq_2.11:2.1.0-SNAPSHOT -</code></pre> - -<p>Unlike using <code>--jars</code>, using <code>--packages</code> ensures that this library and its dependencies will be added to the classpath. -The <code>--packages</code> argument can also be used with <code>bin/spark-submit</code>.</p> - -<p>This library is cross-published for Scala 2.10 and Scala 2.11, so users should replace the proper Scala version (2.10 or 2.11) in the commands listed above.</p> - -<h2 id="examples">Examples</h2> - -<h3 id="scala-api">Scala API</h3> - -<pre><code>val lines = ZeroMQUtils.createStream(ssc, ...) -</code></pre> - -<h3 id="java-api">Java API</h3> - -<pre><code>JavaDStream<String> lines = ZeroMQUtils.createStream(jssc, ...); -</code></pre> - -<p>See end-to-end examples at <a href="https://github.com/apache/bahir/tree/master/streaming-zeromq/examples";>ZeroMQ Examples</a></p> - - </div> -</div> - - - - <hr> - - <!-- <p>© 2016 </p>--> - <footer class="site-footer"> - <div class="wrapper"> - <div class="footer-col-wrapper"> - - <div style="text-align:center;"> - - <div> - Copyright © 2016 <a href="http://www.apache.org";>The Apache Software Foundation</a>. - Licensed under the <a href="http://www.apache.org/licenses/LICENSE-2.0";>Apache License, Version - 2.0</a>. - <br> - - Apache and the Apache Feather logo are trademarks of The Apache Software Foundation. - - </div> - </div> - </div> - </div> -</footer> - - </div> - - - - - <script type="text/javascript"> - (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){ - (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o), - m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m) - })(window,document,'script','//www.google-analytics.com/analytics.js','ga'); - - ga('create', 'UA-79140859-1', 'bahir.apache.org'); - ga('require', 'linkid', 'linkid.js'); - ga('send', 'pageview'); - -</script> - - - - <script src="/assets/themes/apache-clean/jquery/jquery-2.1.1.min.js"></script> - - <script src="/assets/themes/apache-clean/bootstrap/js/bootstrap.min.js"></script> - - - </body> -</html> - http://git-wip-us.apache.org/repos/asf/bahir-website/blob/4c605a65/content/download/index.html ---------------------------------------------------------------------- diff --git a/content/download/index.html b/content/download/index.html index b2e4e1a..fdefcc5 100644 --- a/content/download/index.html +++ b/content/download/index.html @@ -1,4 +1,5 @@ + <!DOCTYPE html> <html lang="en"> <head> @@ -92,6 +93,9 @@ <li><a href="/docs/spark/current/documentation" target="_self">Bahir Spark Extensions - Current</a></li> + <li><a href="/docs/spark/2.0.1/documentation" target="_self">Bahir Spark Extensions - 2.0.1</a></li> + + <li><a href="/docs/spark/2.0.0/documentation" target="_self">Bahir Spark Extensions - 2.0.0</a></li> </ul> @@ -141,6 +145,7 @@ <div class="container"> + <!--<div class="hero-unit Downloads"> <h1></h1> </div> @@ -158,7 +163,7 @@ <h3 id="latest-release">Latest Release</h3> -<p>Our latest release is Apache Bahir 2.0.0, released on (08/11/2016).</p> +<p>Our latest release is Apache Bahir 2.0.1, released on (11/27/2016).</p> <table class="table table-hover sortable"> <thead> @@ -172,18 +177,18 @@ </thead> <tbody> <tr> - <td>Apache Bahir 2.0.0 (tar.gz)</td> - <td><a href="http://www.apache.org/dyn/closer.lua/bahir/2.0.0/apache-bahir-2.0.0-src.tar.gz";>tar.gz</a></td> - <td><a href="http://www.apache.org/dist/bahir/2.0.0/apache-bahir-2.0.0-src.tar.gz.md5";>MD5</a></td> - <!--td><a href="http://www.apache.org/dist/bahir/2.0.0/apache-bahir-2.0.0-src.tar.gz.sha1";>SHA-1</a></td--> - <td><a href="http://www.apache.org/dist/bahir/2.0.0/apache-bahir-2.0.0-src.tar.gz.asc";>ASC</a></td> + <td>Apache Bahir 2.0.1 (tar.gz)</td> + <td><a href="http://www.apache.org/dyn/closer.lua/bahir/2.0.1/apache-bahir-2.0.1-src.tar.gz";>tar.gz</a></td> + <td><a href="http://www.apache.org/dist/bahir/2.0.1/apache-bahir-2.0.1-src.tar.gz.md5";>MD5</a></td> + <!--td><a href="http://www.apache.org/dist/bahir/2.0.1/apache-bahir-2.0.1-src.tar.gz.sha1";>SHA-1</a></td--> + <td><a href="http://www.apache.org/dist/bahir/2.0.1/apache-bahir-2.0.1-src.tar.gz.asc";>ASC</a></td> </tr> <tr> - <td>Apache Bahir 2.0.0 (zip)</td> - <td><a href="http://www.apache.org/dyn/closer.lua/bahir/2.0.0/apache-bahir-2.0.0-src.zip";>zip</a></td> - <td><a href="http://www.apache.org/dist/bahir/2.0.0/apache-bahir-2.0.0-src.zip.md5";>MD5</a></td> - <!--td><a href="http://www.apache.org/dist/bahir/2.0.0/apache-bahir-2.0.0-src.zip.sha1";>SHA-1</a></td--> - <td><a href="http://www.apache.org/dist/bahir/2.0.0/apache-bahir-2.0.0-src.zip.asc";>ASC</a></td> + <td>Apache Bahir 2.0.1 (zip)</td> + <td><a href="http://www.apache.org/dyn/closer.lua/bahir/2.0.1/apache-bahir-2.0.1-src.zip";>zip</a></td> + <td><a href="http://www.apache.org/dist/bahir/2.0.1/apache-bahir-2.0.1-src.zip.md5";>MD5</a></td> + <!--td><a href="http://www.apache.org/dist/bahir/2.0.1/apache-bahir-2.0.1-src.zip.sha1";>SHA-1</a></td--> + <td><a href="http://www.apache.org/dist/bahir/2.0.1/apache-bahir-2.0.1-src.zip.asc";>ASC</a></td> </tr> </tbody> </table> @@ -195,7 +200,7 @@ <pre> git clone https://github.com/apache/bahir cd bahir -git checkout -b tags/v2.0.0 v2.0.0 +git checkout -b tags/v2.0.1 v2.0.1 </pre> <h3 id="verifying-a-release">Verifying a Release</h3> http://git-wip-us.apache.org/repos/asf/bahir-website/blob/4c605a65/content/feed.xml ---------------------------------------------------------------------- diff --git a/content/feed.xml b/content/feed.xml index f67a801..32e142a 100644 --- a/content/feed.xml +++ b/content/feed.xml @@ -6,9 +6,9 @@ </description> <link>http://bahir.apache.org/</link> <atom:link href="http://bahir.apache.org/feed.xml"; rel="self" type="application/rss+xml"/> - <pubDate>Mon, 15 Aug 2016 21:55:42 -0400</pubDate> - <lastBuildDate>Mon, 15 Aug 2016 21:55:42 -0400</lastBuildDate> - <generator>Jekyll v3.0.0</generator> + <pubDate>Fri, 28 Oct 2016 02:00:42 +0200</pubDate> + <lastBuildDate>Fri, 28 Oct 2016 02:00:42 +0200</lastBuildDate> + <generator>Jekyll v3.2.1</generator> <item> <title>Release 0.2.0</title> @@ -23,9 +23,9 @@ it.</p> this release includes faster-than-light travel and chewing gum that never loses its flavor.</p> </description> - <pubDate>Tue, 10 Nov 2015 07:00:00 -0500</pubDate> - <link>http://bahir.apache.org/news/2015/11/10/release-0-2-0/</link> - <guid isPermaLink="true">http://bahir.apache.org/news/2015/11/10/release-0-2-0/</guid> + <pubDate>Tue, 10 Nov 2015 13:00:00 +0100</pubDate> + <link>http://bahir.apache.org/news/2015/11/10/release-0.2.0/</link> + <guid isPermaLink="true">http://bahir.apache.org/news/2015/11/10/release-0.2.0/</guid> <category>v0-2-0</category> @@ -48,9 +48,9 @@ committers for their work on the project. Welcome!</p> <li>Princess Leia</li> </ul> </description> - <pubDate>Sun, 08 Nov 2015 22:03:07 -0500</pubDate> - <link>http://bahir.apache.org/news/2015/11/08/new-committers/</link> - <guid isPermaLink="true">http://bahir.apache.org/news/2015/11/08/new-committers/</guid> + <pubDate>Mon, 09 Nov 2015 04:03:07 +0100</pubDate> + <link>http://bahir.apache.org/news/2015/11/09/new-committers/</link> + <guid isPermaLink="true">http://bahir.apache.org/news/2015/11/09/new-committers/</guid> <category>team</category> @@ -67,9 +67,9 @@ committers for their work on the project. Welcome!</p> <p>Weâre so pleased to be in the Apache Incbuator.</p> </description> - <pubDate>Fri, 25 Sep 2015 08:00:00 -0400</pubDate> - <link>http://bahir.apache.org/news/2015/09/25/release-0-1-0/</link> - <guid isPermaLink="true">http://bahir.apache.org/news/2015/09/25/release-0-1-0/</guid> + <pubDate>Fri, 25 Sep 2015 14:00:00 +0200</pubDate> + <link>http://bahir.apache.org/news/2015/09/25/release-0.1.0/</link> + <guid isPermaLink="true">http://bahir.apache.org/news/2015/09/25/release-0.1.0/</guid> <category>v0-1-0</category> http://git-wip-us.apache.org/repos/asf/bahir-website/blob/4c605a65/content/history/index.html ---------------------------------------------------------------------- diff --git a/content/history/index.html b/content/history/index.html index 3aeafb8..bd32c93 100644 --- a/content/history/index.html +++ b/content/history/index.html @@ -1,4 +1,5 @@ + <!DOCTYPE html> <html lang="en"> <head> @@ -92,6 +93,9 @@ <li><a href="/docs/spark/current/documentation" target="_self">Bahir Spark Extensions - Current</a></li> + <li><a href="/docs/spark/2.0.1/documentation" target="_self">Bahir Spark Extensions - 2.0.1</a></li> + + <li><a href="/docs/spark/2.0.0/documentation" target="_self">Bahir Spark Extensions - 2.0.0</a></li> </ul> @@ -141,6 +145,7 @@ <div class="container"> + <!--<div class="hero-unit History"> <h1></h1> </div> @@ -167,9 +172,9 @@ Downloads are available on the <ul> <li>[<a href="https://issues.apache.org/jira/browse/FOO-911";>FOO-911</a>] -Add a variant of <code>FooSchema</code> that does not cache sub-objects</li> +Add a variant of <code class="highlighter-rouge">FooSchema</code> that does not cache sub-objects</li> <li>[<a href="https://issues.apache.org/jira/browse/FOO-845";>FOO-845</a>] -Derive <code>FOO</code> return type by a customizable policy</li> +Derive <code class="highlighter-rouge">FOO</code> return type by a customizable policy</li> </ul> <h2 id="v0-1-0"><a href="https://github.com/apache/bahir/releases/tag/bahir-0.1.0";>0.1.0</a> / 2015-09-25</h2> http://git-wip-us.apache.org/repos/asf/bahir-website/blob/4c605a65/content/index.html ---------------------------------------------------------------------- diff --git a/content/index.html b/content/index.html index b91bb73..cb2bc3d 100644 --- a/content/index.html +++ b/content/index.html @@ -1,4 +1,5 @@ + <!DOCTYPE html> <html lang="en"> <head> @@ -43,7 +44,7 @@ <p>Apache Bahir provides extensions to distributed analytic platforms such as Apache Spark.</p> - <a href="/download" class="btn btn-primary btn-lg bigFingerButton" role="button">Download Apache Bahir 2.0.0</a></p> + <a href="/download" class="btn btn-primary btn-lg bigFingerButton" role="button">Download Apache Bahir 2.0.1</a></p> </div> </div> @@ -104,6 +105,9 @@ <li><a href="/docs/spark/current/documentation" target="_self">Bahir Spark Extensions - Current</a></li> + <li><a href="/docs/spark/2.0.1/documentation" target="_self">Bahir Spark Extensions - 2.0.1</a></li> + + <li><a href="/docs/spark/2.0.0/documentation" target="_self">Bahir Spark Extensions - 2.0.0</a></li> </ul> @@ -153,6 +157,7 @@ <div class="container"> + <!--<div class="hero-unit Home"> <h1> <small>Apache Project !</small></h1> </div> http://git-wip-us.apache.org/repos/asf/bahir-website/blob/4c605a65/content/news/2015/09/25/release-0-1-0/index.html ---------------------------------------------------------------------- diff --git a/content/news/2015/09/25/release-0-1-0/index.html b/content/news/2015/09/25/release-0-1-0/index.html deleted file mode 100644 index 038d579..0000000 --- a/content/news/2015/09/25/release-0-1-0/index.html +++ /dev/null @@ -1,7 +0,0 @@ -<!-- - ---> - -<p>This is our first release!</p> - -<p>Weâre so pleased to be in the Apache Incbuator.</p> http://git-wip-us.apache.org/repos/asf/bahir-website/blob/4c605a65/content/news/2015/09/25/release-0.1.0/index.html ---------------------------------------------------------------------- diff --git a/content/news/2015/09/25/release-0.1.0/index.html b/content/news/2015/09/25/release-0.1.0/index.html new file mode 100644 index 0000000..038d579 --- /dev/null +++ b/content/news/2015/09/25/release-0.1.0/index.html @@ -0,0 +1,7 @@ +<!-- + +--> + +<p>This is our first release!</p> + +<p>Weâre so pleased to be in the Apache Incbuator.</p> http://git-wip-us.apache.org/repos/asf/bahir-website/blob/4c605a65/content/news/2015/11/08/new-committers/index.html ---------------------------------------------------------------------- diff --git a/content/news/2015/11/08/new-committers/index.html b/content/news/2015/11/08/new-committers/index.html deleted file mode 100644 index f0dd77d..0000000 --- a/content/news/2015/11/08/new-committers/index.html +++ /dev/null @@ -1,11 +0,0 @@ -<!-- - ---> - -<p>The Bahir project management committee today added two new -committers for their work on the project. Welcome!</p> - -<ul> - <li>Darth Vader</li> - <li>Princess Leia</li> -</ul> http://git-wip-us.apache.org/repos/asf/bahir-website/blob/4c605a65/content/news/2015/11/09/new-committers/index.html ---------------------------------------------------------------------- diff --git a/content/news/2015/11/09/new-committers/index.html b/content/news/2015/11/09/new-committers/index.html new file mode 100644 index 0000000..f0dd77d --- /dev/null +++ b/content/news/2015/11/09/new-committers/index.html @@ -0,0 +1,11 @@ +<!-- + +--> + +<p>The Bahir project management committee today added two new +committers for their work on the project. Welcome!</p> + +<ul> + <li>Darth Vader</li> + <li>Princess Leia</li> +</ul> http://git-wip-us.apache.org/repos/asf/bahir-website/blob/4c605a65/content/news/2015/11/10/release-0-2-0/index.html ---------------------------------------------------------------------- diff --git a/content/news/2015/11/10/release-0-2-0/index.html b/content/news/2015/11/10/release-0-2-0/index.html deleted file mode 100644 index 848ca0e..0000000 --- a/content/news/2015/11/10/release-0-2-0/index.html +++ /dev/null @@ -1,10 +0,0 @@ -<!-- - ---> - -<p>This is our second release! Thanks to everyone who has contributed to -it.</p> - -<p>In addition to a large number of bug fixes and minor enhancements, -this release includes faster-than-light travel and chewing gum that -never loses its flavor.</p> http://git-wip-us.apache.org/repos/asf/bahir-website/blob/4c605a65/content/news/2015/11/10/release-0.2.0/index.html ---------------------------------------------------------------------- diff --git a/content/news/2015/11/10/release-0.2.0/index.html b/content/news/2015/11/10/release-0.2.0/index.html new file mode 100644 index 0000000..848ca0e --- /dev/null +++ b/content/news/2015/11/10/release-0.2.0/index.html @@ -0,0 +1,10 @@ +<!-- + +--> + +<p>This is our second release! Thanks to everyone who has contributed to +it.</p> + +<p>In addition to a large number of bug fixes and minor enhancements, +this release includes faster-than-light travel and chewing gum that +never loses its flavor.</p> http://git-wip-us.apache.org/repos/asf/bahir-website/blob/4c605a65/content/privacy-policy/index.html ---------------------------------------------------------------------- diff --git a/content/privacy-policy/index.html b/content/privacy-policy/index.html index 432dd77..f5d0536 100644 --- a/content/privacy-policy/index.html +++ b/content/privacy-policy/index.html @@ -1,4 +1,5 @@ + <!DOCTYPE html> <html lang="en"> <head> @@ -92,6 +93,9 @@ <li><a href="/docs/spark/current/documentation" target="_self">Bahir Spark Extensions - Current</a></li> + <li><a href="/docs/spark/2.0.1/documentation" target="_self">Bahir Spark Extensions - 2.0.1</a></li> + + <li><a href="/docs/spark/2.0.0/documentation" target="_self">Bahir Spark Extensions - 2.0.0</a></li> </ul> @@ -141,6 +145,7 @@ <div class="container"> + <!--<div class="hero-unit Privacy Policy"> <h1></h1> </div> @@ -158,12 +163,13 @@ <p>Information about your use of this website is collected using server access logs and a tracking cookie. The collected information consists of the following:</p> -<pre><code>The IP address from which you access the website; +<div class="highlighter-rouge"><pre class="highlight"><code>The IP address from which you access the website; The type of browser and operating system you use to access our site; The date and time you access our site; The pages you visit; and The addresses of pages from where you followed a link to our site. </code></pre> +</div> <p>Part of this information is gathered using a tracking cookie set by the <a href="http://www.google.com/analytics/";>Google Analytics</a> service and handled by Google as described in their <a href="http://www.google.com/privacy.html";>privacy policy</a>. See your browser documentation for instructions on how to disable the cookie if you prefer not to share this data with Google.</p>
