http://git-wip-us.apache.org/repos/asf/storm/blob/1d09012e/_site/documentation/Using-non-JVM-languages-with-Storm.html ---------------------------------------------------------------------- diff --git a/_site/documentation/Using-non-JVM-languages-with-Storm.html b/_site/documentation/Using-non-JVM-languages-with-Storm.html new file mode 100644 index 0000000..72d7651 --- /dev/null +++ b/_site/documentation/Using-non-JVM-languages-with-Storm.html @@ -0,0 +1,208 @@ +<!DOCTYPE html> +<html> + <head> + <meta charset="utf-8"> + <meta http-equiv="X-UA-Compatible" content="IE=edge"> + <meta name="viewport" content="width=device-width, initial-scale=1"> + + <link rel="shortcut icon" href="/favicon.ico" type="image/x-icon"> + <link rel="icon" href="/favicon.ico" type="image/x-icon"> + + <title>Using non JVM languages with Storm</title> + + <!-- Bootstrap core CSS --> + <link href="/assets/css/bootstrap.min.css" rel="stylesheet"> + <!-- Bootstrap theme --> + <link href="/assets/css/bootstrap-theme.min.css" rel="stylesheet"> + + <!-- Custom styles for this template --> + <link rel="stylesheet" href="http://fortawesome.github.io/Font-Awesome/assets/font-awesome/css/font-awesome.css";> + <link href="/css/style.css" rel="stylesheet"> + <link href="/assets/css/owl.theme.css" rel="stylesheet"> + <link href="/assets/css/owl.carousel.css" rel="stylesheet"> + <script type="text/javascript" src="/assets/js/jquery.min.js"></script> + <script type="text/javascript" src="/assets/js/bootstrap.min.js"></script> + <script type="text/javascript" src="/assets/js/owl.carousel.min.js"></script> + <script type="text/javascript" src="/assets/js/storm.js"></script> + <!-- Just for debugging purposes. Don't actually copy these 2 lines! --> + <!--[if lt IE 9]><script src="../../assets/js/ie8-responsive-file-warning.js"></script><![endif]--> + + <!-- HTML5 shim and Respond.js for IE8 support of HTML5 elements and media queries --> + <!--[if lt IE 9]> + <script src="https://oss.maxcdn.com/html5shiv/3.7.2/html5shiv.min.js";></script> + <script src="https://oss.maxcdn.com/respond/1.4.2/respond.min.js";></script> + <![endif]--> + </head> + + + <body> + <header> + <div class="container-fluid"> + <div class="row"> + <div class="col-md-10"> + <a href="/index.html"><img src="/images/logo.png" class="logo" /></a> + </div> + <div class="col-md-2"> + <a href="/downloads.html" class="btn-std btn-block btn-download">Download</a> + </div> + </div> + </div> +</header> +<!--Header End--> +<!--Navigation Begin--> +<div class="navbar" role="banner"> + <div class="container-fluid"> + <div class="navbar-header"> + <button class="navbar-toggle" type="button" data-toggle="collapse" data-target=".bs-navbar-collapse"> + <span class="icon-bar"></span> + <span class="icon-bar"></span> + <span class="icon-bar"></span> + </button> + </div> + <nav class="collapse navbar-collapse bs-navbar-collapse" role="navigation"> + <ul class="nav navbar-nav"> + <li><a href="/index.html" id="home">Home</a></li> + <li><a href="/getting-help.html" id="getting-help">Getting Help</a></li> + <li><a href="/about/integrates.html" id="project-info">Project Information</a></li> + <li><a href="/documentation.html" id="documentation">Documentation</a></li> + <li><a href="/talksAndVideos.html">Talks and Slideshows</a></li> + <li class="dropdown"> + <a href="#" class="dropdown-toggle" data-toggle="dropdown" id="contribute">Contribute <b class="caret"></b></a> + <ul class="dropdown-menu"> + <li><a href="/contribute/Contributing-to-Storm.html">Getting Started</a></li> + <li><a href="/contribute/BYLAWS.html">ByLaws</a></li> + </ul> + </li> + <li><a href="/2015/06/15/storm0100-beta-released.html" id="news">News</a></li> + </ul> + </nav> + </div> +</div> + + + + <div class="container-fluid"> + <h1 class="page-title">Using non JVM languages with Storm</h1> + <div class="row"> + <div class="col-md-12"> + <!-- Documentation --> + +<p class="post-meta"></p> + +<ul> +<li>two pieces: creating topologies and implementing spouts and bolts in other languages</li> +<li>creating topologies in another language is easy since topologies are just thrift structures (link to storm.thrift)</li> +<li>implementing spouts and bolts in another language is called a "multilang components" or "shelling" + +<ul> +<li>Here's a specification of the protocol: <a href="Multilang-protocol.html">Multilang protocol</a></li> +<li>the thrift structure lets you define multilang components explicitly as a program and a script (e.g., python and the file implementing your bolt)</li> +<li>In Java, you override ShellBolt or ShellSpout to create multilang components + +<ul> +<li>note that output fields declarations happens in the thrift structure, so in Java you create multilang components like the following: + +<ul> +<li>declare fields in java, processing code in the other language by specifying it in constructor of shellbolt</li> +</ul></li> +</ul></li> +<li>multilang uses json messages over stdin/stdout to communicate with the subprocess</li> +<li>storm comes with ruby, python, and fancy adapters that implement the protocol. show an example of python + +<ul> +<li>python supports emitting, anchoring, acking, and logging</li> +</ul></li> +</ul></li> +<li>"storm shell" command makes constructing jar and uploading to nimbus easy + +<ul> +<li>makes jar and uploads it</li> +<li>calls your program with host/port of nimbus and the jarfile id</li> +</ul></li> +</ul> + +<h2 id="notes-on-implementing-a-dsl-in-a-non-jvm-language">Notes on implementing a DSL in a non-JVM language</h2> + +<p>The right place to start is src/storm.thrift. Since Storm topologies are just Thrift structures, and Nimbus is a Thrift daemon, you can create and submit topologies in any language.</p> + +<p>When you create the Thrift structs for spouts and bolts, the code for the spout or bolt is specified in the ComponentObject struct:</p> +<div class="highlight"><pre><code class="language-text" data-lang="text">union ComponentObject { + 1: binary serialized_java; + 2: ShellComponent shell; + 3: JavaObject java_object; +} +</code></pre></div> +<p>For a non-JVM DSL, you would want to make use of "2" and "3". ShellComponent lets you specify a script to run that component (e.g., your python code). And JavaObject lets you specify native java spouts and bolts for the component (and Storm will use reflection to create that spout or bolt).</p> + +<p>There's a "storm shell" command that will help with submitting a topology. Its usage is like this:</p> +<div class="highlight"><pre><code class="language-text" data-lang="text">storm shell resources/ python topology.py arg1 arg2 +</code></pre></div> +<p>storm shell will then package resources/ into a jar, upload the jar to Nimbus, and call your topology.py script like this:</p> +<div class="highlight"><pre><code class="language-text" data-lang="text">python topology.py arg1 arg2 {nimbus-host} {nimbus-port} {uploaded-jar-location} +</code></pre></div> +<p>Then you can connect to Nimbus using the Thrift API and submit the topology, passing {uploaded-jar-location} into the submitTopology method. For reference, here's the submitTopology definition:</p> +<div class="highlight"><pre><code class="language-text" data-lang="text">void submitTopology(1: string name, 2: string uploadedJarLocation, 3: string jsonConf, 4: StormTopology topology) + throws (1: AlreadyAliveException e, 2: InvalidTopologyException ite); +</code></pre></div> + + + </div> + </div> + </div> +<footer> + <div class="container-fluid"> + <div class="row"> + <div class="col-md-3"> + <div class="footer-widget"> + <h5>Meetups</h5> + <ul class="latest-news"> + <li><a href="http://www.meetup.com/Apache-Storm-Apache-Kafka/";>Sunnyvale, CA</a> <span class="small">(10 May 2015)</span></li> + <li><a href="http://www.meetup.com/Apache-Storm-Kafka-Users/";>Seatle, WA</a> <span class="small">(27 Jun 2015)</span></li> + </ul> + </div> + </div> + <div class="col-md-3"> + <div class="footer-widget"> + <h5>About Storm</h5> + <p>Storm integrates with any queueing system and any database system. Storm's spout abstraction makes it easy to integrate a new queuing system. Likewise, integrating Storm with database systems is easy.</p> + </div> + </div> + <div class="col-md-3"> + <div class="footer-widget"> + <h5>First Look</h5> + <ul class="footer-list"> + <li><a href="/documentation/Rationale.html">Rationale</a></li> + <li><a href="/tutorial.html">Tutorial</a></li> + <li><a href="/documentation/Setting-up-development-environment.html">Setting up development environment</a></li> + <li><a href="/documentation/Creating-a-new-Storm-project.html">Creating a new Storm project</a></li> + </ul> + </div> + </div> + <div class="col-md-3"> + <div class="footer-widget"> + <h5>Documentation</h5> + <ul class="footer-list"> + <li><a href="/doc-index.html">Index</a></li> + <li><a href="/documentation.html">Manual</a></li> + <li><a href="https://storm.apache.org/javadoc/apidocs/index.html";>Javadoc</a></li> + <li><a href="/documentation/FAQ.html">FAQ</a></li> + </ul> + </div> + </div> + </div> + <hr/> + <div class="row"> + <div class="col-md-12"> + <p align="center">Copyright © 2015 <a href="http://www.apache.org";>Apache Software Foundation</a>. All Rights Reserved. Apache Storm, Apache, the Apache feather logo, and the Apache Storm project logos are trademarks of The Apache Software Foundation. All other marks mentioned may be trademarks or registered trademarks of their respective owners.</p> + </div> + </div> + </div> +</footer> +<!--Footer End--> +<!-- Scroll to top --> +<span class="totop"><a href="#"><i class="fa fa-angle-up"></i></a></span> + +</body> + +</html> +
http://git-wip-us.apache.org/repos/asf/storm/blob/1d09012e/_site/documentation/getting-help.html ---------------------------------------------------------------------- diff --git a/_site/documentation/getting-help.html b/_site/documentation/getting-help.html new file mode 100644 index 0000000..2b9b557 --- /dev/null +++ b/_site/documentation/getting-help.html @@ -0,0 +1,183 @@ +<!DOCTYPE html> +<html> + <head> + <meta charset="utf-8"> + <meta http-equiv="X-UA-Compatible" content="IE=edge"> + <meta name="viewport" content="width=device-width, initial-scale=1"> + + <link rel="shortcut icon" href="/favicon.ico" type="image/x-icon"> + <link rel="icon" href="/favicon.ico" type="image/x-icon"> + + <title>Documentation</title> + + <!-- Bootstrap core CSS --> + <link href="/assets/css/bootstrap.min.css" rel="stylesheet"> + <!-- Bootstrap theme --> + <link href="/assets/css/bootstrap-theme.min.css" rel="stylesheet"> + + <!-- Custom styles for this template --> + <link rel="stylesheet" href="http://fortawesome.github.io/Font-Awesome/assets/font-awesome/css/font-awesome.css";> + <link href="/css/style.css" rel="stylesheet"> + <link href="/assets/css/owl.theme.css" rel="stylesheet"> + <link href="/assets/css/owl.carousel.css" rel="stylesheet"> + <script type="text/javascript" src="/assets/js/jquery.min.js"></script> + <script type="text/javascript" src="/assets/js/bootstrap.min.js"></script> + <script type="text/javascript" src="/assets/js/owl.carousel.min.js"></script> + <script type="text/javascript" src="/assets/js/storm.js"></script> + <!-- Just for debugging purposes. Don't actually copy these 2 lines! --> + <!--[if lt IE 9]><script src="../../assets/js/ie8-responsive-file-warning.js"></script><![endif]--> + + <!-- HTML5 shim and Respond.js for IE8 support of HTML5 elements and media queries --> + <!--[if lt IE 9]> + <script src="https://oss.maxcdn.com/html5shiv/3.7.2/html5shiv.min.js";></script> + <script src="https://oss.maxcdn.com/respond/1.4.2/respond.min.js";></script> + <![endif]--> + </head> + + + <body> + <header> + <div class="container-fluid"> + <div class="row"> + <div class="col-md-10"> + <a href="/index.html"><img src="/images/logo.png" class="logo" /></a> + </div> + <div class="col-md-2"> + <a href="/downloads.html" class="btn-std btn-block btn-download">Download</a> + </div> + </div> + </div> +</header> +<!--Header End--> +<!--Navigation Begin--> +<div class="navbar" role="banner"> + <div class="container-fluid"> + <div class="navbar-header"> + <button class="navbar-toggle" type="button" data-toggle="collapse" data-target=".bs-navbar-collapse"> + <span class="icon-bar"></span> + <span class="icon-bar"></span> + <span class="icon-bar"></span> + </button> + </div> + <nav class="collapse navbar-collapse bs-navbar-collapse" role="navigation"> + <ul class="nav navbar-nav"> + <li><a href="/index.html" id="home">Home</a></li> + <li><a href="/getting-help.html" id="getting-help">Getting Help</a></li> + <li><a href="/about/integrates.html" id="project-info">Project Information</a></li> + <li><a href="/documentation.html" id="documentation">Documentation</a></li> + <li><a href="/talksAndVideos.html">Talks and Slideshows</a></li> + <li class="dropdown"> + <a href="#" class="dropdown-toggle" data-toggle="dropdown" id="contribute">Contribute <b class="caret"></b></a> + <ul class="dropdown-menu"> + <li><a href="/contribute/Contributing-to-Storm.html">Getting Started</a></li> + <li><a href="/contribute/BYLAWS.html">ByLaws</a></li> + </ul> + </li> + <li><a href="/2015/06/15/storm0100-beta-released.html" id="news">News</a></li> + </ul> + </nav> + </div> +</div> + + + + <div class="container-fluid"> + <h1 class="page-title">Documentation</h1> + <div class="row"> + <div class="col-md-12"> + <h3 id="getting-help">Getting help</h3> + +<p><strong>NOTE:</strong> The google groups account <a href="mailto:[email protected]";>[email protected]</a> is now officially deprecated in favor of the Apache-hosted user/dev mailing lists.</p> + +<h4 id="storm-users">Storm Users</h4> + +<p>Storm users should send messages and subscribe to <a href="mailto:[email protected]";>[email protected]</a>.</p> + +<p>You can subscribe to this list by sending an email to <a href="mailto:[email protected]";>[email protected]</a>. Likewise, you can cancel a subscription by sending an email to <a href="mailto:[email protected]";>[email protected]</a>.</p> + +<p>You can view the archives of the mailing list <a href="http://mail-archives.apache.org/mod_mbox/storm-user/";>here</a>.</p> + +<h4 id="storm-developers">Storm Developers</h4> + +<p>Storm developers should send messages and subscribe to <a href="mailto:[email protected]";>[email protected]</a>.</p> + +<p>You can subscribe to this list by sending an email to <a href="mailto:[email protected]";>[email protected]</a>. Likewise, you can cancel a subscription by sending an email to <a href="mailto:[email protected]";>[email protected]</a>.</p> + +<p>You can view the archives of the mailing list <a href="http://mail-archives.apache.org/mod_mbox/storm-dev/";>here</a>.</p> + +<h4 id="which-list-should-i-send/subscribe-to?">Which list should I send/subscribe to?</h4> + +<p>If you are using a pre-built binary distribution of Storm, then chances are you should send questions, comments, storm-related announcements, etc. to <a href="[email protected]">[email protected]</a>. </p> + +<p>If you are building storm from source, developing new features, or otherwise hacking storm source code, then <a href="[email protected]">[email protected]</a> is more appropriate. </p> + +<h4 id="[email protected]?">What will happen with <a href="mailto:[email protected]";>[email protected]</a>?</h4> + +<p>All existing messages will remain archived there, and can be accessed/searched <a href="https://groups.google.com/forum/#!forum/storm-user";>here</a>.</p> + +<p>New messages sent to <a href="mailto:[email protected]";>[email protected]</a> will either be rejected/bounced or replied to with a message to direct the email to the appropriate Apache-hosted group.</p> + +<h4 id="irc">IRC</h4> + +<p>You can also come to the #storm-user room on <a href="http://freenode.net/";>freenode</a>. You can usually find a Storm developer there to help you out.</p> + + </div> + </div> + </div> +<footer> + <div class="container-fluid"> + <div class="row"> + <div class="col-md-3"> + <div class="footer-widget"> + <h5>Meetups</h5> + <ul class="latest-news"> + <li><a href="http://www.meetup.com/Apache-Storm-Apache-Kafka/";>Sunnyvale, CA</a> <span class="small">(10 May 2015)</span></li> + <li><a href="http://www.meetup.com/Apache-Storm-Kafka-Users/";>Seatle, WA</a> <span class="small">(27 Jun 2015)</span></li> + </ul> + </div> + </div> + <div class="col-md-3"> + <div class="footer-widget"> + <h5>About Storm</h5> + <p>Storm integrates with any queueing system and any database system. Storm's spout abstraction makes it easy to integrate a new queuing system. Likewise, integrating Storm with database systems is easy.</p> + </div> + </div> + <div class="col-md-3"> + <div class="footer-widget"> + <h5>First Look</h5> + <ul class="footer-list"> + <li><a href="/documentation/Rationale.html">Rationale</a></li> + <li><a href="/tutorial.html">Tutorial</a></li> + <li><a href="/documentation/Setting-up-development-environment.html">Setting up development environment</a></li> + <li><a href="/documentation/Creating-a-new-Storm-project.html">Creating a new Storm project</a></li> + </ul> + </div> + </div> + <div class="col-md-3"> + <div class="footer-widget"> + <h5>Documentation</h5> + <ul class="footer-list"> + <li><a href="/doc-index.html">Index</a></li> + <li><a href="/documentation.html">Manual</a></li> + <li><a href="https://storm.apache.org/javadoc/apidocs/index.html";>Javadoc</a></li> + <li><a href="/documentation/FAQ.html">FAQ</a></li> + </ul> + </div> + </div> + </div> + <hr/> + <div class="row"> + <div class="col-md-12"> + <p align="center">Copyright © 2015 <a href="http://www.apache.org";>Apache Software Foundation</a>. All Rights Reserved. Apache Storm, Apache, the Apache feather logo, and the Apache Storm project logos are trademarks of The Apache Software Foundation. All other marks mentioned may be trademarks or registered trademarks of their respective owners.</p> + </div> + </div> + </div> +</footer> +<!--Footer End--> +<!-- Scroll to top --> +<span class="totop"><a href="#"><i class="fa fa-angle-up"></i></a></span> + +</body> + +</html> + http://git-wip-us.apache.org/repos/asf/storm/blob/1d09012e/_site/documentation/images/ack_tree.png ---------------------------------------------------------------------- diff --git a/_site/documentation/images/ack_tree.png b/_site/documentation/images/ack_tree.png new file mode 100644 index 0000000..2134cc8 Binary files /dev/null and b/_site/documentation/images/ack_tree.png differ http://git-wip-us.apache.org/repos/asf/storm/blob/1d09012e/_site/documentation/images/batched-stream.png ---------------------------------------------------------------------- diff --git a/_site/documentation/images/batched-stream.png b/_site/documentation/images/batched-stream.png new file mode 100644 index 0000000..1e6aa01 Binary files /dev/null and b/_site/documentation/images/batched-stream.png differ http://git-wip-us.apache.org/repos/asf/storm/blob/1d09012e/_site/documentation/images/drpc-workflow.png ---------------------------------------------------------------------- diff --git a/_site/documentation/images/drpc-workflow.png b/_site/documentation/images/drpc-workflow.png new file mode 100644 index 0000000..9905648 Binary files /dev/null and b/_site/documentation/images/drpc-workflow.png differ http://git-wip-us.apache.org/repos/asf/storm/blob/1d09012e/_site/documentation/images/eclipse-project-properties.png ---------------------------------------------------------------------- diff --git a/_site/documentation/images/eclipse-project-properties.png b/_site/documentation/images/eclipse-project-properties.png new file mode 100644 index 0000000..62f8d32 Binary files /dev/null and b/_site/documentation/images/eclipse-project-properties.png differ http://git-wip-us.apache.org/repos/asf/storm/blob/1d09012e/_site/documentation/images/example-of-a-running-topology.png ---------------------------------------------------------------------- diff --git a/_site/documentation/images/example-of-a-running-topology.png b/_site/documentation/images/example-of-a-running-topology.png new file mode 100644 index 0000000..1462b21 Binary files /dev/null and b/_site/documentation/images/example-of-a-running-topology.png differ http://git-wip-us.apache.org/repos/asf/storm/blob/1d09012e/_site/documentation/images/grouping.png ---------------------------------------------------------------------- diff --git a/_site/documentation/images/grouping.png b/_site/documentation/images/grouping.png new file mode 100644 index 0000000..3911286 Binary files /dev/null and b/_site/documentation/images/grouping.png differ http://git-wip-us.apache.org/repos/asf/storm/blob/1d09012e/_site/documentation/images/ld-library-path-eclipse-linux.png ---------------------------------------------------------------------- diff --git a/_site/documentation/images/ld-library-path-eclipse-linux.png b/_site/documentation/images/ld-library-path-eclipse-linux.png new file mode 100644 index 0000000..b6fbbd9 Binary files /dev/null and b/_site/documentation/images/ld-library-path-eclipse-linux.png differ http://git-wip-us.apache.org/repos/asf/storm/blob/1d09012e/_site/documentation/images/nimbus_ha_leader_election_and_failover.png ---------------------------------------------------------------------- diff --git a/_site/documentation/images/nimbus_ha_leader_election_and_failover.png b/_site/documentation/images/nimbus_ha_leader_election_and_failover.png new file mode 100644 index 0000000..60cc1b7 Binary files /dev/null and b/_site/documentation/images/nimbus_ha_leader_election_and_failover.png differ http://git-wip-us.apache.org/repos/asf/storm/blob/1d09012e/_site/documentation/images/nimbus_ha_topology_submission.png ---------------------------------------------------------------------- diff --git a/_site/documentation/images/nimbus_ha_topology_submission.png b/_site/documentation/images/nimbus_ha_topology_submission.png new file mode 100644 index 0000000..7707e5a Binary files /dev/null and b/_site/documentation/images/nimbus_ha_topology_submission.png differ http://git-wip-us.apache.org/repos/asf/storm/blob/1d09012e/_site/documentation/images/relationships-worker-processes-executors-tasks.png ---------------------------------------------------------------------- diff --git a/_site/documentation/images/relationships-worker-processes-executors-tasks.png b/_site/documentation/images/relationships-worker-processes-executors-tasks.png new file mode 100644 index 0000000..ef6f3fd Binary files /dev/null and b/_site/documentation/images/relationships-worker-processes-executors-tasks.png differ http://git-wip-us.apache.org/repos/asf/storm/blob/1d09012e/_site/documentation/images/spout-vs-state.png ---------------------------------------------------------------------- diff --git a/_site/documentation/images/spout-vs-state.png b/_site/documentation/images/spout-vs-state.png new file mode 100644 index 0000000..b6b06b3 Binary files /dev/null and b/_site/documentation/images/spout-vs-state.png differ http://git-wip-us.apache.org/repos/asf/storm/blob/1d09012e/_site/documentation/images/storm-cluster.png ---------------------------------------------------------------------- diff --git a/_site/documentation/images/storm-cluster.png b/_site/documentation/images/storm-cluster.png new file mode 100644 index 0000000..df2ddb8 Binary files /dev/null and b/_site/documentation/images/storm-cluster.png differ http://git-wip-us.apache.org/repos/asf/storm/blob/1d09012e/_site/documentation/images/topology-tasks.png ---------------------------------------------------------------------- diff --git a/_site/documentation/images/topology-tasks.png b/_site/documentation/images/topology-tasks.png new file mode 100644 index 0000000..0affaba Binary files /dev/null and b/_site/documentation/images/topology-tasks.png differ http://git-wip-us.apache.org/repos/asf/storm/blob/1d09012e/_site/documentation/images/topology.png ---------------------------------------------------------------------- diff --git a/_site/documentation/images/topology.png b/_site/documentation/images/topology.png new file mode 100644 index 0000000..a45c25c Binary files /dev/null and b/_site/documentation/images/topology.png differ http://git-wip-us.apache.org/repos/asf/storm/blob/1d09012e/_site/documentation/images/transactional-batches.png ---------------------------------------------------------------------- diff --git a/_site/documentation/images/transactional-batches.png b/_site/documentation/images/transactional-batches.png new file mode 100644 index 0000000..db2716b Binary files /dev/null and b/_site/documentation/images/transactional-batches.png differ http://git-wip-us.apache.org/repos/asf/storm/blob/1d09012e/_site/documentation/images/transactional-commit-flow.png ---------------------------------------------------------------------- diff --git a/_site/documentation/images/transactional-commit-flow.png b/_site/documentation/images/transactional-commit-flow.png new file mode 100644 index 0000000..25131b0 Binary files /dev/null and b/_site/documentation/images/transactional-commit-flow.png differ http://git-wip-us.apache.org/repos/asf/storm/blob/1d09012e/_site/documentation/images/transactional-design-2.png ---------------------------------------------------------------------- diff --git a/_site/documentation/images/transactional-design-2.png b/_site/documentation/images/transactional-design-2.png new file mode 100644 index 0000000..a0e0ebf Binary files /dev/null and b/_site/documentation/images/transactional-design-2.png differ http://git-wip-us.apache.org/repos/asf/storm/blob/1d09012e/_site/documentation/images/transactional-spout-structure.png ---------------------------------------------------------------------- diff --git a/_site/documentation/images/transactional-spout-structure.png b/_site/documentation/images/transactional-spout-structure.png new file mode 100644 index 0000000..ecf7def Binary files /dev/null and b/_site/documentation/images/transactional-spout-structure.png differ http://git-wip-us.apache.org/repos/asf/storm/blob/1d09012e/_site/documentation/images/trident-to-storm1.png ---------------------------------------------------------------------- diff --git a/_site/documentation/images/trident-to-storm1.png b/_site/documentation/images/trident-to-storm1.png new file mode 100644 index 0000000..b022776 Binary files /dev/null and b/_site/documentation/images/trident-to-storm1.png differ http://git-wip-us.apache.org/repos/asf/storm/blob/1d09012e/_site/documentation/images/trident-to-storm2.png ---------------------------------------------------------------------- diff --git a/_site/documentation/images/trident-to-storm2.png b/_site/documentation/images/trident-to-storm2.png new file mode 100644 index 0000000..6aa0fc5 Binary files /dev/null and b/_site/documentation/images/trident-to-storm2.png differ http://git-wip-us.apache.org/repos/asf/storm/blob/1d09012e/_site/documentation/images/tuple-dag.png ---------------------------------------------------------------------- diff --git a/_site/documentation/images/tuple-dag.png b/_site/documentation/images/tuple-dag.png new file mode 100644 index 0000000..34611d4 Binary files /dev/null and b/_site/documentation/images/tuple-dag.png differ http://git-wip-us.apache.org/repos/asf/storm/blob/1d09012e/_site/documentation/images/tuple_tree.png ---------------------------------------------------------------------- diff --git a/_site/documentation/images/tuple_tree.png b/_site/documentation/images/tuple_tree.png new file mode 100644 index 0000000..b14f558 Binary files /dev/null and b/_site/documentation/images/tuple_tree.png differ http://git-wip-us.apache.org/repos/asf/storm/blob/1d09012e/_site/documentation/nimbus-ha-design.md ---------------------------------------------------------------------- diff --git a/_site/documentation/nimbus-ha-design.md b/_site/documentation/nimbus-ha-design.md new file mode 100644 index 0000000..672eece --- /dev/null +++ b/_site/documentation/nimbus-ha-design.md @@ -0,0 +1,217 @@ +#Highly Available Nimbus design proposal +##Problem Statement: +Currently the storm master aka nimbus, is a process that runs on a single machine under supervision. In most cases the +nimbus failure is transient and it is restarted by the supervisor. However sometimes when disks fail and networks +partitions occur, nimbus goes down. Under these circumstances the topologies run normally but no new topologies can be +submitted, no existing topologies can be killed/deactivated/activated and if a supervisor node fails then the +reassignments are not performed resulting in performance degradation or topology failures. With this project we intend +to resolve this problem by running nimbus in a primary backup mode to guarantee that even if a nimbus server fails one +of the backups will take over. +##Requirements: +* Increase overall availability of nimbus. +* Allow nimbus hosts to leave and join the cluster at will any time. A newly joined host should auto catch up and join +the list of potential leaders automatically. +* No topology resubmissions required in case of nimbus fail overs. +* No active topology should ever be lost. + +##Leader Election: +The nimbus server will use the following interface: + +```java +public interface ILeaderElector { + /** + * queue up for leadership lock. The call returns immediately and the caller + * must check isLeader() to perform any leadership action. + */ + void addToLeaderLockQueue(); + + /** + * Removes the caller from the leader lock queue. If the caller is leader + * also releases the lock. + */ + void removeFromLeaderLockQueue(); + + /** + * + * @return true if the caller currently has the leader lock. + */ + boolean isLeader(); + + /** + * + * @return the current leader's address , throws exception if noone has has lock. + */ + InetSocketAddress getLeaderAddress(); + + /** + * + * @return list of current nimbus addresses, includes leader. + */ + List<InetSocketAddress> getAllNimbusAddresses(); +} +``` +On startup nimbus will check if it has code for all active topologies available locally. Once it gets to this state it +will call addToLeaderLockQueue() function. When a nimbus is notified to become a leader it will check if it has all the +code locally before assuming the leadership role. If any active topology code is missing, the node will not accept the +leadership role instead it will release the lock and wait till it has all the code before requeueing for leader lock. + +The first implementation will be Zookeeper based. If the zookeeper connection is lost/resetted resulting in loss of lock +or the spot in queue the implementation will take care of updating the state such that isLeader() will reflect the +current status.The leader like actions must finish in less than minimumOf(connectionTimeout, SessionTimeout) to ensure +the lock was held by nimbus for the entire duration of the action (Not sure if we want to just state this expectation +and ensure that zk configurations are set high enough which will result in higher failover time or we actually want to +create some sort of rollback mechanism for all actions, the second option needs a lot of code). If a nimbus that is not +leader receives a request that only a leader can perform it will throw a RunTimeException. + +Following steps describes a nimbus failover scenario: +* Letâs say we have 4 topologies running with 3 nimbus nodes and code-replication-factor = 2. We assume that the +invariant âThe leader nimbus has code for all topologies locallyâ holds true at the beginning. nonleader-1 has code for +the first 2 topologies and nonLeader-2 has code for the other 2 topologies. +* Leader nimbus dies, hard disk failure so no recovery possible. +* nonLeader-1 gets a zookeeper notification to indicate it is now the new leader. before accepting the leadership it +checks if it has code available for all 4 topologies(these are topologies under /storm/storms/). It realizes it only has +code for 2 topologies so it relinquishes the lock and looks under /storm/code-distributor/topologyId to find out from +where can it download the code/metafile for the missing topologies. it finds entries for the leader nimbus and +nonleader-2. It will try downloading from both as part of its retry mechanism. +* nonLeader-2âs code sync thread also realizes that it is missing code for 2 topologies and follows the same process +described in step-3 to download code for missing topologies. +* eventually at least one of the nimbuses will have all the code locally and will accept leadership. +This sequence diagram describes how leader election and failover would work with multiple components. + + + +##Nimbus state store: + +Currently the nimbus stores 2 kind of data +* Meta information like supervisor info, assignment info which is stored in zookeeper +* Actual topology configs and jars that is stored on nimbus hostâs local disk. + +To achieve fail over from primary to backup servers nimbus state/data needs to be replicated across all nimbus hosts or +needs to be stored in a distributed storage. Replicating the data correctly involves state management, consistency checks +and it is hard to test for correctness.However many storm users do not want to take extra dependency on another replicated +storage system like HDFS and still need high availability.Eventually, we want to move to the bittorrent protocol for code +distribution given the size of the jars and to achieve better scaling when the total number of supervisors is very high. +The current file system based model for code distribution works fine with systems that have file system like structure +but it fails to support a non file system based approach like bit torrent. To support bit torrent and all the file +system based replicated storage systems we propose the following interface: + +```java +/** + * Interface responsible to distribute code in the cluster. + */ +public interface ICodeDistributor { + /** + * Prepare this code distributor. + * @param conf + */ + void prepare(Map conf); + + /** + * This API will perform the actual upload of the code to the distributed implementation. + * The API should return a Meta file which should have enough information for downloader + * so it can download the code e.g. for bittorrent it will be a torrent file, in case of something + * like HDFS or s3 it might have the actual directory or paths for files to be downloaded. + * @param dirPath local directory where all the code to be distributed exists. + * @param topologyId the topologyId for which the meta file needs to be created. + * @return metaFile + */ + File upload(Path dirPath, String topologyId); + + /** + * Given the topologyId and metafile, download the actual code and return the downloaded file's list. + * @param topologyid + * @param metafile + * @param destDirPath the folder where all the files will be downloaded. + * @return + */ + List<File> download(Path destDirPath, String topologyid, File metafile); + + /** + * Given the topologyId, returns number of hosts where the code has been replicated. + */ + int getReplicationCount(String topologyId); + + /** + * Performs the cleanup. + * @param topologyid + */ + void cleanup(String topologyid); + + /** + * Close this distributor. + * @param conf + */ + void close(Map conf); +} +``` +To support replication we will allow the user to define a code replication factor which would reflect number of nimbus +hosts to which the code must be replicated before starting the topology. With replication comes the issue of consistency. +We will treat zookeeperâs list of active topologies as our authority for topologies for which the code must exist on a +nimbus host. Any nimbus host that does not have all the code for all the topologies which are marked as active in zookeeper +will relinquish itâs lock so some other nimbus host could become leader. A background thread on all nimbus host will +continuously try to sync code from other hosts where the code was successfully replicated so eventually at least one nimbus +will accept leadership as long as at least one seed hosts exists for each active topology. + +Following steps describe code replication amongst nimbus hosts for a topology: +* When client uploads jar, nothing changes. +* When client submits a topology, leader nimbus calls code distributorâs upload function which will create a metafile stored +locally on leader nimbus. Leader nimbus will write new entries under /storm/code-distributor/topologyId to notify all +nonleader nimbuses that they should download this new code. +* We wait on the leader nimbus to ensure at least N non leader nimbus has the code replicated, with a user configurable timeout. +* When a non leader nimbus receives the notification about new code, it downloads the meta file from leader nimbus and then +downloads the real code by calling code distributorâs download function with metafile as input. +* Once non leader finishes downloading code, it will write an entry under /storm/code-distributor/topologyId to indicate +it is one of the possible places to download the code/metafile in case the leader nimbus dies. +* leader nimbus goes ahead and does all the usual things it does as part of submit topologies. + +The following sequence diagram describes the communication between different components involved in code distribution. + + + +##Thrift and Rest API +In order to avoid workers/supervisors/ui talking to zookeeper for getting master nimbus address we are going to modify the +`getClusterInfo` API so it can also return nimbus information. getClusterInfo currently returns `ClusterSummary` instance +which has a list of `supervisorSummary` and a list of 'topologySummary` instances. We will add a list of `NimbusSummary` +to the `ClusterSummary`. See the structures below: + +```thrift +struct ClusterSummary { + 1: required list<SupervisorSummary> supervisors; + 3: required list<TopologySummary> topologies; + 4: required list<NimbusSummary> nimbuses; +} + +struct NimbusSummary { + 1: required string host; + 2: required i32 port; + 3: required i32 uptime_secs; + 4: required bool isLeader; + 5: required string version; +} +``` + +This will be used by StormSubmitter, Nimbus clients,supervisors and ui to discover the current leaders and participating +nimbus hosts. Any nimbus host will be able to respond to these requests. The nimbus hosts can read this information once +from zookeeper and cache it and keep updating the cache when the watchers are fired to indicate any changes,which should +be rare in general case. + +## Configuration +You can use nimbus ha with default configuration , however the default configuration assumes a single nimbus host so it +trades off replication for lower topology submission latency. Depending on your use case you can adjust following configurations: +* storm.codedistributor.class : This is a string representing fully qualified class name of a class that implements +backtype.storm.codedistributor.ICodeDistributor. The default is set to "backtype.storm.codedistributor.LocalFileSystemCodeDistributor". +This class leverages local file system to store both meta files and code/configs. This class adds extra load on zookeeper as even after +downloading the code-distrbutor meta file it contacts zookeeper in order to figure out hosts from where it can download +actual code/config and to get the current replication count. An alternative is to use +"org.apache.storm.hdfs.ha.codedistributor.HDFSCodeDistributor" which relies on HDFS but does not add extra load on zookeeper and will +make topology submission faster. +* topology.min.replication.count : Minimum number of nimbus hosts where the code must be replicated before leader nimbus +can mark the topology as active and create assignments. Default is 1. +* topology.max.replication.wait.time.sec: Maximum wait time for the nimbus host replication to achieve the nimbus.min.replication.count. +Once this time is elapsed nimbus will go ahead and perform topology activation tasks even if required nimbus.min.replication.count is not achieved. +The default is 60 seconds, a value of -1 indicates to wait for ever. +*nimbus.code.sync.freq.secs: frequency at which the background thread on nimbus which syncs code for locally missing topologies will run. default is 5 minutes. + +Note: Even though all nimbus hosts have watchers on zookeeper to be notified immediately as soon as a new topology is available for code +download, the callback pretty much never results in code download. In practice we have observed that the desired replication is only achieved once the background-thread runs. +So you should expect your topology submission time to be somewhere between 0 to (2 * nimbus.code.sync.freq.secs) for any nimbus.min.replication.count > 1. \ No newline at end of file http://git-wip-us.apache.org/repos/asf/storm/blob/1d09012e/_site/downloads.html ---------------------------------------------------------------------- diff --git a/_site/downloads.html b/_site/downloads.html new file mode 100644 index 0000000..21ad073 --- /dev/null +++ b/_site/downloads.html @@ -0,0 +1,395 @@ +<!DOCTYPE html> +<html> + <head> + <meta charset="utf-8"> + <meta http-equiv="X-UA-Compatible" content="IE=edge"> + <meta name="viewport" content="width=device-width, initial-scale=1"> + + <link rel="shortcut icon" href="/favicon.ico" type="image/x-icon"> + <link rel="icon" href="/favicon.ico" type="image/x-icon"> + + <title>Storm downloads</title> + + <!-- Bootstrap core CSS --> + <link href="/assets/css/bootstrap.min.css" rel="stylesheet"> + <!-- Bootstrap theme --> + <link href="/assets/css/bootstrap-theme.min.css" rel="stylesheet"> + + <!-- Custom styles for this template --> + <link rel="stylesheet" href="http://fortawesome.github.io/Font-Awesome/assets/font-awesome/css/font-awesome.css";> + <link href="/css/style.css" rel="stylesheet"> + <link href="/assets/css/owl.theme.css" rel="stylesheet"> + <link href="/assets/css/owl.carousel.css" rel="stylesheet"> + <script type="text/javascript" src="/assets/js/jquery.min.js"></script> + <script type="text/javascript" src="/assets/js/bootstrap.min.js"></script> + <script type="text/javascript" src="/assets/js/owl.carousel.min.js"></script> + <script type="text/javascript" src="/assets/js/storm.js"></script> + <!-- Just for debugging purposes. Don't actually copy these 2 lines! --> + <!--[if lt IE 9]><script src="../../assets/js/ie8-responsive-file-warning.js"></script><![endif]--> + + <!-- HTML5 shim and Respond.js for IE8 support of HTML5 elements and media queries --> + <!--[if lt IE 9]> + <script src="https://oss.maxcdn.com/html5shiv/3.7.2/html5shiv.min.js";></script> + <script src="https://oss.maxcdn.com/respond/1.4.2/respond.min.js";></script> + <![endif]--> + </head> + + + <body> + <header> + <div class="container-fluid"> + <div class="row"> + <div class="col-md-10"> + <a href="/index.html"><img src="/images/logo.png" class="logo" /></a> + </div> + <div class="col-md-2"> + <a href="/downloads.html" class="btn-std btn-block btn-download">Download</a> + </div> + </div> + </div> +</header> +<!--Header End--> +<!--Navigation Begin--> +<div class="navbar" role="banner"> + <div class="container-fluid"> + <div class="navbar-header"> + <button class="navbar-toggle" type="button" data-toggle="collapse" data-target=".bs-navbar-collapse"> + <span class="icon-bar"></span> + <span class="icon-bar"></span> + <span class="icon-bar"></span> + </button> + </div> + <nav class="collapse navbar-collapse bs-navbar-collapse" role="navigation"> + <ul class="nav navbar-nav"> + <li><a href="/index.html" id="home">Home</a></li> + <li><a href="/getting-help.html" id="getting-help">Getting Help</a></li> + <li><a href="/about/integrates.html" id="project-info">Project Information</a></li> + <li><a href="/documentation.html" id="documentation">Documentation</a></li> + <li><a href="/talksAndVideos.html">Talks and Slideshows</a></li> + <li class="dropdown"> + <a href="#" class="dropdown-toggle" data-toggle="dropdown" id="contribute">Contribute <b class="caret"></b></a> + <ul class="dropdown-menu"> + <li><a href="/contribute/Contributing-to-Storm.html">Getting Started</a></li> + <li><a href="/contribute/BYLAWS.html">ByLaws</a></li> + </ul> + </li> + <li><a href="/2015/06/15/storm0100-beta-released.html" id="news">News</a></li> + </ul> + </nav> + </div> +</div> + + + + <div class="container-fluid"> + <h1 class="page-title">Storm downloads</h1> + <div class="row"> + <div class="col-md-12"> + <div class="content"> + <div class="container-fluid"> + <div class="row"> + <div class="col-md-12"> + <p> + Downloads for Storm are below. Instructions for how to set up a Storm cluster can be found <a href="/documentation/Setting-up-a-Storm-cluster.html">here</a>. + </p> + + <h3>Source Code</h3> + Current source code is hosted on GitHub, <a href="https://github.com/apache/storm";>apache/storm</a> + + <h3>Current Beta Release</h3> + The current beta release is 0.10.0-beta1. Source and binary distributions can be found below. + + The list of changes for this release can be found <a href="https://github.com/apache/storm/blob/v0.10.0-beta/CHANGELOG.md";>here.</a> + + <ul> + <li><a href="http://www.apache.org/dyn/closer.cgi/storm/apache-storm-0.10.0-beta/apache-storm-0.10.0-beta.tar.gz";>apache-storm-0.10.0-beta.tar.gz</a> + [<a href="http://www.us.apache.org/dist/storm/apache-storm-0.10.0-beta/apache-storm-0.10.0-beta.tar.gz.asc";>PGP</a>] + [<a href="http://www.us.apache.org/dist/storm/apache-storm-0.10.0-beta/apache-storm-0.10.0-beta.tar.gz.sha";>SHA512</a>] + [<a href="http://www.us.apache.org/dist/storm/apache-storm-0.10.0-beta/apache-storm-0.10.0-beta.tar.gz.md5";>MD5</a>] + </li> + <li><a href="http://www.apache.org/dyn/closer.cgi/storm/apache-storm-0.10.0-beta/apache-storm-0.10.0-beta.zip";>apache-storm-0.10.0-beta.zip</a> + [<a href="http://www.us.apache.org/dist/storm/apache-storm-0.10.0-beta/apache-storm-0.10.0-beta.zip.asc";>PGP</a>] + [<a href="http://www.us.apache.org/dist/storm/apache-storm-0.10.0-beta/apache-storm-0.10.0-beta.zip.sha";>SHA512</a>] + [<a href="http://www.us.apache.org/dist/storm/apache-storm-0.10.0-beta/apache-storm-0.10.0-beta.zip.md5";>MD5</a>] + </li> + <li><a href="http://www.apache.org/dyn/closer.cgi/storm/apache-storm-0.10.0-beta/apache-storm-0.10.0-beta-src.tar.gz";>apache-storm-0.10.0-beta-src.tar.gz</a> + [<a href="http://www.us.apache.org/dist/storm/apache-storm-0.10.0-beta/apache-storm-0.10.0-beta-src.tar.gz.asc";>PGP</a>] + [<a href="http://www.us.apache.org/dist/storm/apache-storm-0.10.0-beta/apache-storm-0.10.0-beta-src.tar.gz.sha";>SHA512</a>] + [<a href="http://www.us.apache.org/dist/storm/apache-storm-0.10.0-beta/apache-storm-0.10.0-beta-src.tar.gz.md5";>MD5</a>] + </li> + <li><a href="http://www.apache.org/dyn/closer.cgi/storm/apache-storm-0.10.0-beta/apache-storm-0.10.0-beta-src.zip";>apache-storm-0.10.0-beta-src.zip</a> + [<a href="http://www.us.apache.org/dist/storm/apache-storm-0.10.0-beta/apache-storm-0.10.0-beta-src.zip.asc";>PGP</a>] + [<a href="http://www.us.apache.org/dist/storm/apache-storm-0.10.0-beta/apache-storm-0.10.0-beta-src.zip.sha";>SHA512</a>] + [<a href="http://www.us.apache.org/dist/storm/apache-storm-0.10.0-beta/apache-storm-0.10.0-beta-src.zip.md5";>MD5</a>] + </li> + </ul> + + + <h3>Current Release</h3> + The current release is 0.9.5. Source and binary distributions can be found below. + + The list of changes for this release can be found <a href="https://github.com/apache/storm/blob/v0.9.5/CHANGELOG.md";>here.</a> + + <ul> + <li><a href="http://www.apache.org/dyn/closer.cgi/storm/apache-storm-0.9.5/apache-storm-0.9.5.tar.gz";>apache-storm-0.9.5.tar.gz</a> + [<a href="http://www.us.apache.org/dist/storm/apache-storm-0.9.5/apache-storm-0.9.5.tar.gz.asc";>PGP</a>] + [<a href="http://www.us.apache.org/dist/storm/apache-storm-0.9.5/apache-storm-0.9.5.tar.gz.sha";>SHA512</a>] + [<a href="http://www.us.apache.org/dist/storm/apache-storm-0.9.5/apache-storm-0.9.5.tar.gz.md5";>MD5</a>] + </li> + <li><a href="http://www.apache.org/dyn/closer.cgi/storm/apache-storm-0.9.5/apache-storm-0.9.5.zip";>apache-storm-0.9.5.zip</a> + [<a href="http://www.us.apache.org/dist/storm/apache-storm-0.9.5/apache-storm-0.9.5.zip.asc";>PGP</a>] + [<a href="http://www.us.apache.org/dist/storm/apache-storm-0.9.5/apache-storm-0.9.5.zip.sha";>SHA512</a>] + [<a href="http://www.us.apache.org/dist/storm/apache-storm-0.9.5/apache-storm-0.9.5.zip.md5";>MD5</a>] + </li> + <li><a href="http://www.apache.org/dyn/closer.cgi/storm/apache-storm-0.9.5/apache-storm-0.9.5-src.tar.gz";>apache-storm-0.9.5-src.tar.gz</a> + [<a href="http://www.us.apache.org/dist/storm/apache-storm-0.9.5/apache-storm-0.9.5-src.tar.gz.asc";>PGP</a>] + [<a href="http://www.us.apache.org/dist/storm/apache-storm-0.9.5/apache-storm-0.9.5-src.tar.gz.sha";>SHA512</a>] + [<a href="http://www.us.apache.org/dist/storm/apache-storm-0.9.5/apache-storm-0.9.5-src.tar.gz.md5";>MD5</a>] + </li> + <li><a href="http://www.apache.org/dyn/closer.cgi/storm/apache-storm-0.9.5/apache-storm-0.9.5-src.zip";>apache-storm-0.9.5-src.zip</a> + [<a href="http://www.us.apache.org/dist/storm/apache-storm-0.9.5/apache-storm-0.9.5-src.zip.asc";>PGP</a>] + [<a href="http://www.us.apache.org/dist/storm/apache-storm-0.9.5/apache-storm-0.9.5-src.zip.sha";>SHA512</a>] + [<a href="http://www.us.apache.org/dist/storm/apache-storm-0.9.5/apache-storm-0.9.5-src.zip.md5";>MD5</a>] + </li> + </ul> + + Storm artifacts are hosted in <a href="http://search.maven.org/#search%7Cga%7C1%7Cg%3A%22org.apache.storm%22";>Maven Central</a>. You can add Storm as a dependency with the following coordinates: + + <pre> +groupId: <a href="http://search.maven.org/#search%7Cga%7C1%7Cg%3A%22org.apache.storm%22";>org.apache.storm</a> +artifactId: storm-core +version: 0.9.5</pre> + + + The signing keys for releases can be found <a href="http://www.apache.org/dist/storm/KEYS";>here.</a> + + <p> + + </p> + <h3>Previous Releases</h3> + + <b>0.9.4</b> + + <ul> + <li><a href="http://www.apache.org/dyn/closer.cgi/storm/apache-storm-0.9.4/apache-storm-0.9.4.tar.gz";>apache-storm-0.9.4.tar.gz</a> + [<a href="http://www.us.apache.org/dist/storm/apache-storm-0.9.4/apache-storm-0.9.4.tar.gz.asc";>PGP</a>] + [<a href="http://www.us.apache.org/dist/storm/apache-storm-0.9.4/apache-storm-0.9.4.tar.gz.sha";>SHA512</a>] + [<a href="http://www.us.apache.org/dist/storm/apache-storm-0.9.4/apache-storm-0.9.4.tar.gz.md5";>MD5</a>] + </li> + <li><a href="http://www.apache.org/dyn/closer.cgi/storm/apache-storm-0.9.4/apache-storm-0.9.4.zip";>apache-storm-0.9.4.zip</a> + [<a href="http://www.us.apache.org/dist/storm/apache-storm-0.9.4/apache-storm-0.9.4.zip.asc";>PGP</a>] + [<a href="http://www.us.apache.org/dist/storm/apache-storm-0.9.4/apache-storm-0.9.4.zip.sha";>SHA512</a>] + [<a href="http://www.us.apache.org/dist/storm/apache-storm-0.9.4/apache-storm-0.9.4.zip.md5";>MD5</a>] + </li> + <li><a href="http://www.apache.org/dyn/closer.cgi/storm/apache-storm-0.9.4/apache-storm-0.9.4-src.tar.gz";>apache-storm-0.9.4-src.tar.gz</a> + [<a href="http://www.us.apache.org/dist/storm/apache-storm-0.9.4/apache-storm-0.9.4-src.tar.gz.asc";>PGP</a>] + [<a href="http://www.us.apache.org/dist/storm/apache-storm-0.9.4/apache-storm-0.9.4-src.tar.gz.sha";>SHA512</a>] + [<a href="http://www.us.apache.org/dist/storm/apache-storm-0.9.4/apache-storm-0.9.4-src.tar.gz.md5";>MD5</a>] + </li> + <li><a href="http://www.apache.org/dyn/closer.cgi/storm/apache-storm-0.9.4/apache-storm-0.9.4-src.zip";>apache-storm-0.9.4-src.zip</a> + [<a href="http://www.us.apache.org/dist/storm/apache-storm-0.9.4/apache-storm-0.9.4-src.zip.asc";>PGP</a>] + [<a href="http://www.us.apache.org/dist/storm/apache-storm-0.9.4/apache-storm-0.9.4-src.zip.sha";>SHA512</a>] + [<a href="http://www.us.apache.org/dist/storm/apache-storm-0.9.4/apache-storm-0.9.4-src.zip.md5";>MD5</a>] + </li> + </ul> + + <b>0.9.3</b> + + <ul> + <li><a href="http://www.apache.org/dyn/closer.cgi/storm/apache-storm-0.9.3/apache-storm-0.9.3.tar.gz";>apache-storm-0.9.3.tar.gz</a> + [<a href="http://www.us.apache.org/dist/storm/apache-storm-0.9.3/apache-storm-0.9.3.tar.gz.asc";>PGP</a>] + [<a href="http://www.us.apache.org/dist/storm/apache-storm-0.9.3/apache-storm-0.9.3.tar.gz.sha";>SHA512</a>] + [<a href="http://www.us.apache.org/dist/storm/apache-storm-0.9.3/apache-storm-0.9.3.tar.gz.md5";>MD5</a>] + </li> + <li><a href="http://www.apache.org/dyn/closer.cgi/storm/apache-storm-0.9.3/apache-storm-0.9.3.zip";>apache-storm-0.9.3.zip</a> + [<a href="http://www.us.apache.org/dist/storm/apache-storm-0.9.3/apache-storm-0.9.3.zip.asc";>PGP</a>] + [<a href="http://www.us.apache.org/dist/storm/apache-storm-0.9.3/apache-storm-0.9.3.zip.sha";>SHA512</a>] + [<a href="http://www.us.apache.org/dist/storm/apache-storm-0.9.3/apache-storm-0.9.3.zip.md5";>MD5</a>] + </li> + <li><a href="http://www.apache.org/dyn/closer.cgi/storm/apache-storm-0.9.3/apache-storm-0.9.3-src.tar.gz";>apache-storm-0.9.3-src.tar.gz</a> + [<a href="http://www.us.apache.org/dist/storm/apache-storm-0.9.3/apache-storm-0.9.3-src.tar.gz.asc";>PGP</a>] + [<a href="http://www.us.apache.org/dist/storm/apache-storm-0.9.3/apache-storm-0.9.3-src.tar.gz.sha";>SHA512</a>] + [<a href="http://www.us.apache.org/dist/storm/apache-storm-0.9.3/apache-storm-0.9.3-src.tar.gz.md5";>MD5</a>] + </li> + <li><a href="http://www.apache.org/dyn/closer.cgi/storm/apache-storm-0.9.3/apache-storm-0.9.3-src.zip";>apache-storm-0.9.3-src.zip</a> + [<a href="http://www.us.apache.org/dist/storm/apache-storm-0.9.3/apache-storm-0.9.3-src.zip.asc";>PGP</a>] + [<a href="http://www.us.apache.org/dist/storm/apache-storm-0.9.3/apache-storm-0.9.3-src.zip.sha";>SHA512</a>] + [<a href="http://www.us.apache.org/dist/storm/apache-storm-0.9.3/apache-storm-0.9.3-src.zip.md5";>MD5</a>] + </li> + </ul> + + + <b>0.9.2-incubating</b> + + <ul> + <li><a href="http://www.apache.org/dyn/closer.cgi/storm/apache-storm-0.9.2-incubating/apache-storm-0.9.2-incubating.tar.gz";>apache-storm-0.9.2-incubating.tar.gz</a> + [<a href="http://www.apache.org/dist/storm/apache-storm-0.9.2-incubating/apache-storm-0.9.2-incubating.tar.gz.asc";>PGP</a>] + [<a href="http://www.apache.org/dist/storm/apache-storm-0.9.2-incubating/apache-storm-0.9.2-incubating.tar.gz.sha";>SHA512</a>] + [<a href="http://www.apache.org/dist/storm/apache-storm-0.9.2-incubating/apache-storm-0.9.2-incubating.tar.gz.md5";>MD5</a>] + </li> + <li><a href="http://www.apache.org/dyn/closer.cgi/storm/apache-storm-0.9.2-incubating/apache-storm-0.9.2-incubating.zip";>apache-storm-0.9.2-incubating.zip</a> + [<a href="http://www.apache.org/dist/storm/apache-storm-0.9.2-incubating/apache-storm-0.9.2-incubating.zip.asc";>PGP</a>] + [<a href="http://www.apache.org/dist/storm/apache-storm-0.9.2-incubating/apache-storm-0.9.2-incubating.zip.sha";>SHA512</a>] + [<a href="http://www.apache.org/dist/storm/apache-storm-0.9.2-incubating/apache-storm-0.9.2-incubating.zip.md5";>MD5</a>] + </li> + <li><a href="http://www.apache.org/dyn/closer.cgi/storm/apache-storm-0.9.2-incubating/apache-storm-0.9.2-incubating-src.tar.gz";>apache-storm-0.9.2-incubating-src.tar.gz</a> + [<a href="http://www.apache.org/dist/storm/apache-storm-0.9.2-incubating/apache-storm-0.9.2-incubating-src.tar.gz.asc";>PGP</a>] + [<a href="http://www.apache.org/dist/storm/apache-storm-0.9.2-incubating/apache-storm-0.9.2-incubating-src.tar.gz.sha";>SHA512</a>] + [<a href="http://www.apache.org/dist/storm/apache-storm-0.9.2-incubating/apache-storm-0.9.2-incubating-src.tar.gz.md5";>MD5</a>] + </li> + <li><a href="http://www.apache.org/dyn/closer.cgi/storm/apache-storm-0.9.2-incubating/apache-storm-0.9.2-incubating-src.zip";>apache-storm-0.9.2-incubating-src.zip</a> + [<a href="http://www.apache.org/dist/storm/apache-storm-0.9.2-incubating/apache-storm-0.9.2-incubating-src.zip.asc";>PGP</a>] + [<a href="http://www.apache.org/dist/storm/apache-storm-0.9.2-incubating/apache-storm-0.9.2-incubating-src.zip.sha";>SHA512</a>] + [<a href="http://www.apache.org/dist/storm/apache-storm-0.9.2-incubating/apache-storm-0.9.2-incubating-src.zip.md5";>MD5</a>] + </li> + </ul> + + + <b>0.9.1-incubating</b> + + <ul> + <li><a href="http://www.apache.org/dyn/closer.cgi/storm/apache-storm-0.9.1-incubating/apache-storm-0.9.1-incubating.tar.gz";>apache-storm-0.9.1-incubating.tar.gz</a> + [<a href="http://www.apache.org/dist/storm/apache-storm-0.9.1-incubating/apache-storm-0.9.1-incubating.tar.gz.asc";>PGP</a>] + [<a href="http://www.apache.org/dist/storm/apache-storm-0.9.1-incubating/apache-storm-0.9.1-incubating.tar.gz.sha";>SHA512</a>] + [<a href="http://www.apache.org/dist/storm/apache-storm-0.9.1-incubating/apache-storm-0.9.1-incubating.tar.gz.md5";>MD5</a>] + </li> + <li><a href="http://www.apache.org/dyn/closer.cgi/storm/apache-storm-0.9.1-incubating/apache-storm-0.9.1-incubating.zip";>apache-storm-0.9.1-incubating.zip</a> + [<a href="http://www.apache.org/dist/storm/apache-storm-0.9.1-incubating/apache-storm-0.9.1-incubating.zip.asc";>PGP</a>] + [<a href="http://www.apache.org/dist/storm/apache-storm-0.9.1-incubating/apache-storm-0.9.1-incubating.zip.sha";>SHA512</a>] + [<a href="http://www.apache.org/dist/storm/apache-storm-0.9.1-incubating/apache-storm-0.9.1-incubating.zip.md5";>MD5</a>] + </li> + <li><a href="http://www.apache.org/dyn/closer.cgi/storm/apache-storm-0.9.1-incubating/apache-storm-0.9.1-incubating-src.tar.gz";>apache-storm-0.9.1-incubating-src.tar.gz</a> + [<a href="http://www.apache.org/dist/storm/apache-storm-0.9.1-incubating/apache-storm-0.9.1-incubating-src.tar.gz.asc";>PGP</a>] + [<a href="http://www.apache.org/dist/storm/apache-storm-0.9.1-incubating/apache-storm-0.9.1-incubating-src.tar.gz.sha";>SHA512</a>] + [<a href="http://www.apache.org/dist/storm/apache-storm-0.9.1-incubating/apache-storm-0.9.1-incubating-src.tar.gz.md5";>MD5</a>] + </li> + <li><a href="http://www.apache.org/dyn/closer.cgi/storm/apache-storm-0.9.1-incubating/apache-storm-0.9.1-incubating-src.zip";>apache-storm-0.9.1-incubating-src.zip</a> + [<a href="http://www.apache.org/dist/storm/apache-storm-0.9.1-incubating/apache-storm-0.9.1-incubating-src.zip.asc";>PGP</a>] + [<a href="http://www.apache.org/dist/storm/apache-storm-0.9.1-incubating/apache-storm-0.9.1-incubating-src.zip.sha";>SHA512</a>] + [<a href="http://www.apache.org/dist/storm/apache-storm-0.9.1-incubating/apache-storm-0.9.1-incubating-src.zip.md5";>MD5</a>] + </li> + </ul> + + <h3>Historical (non-Apache) Releases</h3> + <b>NOTE:</b> The following releases are neither a top-level Apache releases nor Apache Incubator releases. They are not endorsed by the Apache Software Foundation, nor hosted by Apache.</b> + <ul> + <li><a href="https://dl.dropboxusercontent.com/s/dj86w8ojecgsam7/storm-0.9.0.1.zip";>storm-0.9.0.1.zip</a> + [<a href="release/storm-0.9.0.1.zip.asc">PGP</a>] + [<a href="release/storm-0.9.0.1.zip.sha">SHA512</a>] + [<a href="release/storm-0.9.0.1.zip.md5">MD5</a>] + </li> + <li><a href="https://dl.dropboxusercontent.com/s/tqdpoif32gufapo/storm-0.9.0.1.tar.gz";>storm-0.9.0.1.tar.gz</a> + [<a href="release/storm-0.9.0.1.tar.gz.asc">PGP</a>] + [<a href="release/storm-0.9.0.1.tar.gz.sha">SHA512</a>] + [<a href="release/storm-0.9.0.1.tar.gz.md5">MD5</a>] + </li> + + + <li><a href="https://dl.dropboxusercontent.com/s/t8m516l2kadt7c6/storm-0.9.0-rc3.zip";>Storm 0.9.0-rc3</a> + [<a href="release/storm-0.9.0-rc3.zip.asc">PGP</a>] + [<a href="release/storm-0.9.0-rc3.zip.sha">SHA512</a>] + [<a href="release/storm-0.9.0-rc3.zip.md5">MD5</a>] + </li> + <li><a href="https://dl.dropboxusercontent.com/s/p5wf0hsdab5n9kn/storm-0.9.0-rc2.zip";>Storm 0.9.0-rc2</a> + [<a href="release/storm-0.9.0-rc2.zip.asc">PGP</a>] + [<a href="release/storm-0.9.0-rc2.zip.sha">SHA512</a>] + [<a href="release/storm-0.9.0-rc2.zip.md5">MD5</a>] + </li> + <li><a href="https://www.dropbox.com/s/fl4kr7w0oc8ihdw/storm-0.8.2.zip";>Storm 0.8.2</a></li> + + <li><a href="https://www.dropbox.com/s/smesqx9uwa7f0qk/storm-0.8.1.zip";>Storm 0.8.1</a></li> + + <li><a href="https://www.dropbox.com/s/a6lgds9wbki04d2/storm-0.8.0.zip";>Storm 0.8.0</a></li> + + <li><a href="https://www.dropbox.com/s/8245jp6v9eanttq/storm-0.7.4.zip";>Storm 0.7.4</a></li> + + <li><a href="https://www.dropbox.com/s/k3fmyihazj3b5c5/storm-0.7.3.zip";>Storm 0.7.3</a></li> + + <li><a href="https://www.dropbox.com/s/rzjaohlfcrx8h7l/storm-0.7.2.zip";>Storm 0.7.2</a></li> + + <li><a href="https://www.dropbox.com/s/3pr1rd8fx5kls3w/storm-0.7.1.zip";>Storm 0.7.1</a></li> + + <li><a href="https://www.dropbox.com/s/pfz2xsy3om6g9eo/storm-0.7.0.zip";>Storm 0.7.0</a></li> + + <li><a href="https://www.dropbox.com/s/eycmnk50d52fshe/storm-0.6.2.zip";>Storm 0.6.2</a></li> + + <li><a href="https://www.dropbox.com/s/jowrk06bslsp542/storm-0.6.1.zip";>Storm 0.6.1</a></li> + + <li><a href="https://www.dropbox.com/s/awr380ytrg9q2tb/storm-0.6.0.zip";>Storm 0.6.0</a></li> + + <li><a href="https://www.dropbox.com/s/8ep0oujz1et8sdd/storm-0.5.4.zip";>Storm 0.5.4</a></li> + + <li><a href="https://www.dropbox.com/s/iqnt220u43wapqw/storm-0.5.3.zip";>Storm 0.5.3</a></li> + + <li><a href="https://www.dropbox.com/s/ycbts1ljwe27n08/storm-0.5.2.zip";>Storm 0.5.2</a></li> + + <li><a href="https://www.dropbox.com/s/xlg3j5zy1tbe24t/storm-0.5.1.zip";>Storm 0.5.1</a></li> + + <li><a href="https://www.dropbox.com/s/m233lpi1pj37e8x/storm-0.5.0.zip";>Storm 0.5.0</a></li> + + </ul> + </div> + </div> + </div> +</div> + + </div> + </div> + </div> +<footer> + <div class="container-fluid"> + <div class="row"> + <div class="col-md-3"> + <div class="footer-widget"> + <h5>Meetups</h5> + <ul class="latest-news"> + <li><a href="http://www.meetup.com/Apache-Storm-Apache-Kafka/";>Sunnyvale, CA</a> <span class="small">(10 May 2015)</span></li> + <li><a href="http://www.meetup.com/Apache-Storm-Kafka-Users/";>Seatle, WA</a> <span class="small">(27 Jun 2015)</span></li> + </ul> + </div> + </div> + <div class="col-md-3"> + <div class="footer-widget"> + <h5>About Storm</h5> + <p>Storm integrates with any queueing system and any database system. Storm's spout abstraction makes it easy to integrate a new queuing system. Likewise, integrating Storm with database systems is easy.</p> + </div> + </div> + <div class="col-md-3"> + <div class="footer-widget"> + <h5>First Look</h5> + <ul class="footer-list"> + <li><a href="/documentation/Rationale.html">Rationale</a></li> + <li><a href="/tutorial.html">Tutorial</a></li> + <li><a href="/documentation/Setting-up-development-environment.html">Setting up development environment</a></li> + <li><a href="/documentation/Creating-a-new-Storm-project.html">Creating a new Storm project</a></li> + </ul> + </div> + </div> + <div class="col-md-3"> + <div class="footer-widget"> + <h5>Documentation</h5> + <ul class="footer-list"> + <li><a href="/doc-index.html">Index</a></li> + <li><a href="/documentation.html">Manual</a></li> + <li><a href="https://storm.apache.org/javadoc/apidocs/index.html";>Javadoc</a></li> + <li><a href="/documentation/FAQ.html">FAQ</a></li> + </ul> + </div> + </div> + </div> + <hr/> + <div class="row"> + <div class="col-md-12"> + <p align="center">Copyright © 2015 <a href="http://www.apache.org";>Apache Software Foundation</a>. All Rights Reserved. Apache Storm, Apache, the Apache feather logo, and the Apache Storm project logos are trademarks of The Apache Software Foundation. All other marks mentioned may be trademarks or registered trademarks of their respective owners.</p> + </div> + </div> + </div> +</footer> +<!--Footer End--> +<!-- Scroll to top --> +<span class="totop"><a href="#"><i class="fa fa-angle-up"></i></a></span> + +</body> + +</html> + http://git-wip-us.apache.org/repos/asf/storm/blob/1d09012e/_site/favicon.ico ---------------------------------------------------------------------- diff --git a/_site/favicon.ico b/_site/favicon.ico new file mode 100644 index 0000000..7149e2e Binary files /dev/null and b/_site/favicon.ico differ http://git-wip-us.apache.org/repos/asf/storm/blob/1d09012e/_site/favicon.png ---------------------------------------------------------------------- diff --git a/_site/favicon.png b/_site/favicon.png new file mode 100644 index 0000000..1ae6ecb Binary files /dev/null and b/_site/favicon.png differ
