Modified: flink/site/docs/0.8/faq.html URL: http://svn.apache.org/viewvc/flink/site/docs/0.8/faq.html?rev=1657551&r1=1657550&r2=1657551&view=diff ============================================================================== --- flink/site/docs/0.8/faq.html (original) +++ flink/site/docs/0.8/faq.html Thu Feb 5 12:21:38 2015 @@ -42,7 +42,7 @@ under the License. <div class="container"> <div class="row"> <div class="col-md-1 af-mobile-nav-bar"> - <a href="index.html" title="Home"> + <a href="http://flink.apache.org"; title="Home"> <img class="hidden-xs hidden-sm img-responsive" src="img/logo.png" alt="Apache Flink Logo"> </a> @@ -311,7 +311,7 @@ breaks.</p> at org.apache.flinkruntime.fs.hdfs.DistributedFileSystem.initialize<span class="o">(</span>DistributedFileSystem.java:276</code></pre></div> <p>Please refer to the <a href="/downloads.html#maven">download page</a> and -the <a href="https://github.com/apache/incubator-flink/blob/master/README.md";>build instructions</a> +the <a href="https://github.com/apache/flink/blob/master/README.md";>build instructions</a> for details on how to set up Flink for different Hadoop and HDFS versions.</p> <h3 id="in-eclipse-i-get-compilation-errors-in-the-scala-projects">In Eclipse, I get compilation errors in the Scala projects</h3> @@ -515,7 +515,7 @@ open source project in the next versions <p><a href="programming_guide.html#accumulators--counters">Flinkâs Accumulators</a> work very similar like [Hadoopâs counters, but are more powerful.</p> -<p>Flink has a <a href="https://github.com/apache/incubator-flink/blob/master//flink-core/src/main/java/org/apache/flink/api/common/cache/DistributedCache.java";>Distributed Cache</a> that is deeply integrated with the APIs. Please refer to the <a href="https://github.com/apache/incubator-flink/blob/master//flink-java/src/main/java/org/apache/flink/api/java/ExecutionEnvironment.java#L561";>JavaDocs</a> for details on how to use it.</p> +<p>Flink has a <a href="https://github.com/apache/flink/blob/master//flink-core/src/main/java/org/apache/flink/api/common/cache/DistributedCache.java";>Distributed Cache</a> that is deeply integrated with the APIs. Please refer to the <a href="https://github.com/apache/flink/blob/master//flink-java/src/main/java/org/apache/flink/api/java/ExecutionEnvironment.java#L561";>JavaDocs</a> for details on how to use it.</p> <p>In order to make data sets available on all tasks, we encourage you to use <a href="programming_guide.html#broadcast-variables">Broadcast Variables</a> instead. They are more efficient and easier to use than the distributed cache.</p>
Modified: flink/site/docs/0.8/hadoop_compatibility.html URL: http://svn.apache.org/viewvc/flink/site/docs/0.8/hadoop_compatibility.html?rev=1657551&r1=1657550&r2=1657551&view=diff ============================================================================== --- flink/site/docs/0.8/hadoop_compatibility.html (original) +++ flink/site/docs/0.8/hadoop_compatibility.html Thu Feb 5 12:21:38 2015 @@ -42,7 +42,7 @@ under the License. <div class="container"> <div class="row"> <div class="col-md-1 af-mobile-nav-bar"> - <a href="index.html" title="Home"> + <a href="http://flink.apache.org"; title="Home"> <img class="hidden-xs hidden-sm img-responsive" src="img/logo.png" alt="Apache Flink Logo"> </a> Modified: flink/site/docs/0.8/how_to_contribute.html URL: http://svn.apache.org/viewvc/flink/site/docs/0.8/how_to_contribute.html?rev=1657551&r1=1657550&r2=1657551&view=diff ============================================================================== --- flink/site/docs/0.8/how_to_contribute.html (original) +++ flink/site/docs/0.8/how_to_contribute.html Thu Feb 5 12:21:38 2015 @@ -42,7 +42,7 @@ under the License. <div class="container"> <div class="row"> <div class="col-md-1 af-mobile-nav-bar"> - <a href="index.html" title="Home"> + <a href="http://flink.apache.org"; title="Home"> <img class="hidden-xs hidden-sm img-responsive" src="img/logo.png" alt="Apache Flink Logo"> </a> Modified: flink/site/docs/0.8/index.html URL: http://svn.apache.org/viewvc/flink/site/docs/0.8/index.html?rev=1657551&r1=1657550&r2=1657551&view=diff ============================================================================== --- flink/site/docs/0.8/index.html (original) +++ flink/site/docs/0.8/index.html Thu Feb 5 12:21:38 2015 @@ -42,7 +42,7 @@ under the License. <div class="container"> <div class="row"> <div class="col-md-1 af-mobile-nav-bar"> - <a href="index.html" title="Home"> + <a href="http://flink.apache.org"; title="Home"> <img class="hidden-xs hidden-sm img-responsive" src="img/logo.png" alt="Apache Flink Logo"> </a> @@ -164,8 +164,8 @@ a thorough introduction of the Flink API <h2 id="download">Download</h2> -<p>You can download Flink from the <a href="http://flink.incubator.apache.org/downloads.html";>downloads</a> page -of the <a href="http://flink.incubator.apache.org";>project website</a>. This documentation is for version 0.8.0. Be careful +<p>You can download Flink from the <a href="http://flink.apache.org/downloads.html";>downloads</a> page +of the <a href="http://flink.apache.org";>project website</a>. This documentation is for version 0.8.0. Be careful when picking a version, there are different versions depending on the Hadoop and/or HDFS version that you want to use with Flink. Please refer to <a href="building.html">building</a> if you want to build Flink yourself from the source.</p> Modified: flink/site/docs/0.8/internal_add_operator.html URL: http://svn.apache.org/viewvc/flink/site/docs/0.8/internal_add_operator.html?rev=1657551&r1=1657550&r2=1657551&view=diff ============================================================================== --- flink/site/docs/0.8/internal_add_operator.html (original) +++ flink/site/docs/0.8/internal_add_operator.html Thu Feb 5 12:21:38 2015 @@ -42,7 +42,7 @@ under the License. <div class="container"> <div class="row"> <div class="col-md-1 af-mobile-nav-bar"> - <a href="index.html" title="Home"> + <a href="http://flink.apache.org"; title="Home"> <img class="hidden-xs hidden-sm img-responsive" src="img/logo.png" alt="Apache Flink Logo"> </a> @@ -183,7 +183,7 @@ new functionality does require a new run <p>Many operators can be implemented as a specialization of another operator, or by means of a UDF.</p> <p>The simplest example are the <code>sum()</code>, <code>min()</code>, and <code>max()</code> functions on the -<a href="https://github.com/apache/incubator-flink/blob/master//flink-java/src/main/java/org/apache/flink/api/java/DataSet.java";>DataSet</a>. +<a href="https://github.com/apache/flink/blob/master//flink-java/src/main/java/org/apache/flink/api/java/DataSet.java";>DataSet</a>. These functions simply call other operations with some pre-defined parameters:</p> <div class="highlight"><pre><code class="language-java"><span class="kd">public</span> <span class="n">AggregateOperator</span><span class="o"><</span><span class="n">T</span><span class="o">></span> <span class="nf">sum</span> <span class="o">(</span><span class="kt">int</span> <span class="n">field</span><span class="o">)</span> <span class="o">{</span> @@ -193,7 +193,7 @@ These functions simply call other operat <p>Some operations can be implemented as compositions of multiple other operators. An example is to implement a <em>count()</em> function through a combination of <em>map</em> and <em>aggregate</em>. </p> -<p>A simple way to do this is to define a function on the <a href="https://github.com/apache/incubator-flink/blob/master//flink-java/src/main/java/org/apache/flink/api/java/DataSet.java";>DataSet</a> that calls <em>map(â¦)</em> and <em>reduce(â¦)</em> in turn:</p> +<p>A simple way to do this is to define a function on the <a href="https://github.com/apache/flink/blob/master//flink-java/src/main/java/org/apache/flink/api/java/DataSet.java";>DataSet</a> that calls <em>map(â¦)</em> and <em>reduce(â¦)</em> in turn:</p> <div class="highlight"><pre><code class="language-java"><span class="kd">public</span> <span class="n">DataSet</span><span class="o"><</span><span class="n">Long</span><span class="o">></span> <span class="nf">count</span><span class="o">()</span> <span class="o">{</span> <span class="k">return</span> <span class="k">this</span><span class="o">.</span><span class="na">map</span><span class="o">(</span><span class="k">new</span> <span class="n">MapFunction</span><span class="o"><</span><span class="n">T</span><span class="o">,</span> <span class="n">Long</span><span class="o">>()</span> <span class="o">{</span> @@ -217,9 +217,9 @@ into another class. The example of the < <h3 id="more-complex-operators">More Complex Operators</h3> -<p>A more complex example of an operation via specialization is the <a href="https://github.com/apache/incubator-flink/blob/master//flink-java/src/main/java/org/apache/flink/api/java/operators/AggregateOperator.java";>Aggregation Operation</a> in the Java API. It is implemented by means of a <em>GroupReduce</em> UDF.</p> +<p>A more complex example of an operation via specialization is the <a href="https://github.com/apache/flink/blob/master//flink-java/src/main/java/org/apache/flink/api/java/operators/AggregateOperator.java";>Aggregation Operation</a> in the Java API. It is implemented by means of a <em>GroupReduce</em> UDF.</p> -<p>The Aggregate Operation comes with its own operator in the <em>Java API</em>, but translates itself into a <a href="https://github.com/apache/incubator-flink/blob/master//flink-core/src/main/java/org/apache/flink/api/common/operators/base/GroupReduceOperatorBase.java";>GroupReduceOperatorBase</a> in the <em>Common API</em>. (see <a href="internal_program_life_cycle.html">Program Life Cycle</a> for details of how an operation from the <em>Java API</em> becomes an operation of the <em>Common API</em> and finally a runtime operation.) +<p>The Aggregate Operation comes with its own operator in the <em>Java API</em>, but translates itself into a <a href="https://github.com/apache/flink/blob/master//flink-core/src/main/java/org/apache/flink/api/common/operators/base/GroupReduceOperatorBase.java";>GroupReduceOperatorBase</a> in the <em>Common API</em>. (see <a href="internal_program_life_cycle.html">Program Life Cycle</a> for details of how an operation from the <em>Java API</em> becomes an operation of the <em>Common API</em> and finally a runtime operation.) The Java API aggregation operator is only a builder that takes the types of aggregations and the field positions, and used that information to parameterize the GroupReduce UDF that performs the aggregations.</p> @@ -234,7 +234,7 @@ The <em>CustomUnaryOperation</em> interf <span class="n">DataSet</span><span class="o"><</span><span class="n">OUT</span><span class="o">></span> <span class="nf">createResult</span><span class="o">();</span></code></pre></div> -<p>The <a href="https://github.com/apache/incubator-flink/blob/master//flink-addons/flink-spargel/src/main/java/org/apache/flink/spargel/java/VertexCentricIteration.java";>VertexCentricIteration</a> operator is implemented that way. Below is an example how to implement the <em>count()</em> operator that way.</p> +<p>The <a href="https://github.com/apache/flink/blob/master//flink-addons/flink-spargel/src/main/java/org/apache/flink/spargel/java/VertexCentricIteration.java";>VertexCentricIteration</a> operator is implemented that way. Below is an example how to implement the <em>count()</em> operator that way.</p> <div class="highlight"><pre><code class="language-java"><span class="kd">public</span> <span class="kd">class</span> <span class="nc">Counter</span><span class="o"><</span><span class="n">T</span><span class="o">></span> <span class="kd">implements</span> <span class="n">CustomUnaryOperation</span><span class="o"><</span><span class="n">T</span><span class="o">,</span> <span class="n">Long</span><span class="o">></span> <span class="o">{</span> @@ -268,7 +268,7 @@ function, but invoked only once per para <p><strong>Runtime</strong></p> -<p>Runtime Operators are implemented using the <a href="https://github.com/apache/incubator-flink/blob/master//flink-runtime/src/main/java/org/apache/flink/runtime/operators/PactDriver.java";>Driver</a> interface. The interface defines the methods that describe the operator towards the runtime. The <a href="https://github.com/apache/incubator-flink/blob/master//flink-runtime/src/main/java/org/apache/flink/runtime/operators/MapDriver.java";>MapDriver</a> serves as a simple example of how those operators work.</p> +<p>Runtime Operators are implemented using the <a href="https://github.com/apache/flink/blob/master//flink-runtime/src/main/java/org/apache/flink/runtime/operators/PactDriver.java";>Driver</a> interface. The interface defines the methods that describe the operator towards the runtime. The <a href="https://github.com/apache/flink/blob/master//flink-runtime/src/main/java/org/apache/flink/runtime/operators/MapDriver.java";>MapDriver</a> serves as a simple example of how those operators work.</p> <p>The runtime works with the <code>MutableObjectIterator</code>, which describes data streams with the ability to reuse objects, to reduce pressure on the garbage collector.</p> @@ -290,8 +290,8 @@ function, but invoked only once per para operators run in the same thread as their preceding operator, and work with nested function calls. This is very efficient, because it saves serialization/deserialization overhead.</p> -<p>To learn how to implement a chained operator, take a look at the <a href="https://github.com/apache/incubator-flink/blob/master//flink-runtime/src/main/java/org/apache/flink/runtime/operators/MapDriver.java";>MapDriver</a> (regular) and the -<a href="https://github.com/apache/incubator-flink/blob/master//flink-runtime/src/main/java/org/apache/flink/runtime/operators/chaining/ChainedMapDriver.java";>ChainedMapDriver</a> (chained variant).</p> +<p>To learn how to implement a chained operator, take a look at the <a href="https://github.com/apache/flink/blob/master//flink-runtime/src/main/java/org/apache/flink/runtime/operators/MapDriver.java";>MapDriver</a> (regular) and the +<a href="https://github.com/apache/flink/blob/master//flink-runtime/src/main/java/org/apache/flink/runtime/operators/chaining/ChainedMapDriver.java";>ChainedMapDriver</a> (chained variant).</p> <h3 id="optimizercompiler">Optimizer/Compiler</h3> @@ -300,17 +300,17 @@ To allow the optimizer to include a new <ul> <li> - <p><em><a href="https://github.com/apache/incubator-flink/blob/master//flink-runtime/src/main/java/org/apache/flink/runtime/operators/DriverStrategy.java";>DriverStrategy</a></em>: The operation needs to be added to the Enum, to make it available to the optimizer. The parameters to the Enum entry define which class implements the runtime operator, its chained version, whether the operator accumulates records (and needs memory for that), and whether it requires a comparator (works on keys). For our example, we can add the entry + <p><em><a href="https://github.com/apache/flink/blob/master//flink-runtime/src/main/java/org/apache/flink/runtime/operators/DriverStrategy.java";>DriverStrategy</a></em>: The operation needs to be added to the Enum, to make it available to the optimizer. The parameters to the Enum entry define which class implements the runtime operator, its chained version, whether the operator accumulates records (and needs memory for that), and whether it requires a comparator (works on keys). For our example, we can add the entry ~~~ java MAP_PARTITION(MapPartitionDriver.class, null /* or chained variant */, PIPELINED, false) ~~~</p> </li> <li> - <p><em>Cost function</em>: The class <a href="https://github.com/apache/incubator-flink/blob/master//flink-compiler/src/main/java/org/apache/flink/compiler/costs/CostEstimator.java";>CostEstimator</a> needs to know how expensive the operation is to the system. The costs here refer to the non-UDF part of the operator. Since the operator does essentially no work (it forwards the record stream to the UDF), the costs are zero. We change the <code>costOperator(...)</code> method by adding the <em>MAP_PARTITION</em> constant to the switch statement similar to the <em>MAP</em> constant such that no cost is accounted for it.</p> + <p><em>Cost function</em>: The class <a href="https://github.com/apache/flink/blob/master//flink-compiler/src/main/java/org/apache/flink/compiler/costs/CostEstimator.java";>CostEstimator</a> needs to know how expensive the operation is to the system. The costs here refer to the non-UDF part of the operator. Since the operator does essentially no work (it forwards the record stream to the UDF), the costs are zero. We change the <code>costOperator(...)</code> method by adding the <em>MAP_PARTITION</em> constant to the switch statement similar to the <em>MAP</em> constant such that no cost is accounted for it.</p> </li> <li> - <p><em>OperatorDescriptor</em>: The operator descriptors define how an operation needs to be treated by the optimizer. They describe how the operation requires the input data to be (e.g., sorted or partitioned) and that way allows the optimizer to optimize the data movement, sorting, grouping in a global fashion. They do that by describing which <a href="https://github.com/apache/incubator-flink/blob/master//flink-compiler/src/main/java/org/apache/flink/compiler/dataproperties/RequestedGlobalProperties.java";>RequestedGlobalProperties</a> (partitioning, replication, etc) and which <a href="https://github.com/apache/incubator-flink/blob/master//flink-compiler/src/main/java/org/apache/flink/compiler/dataproperties/RequestedLocalProperties.java";>RequestedLocalProperties</a> (sorting, grouping, uniqueness) the operator has, as well as how the operator affects the existing <a href="https://github.com/apache/incubator-flink/blob/master//flink-compiler/src/main/java/org/apache/flink/com piler/dataproperties/GlobalProperties.java">GlobalProperties</a> and <a href="https://github.com/apache/incubator-flink/blob/master//flink-compiler/src/main/java/org/apache/flink/compiler/dataproperties/LocalProperties.java";>LocalProperties</a>. In addition, it defines a few utility methods, for example to instantiate an operator candidate. -Since the <em>mapPartition()</em> function is very simple (no requirements on partitioning/grouping), the descriptor is very simple. Other operators have more complex requirements, for example the <a href="https://github.com/apache/incubator-flink/blob/master//flink-compiler/src/main/java/org/apache/flink/compiler/operators/GroupReduceProperties.java";>GroupReduce</a>. Some operators, like <em>join</em> have multiple ways in which they can be executed and therefore have multiple descriptors (<a href="https://github.com/apache/incubator-flink/blob/master//flink-compiler/src/main/java/org/apache/flink/compiler/operators/HashJoinBuildFirstProperties.java";>Hash Join 1</a>, <a href="https://github.com/apache/incubator-flink/blob/master//flink-compiler/src/main/java/org/apache/flink/compiler/operators/HashJoinBuildSecondProperties.java";>Hash Join 2</a>, <a href="https://github.com/apache/incubator-flink/blob/master//flink-compiler/src/main/java/org/apache/flink/compiler/operators/SortMerge JoinDescriptor.java">SortMerge Join</a>). + <p><em>OperatorDescriptor</em>: The operator descriptors define how an operation needs to be treated by the optimizer. They describe how the operation requires the input data to be (e.g., sorted or partitioned) and that way allows the optimizer to optimize the data movement, sorting, grouping in a global fashion. They do that by describing which <a href="https://github.com/apache/flink/blob/master//flink-compiler/src/main/java/org/apache/flink/compiler/dataproperties/RequestedGlobalProperties.java";>RequestedGlobalProperties</a> (partitioning, replication, etc) and which <a href="https://github.com/apache/flink/blob/master//flink-compiler/src/main/java/org/apache/flink/compiler/dataproperties/RequestedLocalProperties.java";>RequestedLocalProperties</a> (sorting, grouping, uniqueness) the operator has, as well as how the operator affects the existing <a href="https://github.com/apache/flink/blob/master//flink-compiler/src/main/java/org/apache/flink/compiler/dataproperties/GlobalPro perties.java">GlobalProperties</a> and <a href="https://github.com/apache/flink/blob/master//flink-compiler/src/main/java/org/apache/flink/compiler/dataproperties/LocalProperties.java";>LocalProperties</a>. In addition, it defines a few utility methods, for example to instantiate an operator candidate. +Since the <em>mapPartition()</em> function is very simple (no requirements on partitioning/grouping), the descriptor is very simple. Other operators have more complex requirements, for example the <a href="https://github.com/apache/flink/blob/master//flink-compiler/src/main/java/org/apache/flink/compiler/operators/GroupReduceProperties.java";>GroupReduce</a>. Some operators, like <em>join</em> have multiple ways in which they can be executed and therefore have multiple descriptors (<a href="https://github.com/apache/flink/blob/master//flink-compiler/src/main/java/org/apache/flink/compiler/operators/HashJoinBuildFirstProperties.java";>Hash Join 1</a>, <a href="https://github.com/apache/flink/blob/master//flink-compiler/src/main/java/org/apache/flink/compiler/operators/HashJoinBuildSecondProperties.java";>Hash Join 2</a>, <a href="https://github.com/apache/flink/blob/master//flink-compiler/src/main/java/org/apache/flink/compiler/operators/SortMergeJoinDescriptor.java";>SortMerge Join</a>) . The code sample below explains (with comments) how to create a descriptor for the <em>MapPartitionOperator</em> </p> <div class="highlight"><pre><code class="language-java"> <span class="kd">public</span> <span class="n">DriverStrategy</span> <span class="nf">getStrategy</span><span class="o">()</span> <span class="o">{</span> @@ -346,17 +346,17 @@ The code sample below explains (with com <span class="o">}</span></code></pre></div> </li> <li> - <p><em>OptimizerNode</em>: The optimizer node is the place where all comes together. It creates the list of <em>OperatorDescriptors</em>, implements the result data set size estimation, and assigns a name to the operation. It is a relatively small class and can be more or less copied again from the <a href="https://github.com/apache/incubator-flink/blob/master//flink-compiler/src/main/java/org/apache/flink/compiler/dag/MapNode.java";>MapNode</a>.</p> + <p><em>OptimizerNode</em>: The optimizer node is the place where all comes together. It creates the list of <em>OperatorDescriptors</em>, implements the result data set size estimation, and assigns a name to the operation. It is a relatively small class and can be more or less copied again from the <a href="https://github.com/apache/flink/blob/master//flink-compiler/src/main/java/org/apache/flink/compiler/dag/MapNode.java";>MapNode</a>.</p> </li> </ul> <h3 id="common-api">Common API</h3> <p>To make the operation available to the higher-level APIs, it needs to be added to the Common API. The simplest way to do this is to add a -base operator. Create a class <code>MapPartitionOperatorBase</code>, after the pattern of the <a href="https://github.com/apache/incubator-flink/blob/master//flink-core/src/main/java/org/apache/flink/api/common/operators/base/MapOperatorBase.java";>MapOperatorBase</a>.</p> +base operator. Create a class <code>MapPartitionOperatorBase</code>, after the pattern of the <a href="https://github.com/apache/flink/blob/master//flink-core/src/main/java/org/apache/flink/api/common/operators/base/MapOperatorBase.java";>MapOperatorBase</a>.</p> <p>In addition, the optimizer needs to know which OptimizerNode how to create an OptimizerNode from the OperatorBase. This happens in the class -<code>GraphCreatingVisitor</code> in the <a href="https://github.com/apache/incubator-flink/blob/master//flink-compiler/src/main/java/org/apache/flink/compiler/PactCompiler.java";>Optimizer</a>.</p> +<code>GraphCreatingVisitor</code> in the <a href="https://github.com/apache/flink/blob/master//flink-compiler/src/main/java/org/apache/flink/compiler/PactCompiler.java";>Optimizer</a>.</p> <p><em>Note:</em> A pending idea is to allow to skip this step by unifying the OptimizerNode and the Common API operator. They essentially fulfill the same function. The Common API operator exists only in order for the <code>flink-java</code> and <code>flink-scala</code> packages to not have a dependency on the @@ -364,7 +364,7 @@ optimizer.</p> <h3 id="java-api">Java API</h3> -<p>Create a Java API operator that is constructed in the same way as the <a href="https://github.com/apache/incubator-flink/blob/master//flink-java/src/main/java/org/apache/flink/api/java/operators/MapOperator.java";>MapOperator</a>. The core method is the <code>translateToDataFlow(...)</code> method, which creates the Common API operator for the Java API operator.</p> +<p>Create a Java API operator that is constructed in the same way as the <a href="https://github.com/apache/flink/blob/master//flink-java/src/main/java/org/apache/flink/api/java/operators/MapOperator.java";>MapOperator</a>. The core method is the <code>translateToDataFlow(...)</code> method, which creates the Common API operator for the Java API operator.</p> <p>The final step is to add a function to the <code>DataSet</code> class:</p> Modified: flink/site/docs/0.8/internal_distributed_runtime.html URL: http://svn.apache.org/viewvc/flink/site/docs/0.8/internal_distributed_runtime.html?rev=1657551&r1=1657550&r2=1657551&view=diff ============================================================================== --- flink/site/docs/0.8/internal_distributed_runtime.html (original) +++ flink/site/docs/0.8/internal_distributed_runtime.html Thu Feb 5 12:21:38 2015 @@ -42,7 +42,7 @@ under the License. <div class="container"> <div class="row"> <div class="col-md-1 af-mobile-nav-bar"> - <a href="index.html" title="Home"> + <a href="http://flink.apache.org"; title="Home"> <img class="hidden-xs hidden-sm img-responsive" src="img/logo.png" alt="Apache Flink Logo"> </a> Modified: flink/site/docs/0.8/internal_general_arch.html URL: http://svn.apache.org/viewvc/flink/site/docs/0.8/internal_general_arch.html?rev=1657551&r1=1657550&r2=1657551&view=diff ============================================================================== --- flink/site/docs/0.8/internal_general_arch.html (original) +++ flink/site/docs/0.8/internal_general_arch.html Thu Feb 5 12:21:38 2015 @@ -42,7 +42,7 @@ under the License. <div class="container"> <div class="row"> <div class="col-md-1 af-mobile-nav-bar"> - <a href="index.html" title="Home"> + <a href="http://flink.apache.org"; title="Home"> <img class="hidden-xs hidden-sm img-responsive" src="img/logo.png" alt="Apache Flink Logo"> </a> Modified: flink/site/docs/0.8/internal_job_scheduling.html URL: http://svn.apache.org/viewvc/flink/site/docs/0.8/internal_job_scheduling.html?rev=1657551&r1=1657550&r2=1657551&view=diff ============================================================================== --- flink/site/docs/0.8/internal_job_scheduling.html (original) +++ flink/site/docs/0.8/internal_job_scheduling.html Thu Feb 5 12:21:38 2015 @@ -42,7 +42,7 @@ under the License. <div class="container"> <div class="row"> <div class="col-md-1 af-mobile-nav-bar"> - <a href="index.html" title="Home"> + <a href="http://flink.apache.org"; title="Home"> <img class="hidden-xs hidden-sm img-responsive" src="img/logo.png" alt="Apache Flink Logo"> </a> @@ -178,8 +178,8 @@ parallism of 3. A pipeline consists of t <img src="img/slots.svg" alt="Assigning Pipelines of Tasks to Slots" height="250px" style="text-align: center;" /> </div> -<p>Internally, Flink defines through <a href="https://github.com/apache/incubator-flink/blob/master//flink-runtime/src/main/java/org/apache/flink/runtime/jobmanager/scheduler/SlotSharingGroup.java";>SlotSharingGroup</a> -and <a href="https://github.com/apache/incubator-flink/blob/master//flink-runtime/src/main/java/org/apache/flink/runtime/jobmanager/scheduler/CoLocationGroup.java";>CoLocationGroup</a> +<p>Internally, Flink defines through <a href="https://github.com/apache/flink/blob/master//flink-runtime/src/main/java/org/apache/flink/runtime/jobmanager/scheduler/SlotSharingGroup.java";>SlotSharingGroup</a> +and <a href="https://github.com/apache/flink/blob/master//flink-runtime/src/main/java/org/apache/flink/runtime/jobmanager/scheduler/CoLocationGroup.java";>CoLocationGroup</a> which tasks may share a slot (permissive), respectively which tasks must be strictly placed into the same slot.</p> <h2 id="jobmanager-data-structures">JobManager Data Structures</h2> @@ -187,18 +187,18 @@ which tasks may share a slot (permissive <p>During job execution, the JobManager keeps track of distributed tasks, decides when to schedule the next task (or set of tasks), and reacts to finished tasks or execution failures.</p> -<p>The JobManager receives the <a href="https://github.com/apache/incubator-flink/blob/master//flink-runtime/src/main/java/org/apache/flink/runtime/jobgraph/";>JobGraph</a>, -which is a representation of the data flow consisting of operators (<a href="https://github.com/apache/incubator-flink/blob/master//flink-runtime/src/main/java/org/apache/flink/runtime/jobgraph/AbstractJobVertex.java";>JobVertex</a>) -and intermediate results (<a href="https://github.com/apache/incubator-flink/blob/master//flink-runtime/src/main/java/org/apache/flink/runtime/jobgraph/IntermediateDataSet.java";>IntermediateDataSet</a>). +<p>The JobManager receives the <a href="https://github.com/apache/flink/blob/master//flink-runtime/src/main/java/org/apache/flink/runtime/jobgraph/";>JobGraph</a>, +which is a representation of the data flow consisting of operators (<a href="https://github.com/apache/flink/blob/master//flink-runtime/src/main/java/org/apache/flink/runtime/jobgraph/AbstractJobVertex.java";>JobVertex</a>) +and intermediate results (<a href="https://github.com/apache/flink/blob/master//flink-runtime/src/main/java/org/apache/flink/runtime/jobgraph/IntermediateDataSet.java";>IntermediateDataSet</a>). Each operator has properies, like the degree of parallelism and the code that it executes. In addition, the JobGraph has a set of attached libraries, that are neccessary to execute the code of the operators.</p> -<p>The JobManager transforms the JobGraph into an <a href="https://github.com/apache/incubator-flink/blob/master//flink-runtime/src/main/java/org/apache/flink/runtime/executiongraph/";>ExecutionGraph</a>. -The ExecutionGraph is a parallel version of the JobGraph: For each JobVertex, it contains an <a href="https://github.com/apache/incubator-flink/blob/master//flink-runtime/src/main/java/org/apache/flink/runtime/executiongraph/ExecutionVertex.java";>ExecutionVertex</a> per parallel subtask. An operator with a parallelism of 100 will have one JobVertex and 100 ExecutionVertices. +<p>The JobManager transforms the JobGraph into an <a href="https://github.com/apache/flink/blob/master//flink-runtime/src/main/java/org/apache/flink/runtime/executiongraph/";>ExecutionGraph</a>. +The ExecutionGraph is a parallel version of the JobGraph: For each JobVertex, it contains an <a href="https://github.com/apache/flink/blob/master//flink-runtime/src/main/java/org/apache/flink/runtime/executiongraph/ExecutionVertex.java";>ExecutionVertex</a> per parallel subtask. An operator with a parallelism of 100 will have one JobVertex and 100 ExecutionVertices. The ExecutionVertex tracks the state of execution of a particular subtask. All ExecutionVertices from one JobVertex are held in an -<a href="https://github.com/apache/incubator-flink/blob/master//flink-runtime/src/main/java/org/apache/flink/runtime/executiongraph/ExecutionJobVertex.java";>ExecutionJobVertex</a>, +<a href="https://github.com/apache/flink/blob/master//flink-runtime/src/main/java/org/apache/flink/runtime/executiongraph/ExecutionJobVertex.java";>ExecutionJobVertex</a>, which tracks the status of the operator as a whole. -Besides the vertices, the ExecutionGraph also contains the <a href="https://github.com/apache/incubator-flink/blob/master//flink-runtime/src/main/java/org/apache/flink/runtime/executiongraph/IntermediateResult.java";>IntermediateResult</a> and the <a href="https://github.com/apache/incubator-flink/blob/master//flink-runtime/src/main/java/org/apache/flink/runtime/executiongraph/IntermediateResultPartition.java";>IntermediateResultPartition</a>. The former tracks the state of the <em>IntermediateDataSet</em>, the latter the state of each of its partitions.</p> +Besides the vertices, the ExecutionGraph also contains the <a href="https://github.com/apache/flink/blob/master//flink-runtime/src/main/java/org/apache/flink/runtime/executiongraph/IntermediateResult.java";>IntermediateResult</a> and the <a href="https://github.com/apache/flink/blob/master//flink-runtime/src/main/java/org/apache/flink/runtime/executiongraph/IntermediateResultPartition.java";>IntermediateResultPartition</a>. The former tracks the state of the <em>IntermediateDataSet</em>, the latter the state of each of its partitions.</p> <div style="text-align: center;"> <img src="img/job_and_execution_graph.svg" alt="JobGraph and ExecutionGraph" height="400px" style="text-align: center;" /> @@ -206,7 +206,7 @@ Besides the vertices, the ExecutionGraph <p>During its execution, each parallel task goes through multiple stages, from <em>created</em> to <em>finished</em> or <em>failed</em>. The diagram below illustrates the states and possible transitions between them. A task may be executed multiple times (for example in the course of failure recovery). -For that reason, the execution of an ExecutionVertex is tracked in an <a href="https://github.com/apache/incubator-flink/blob/master//flink-runtime/src/main/java/org/apache/flink/runtime/executiongraph/Execution.java";>Execution</a>. Each ExecutionVertex has a current Execution, and prior Executions.</p> +For that reason, the execution of an ExecutionVertex is tracked in an <a href="https://github.com/apache/flink/blob/master//flink-runtime/src/main/java/org/apache/flink/runtime/executiongraph/Execution.java";>Execution</a>. Each ExecutionVertex has a current Execution, and prior Executions.</p> <div style="text-align: center;"> <img src="img/state_machine.svg" alt="States and Transitions of Task Executions" height="300px" style="text-align: center;" /> Modified: flink/site/docs/0.8/internal_logging.html URL: http://svn.apache.org/viewvc/flink/site/docs/0.8/internal_logging.html?rev=1657551&r1=1657550&r2=1657551&view=diff ============================================================================== --- flink/site/docs/0.8/internal_logging.html (original) +++ flink/site/docs/0.8/internal_logging.html Thu Feb 5 12:21:38 2015 @@ -42,7 +42,7 @@ under the License. <div class="container"> <div class="row"> <div class="col-md-1 af-mobile-nav-bar"> - <a href="index.html" title="Home"> + <a href="http://flink.apache.org"; title="Home"> <img class="hidden-xs hidden-sm img-responsive" src="img/logo.png" alt="Apache Flink Logo"> </a> Modified: flink/site/docs/0.8/internal_operators_and_memory.html URL: http://svn.apache.org/viewvc/flink/site/docs/0.8/internal_operators_and_memory.html?rev=1657551&r1=1657550&r2=1657551&view=diff ============================================================================== --- flink/site/docs/0.8/internal_operators_and_memory.html (original) +++ flink/site/docs/0.8/internal_operators_and_memory.html Thu Feb 5 12:21:38 2015 @@ -42,7 +42,7 @@ under the License. <div class="container"> <div class="row"> <div class="col-md-1 af-mobile-nav-bar"> - <a href="index.html" title="Home"> + <a href="http://flink.apache.org"; title="Home"> <img class="hidden-xs hidden-sm img-responsive" src="img/logo.png" alt="Apache Flink Logo"> </a> Modified: flink/site/docs/0.8/internal_optimizer.html URL: http://svn.apache.org/viewvc/flink/site/docs/0.8/internal_optimizer.html?rev=1657551&r1=1657550&r2=1657551&view=diff ============================================================================== --- flink/site/docs/0.8/internal_optimizer.html (original) +++ flink/site/docs/0.8/internal_optimizer.html Thu Feb 5 12:21:38 2015 @@ -42,7 +42,7 @@ under the License. <div class="container"> <div class="row"> <div class="col-md-1 af-mobile-nav-bar"> - <a href="index.html" title="Home"> + <a href="http://flink.apache.org"; title="Home"> <img class="hidden-xs hidden-sm img-responsive" src="img/logo.png" alt="Apache Flink Logo"> </a> Modified: flink/site/docs/0.8/internal_overview.html URL: http://svn.apache.org/viewvc/flink/site/docs/0.8/internal_overview.html?rev=1657551&r1=1657550&r2=1657551&view=diff ============================================================================== --- flink/site/docs/0.8/internal_overview.html (original) +++ flink/site/docs/0.8/internal_overview.html Thu Feb 5 12:21:38 2015 @@ -42,7 +42,7 @@ under the License. <div class="container"> <div class="row"> <div class="col-md-1 af-mobile-nav-bar"> - <a href="index.html" title="Home"> + <a href="http://flink.apache.org"; title="Home"> <img class="hidden-xs hidden-sm img-responsive" src="img/logo.png" alt="Apache Flink Logo"> </a> Modified: flink/site/docs/0.8/internal_program_life_cycle.html URL: http://svn.apache.org/viewvc/flink/site/docs/0.8/internal_program_life_cycle.html?rev=1657551&r1=1657550&r2=1657551&view=diff ============================================================================== --- flink/site/docs/0.8/internal_program_life_cycle.html (original) +++ flink/site/docs/0.8/internal_program_life_cycle.html Thu Feb 5 12:21:38 2015 @@ -42,7 +42,7 @@ under the License. <div class="container"> <div class="row"> <div class="col-md-1 af-mobile-nav-bar"> - <a href="index.html" title="Home"> + <a href="http://flink.apache.org"; title="Home"> <img class="hidden-xs hidden-sm img-responsive" src="img/logo.png" alt="Apache Flink Logo"> </a> Modified: flink/site/docs/0.8/iterations.html URL: http://svn.apache.org/viewvc/flink/site/docs/0.8/iterations.html?rev=1657551&r1=1657550&r2=1657551&view=diff ============================================================================== --- flink/site/docs/0.8/iterations.html (original) +++ flink/site/docs/0.8/iterations.html Thu Feb 5 12:21:38 2015 @@ -42,7 +42,7 @@ under the License. <div class="container"> <div class="row"> <div class="col-md-1 af-mobile-nav-bar"> - <a href="index.html" title="Home"> + <a href="http://flink.apache.org"; title="Home"> <img class="hidden-xs hidden-sm img-responsive" src="img/logo.png" alt="Apache Flink Logo"> </a> Modified: flink/site/docs/0.8/java8_programming_guide.html URL: http://svn.apache.org/viewvc/flink/site/docs/0.8/java8_programming_guide.html?rev=1657551&r1=1657550&r2=1657551&view=diff ============================================================================== --- flink/site/docs/0.8/java8_programming_guide.html (original) +++ flink/site/docs/0.8/java8_programming_guide.html Thu Feb 5 12:21:38 2015 @@ -42,7 +42,7 @@ under the License. <div class="container"> <div class="row"> <div class="col-md-1 af-mobile-nav-bar"> - <a href="index.html" title="Home"> + <a href="http://flink.apache.org"; title="Home"> <img class="hidden-xs hidden-sm img-responsive" src="img/logo.png" alt="Apache Flink Logo"> </a> Modified: flink/site/docs/0.8/java_api_quickstart.html URL: http://svn.apache.org/viewvc/flink/site/docs/0.8/java_api_quickstart.html?rev=1657551&r1=1657550&r2=1657551&view=diff ============================================================================== --- flink/site/docs/0.8/java_api_quickstart.html (original) +++ flink/site/docs/0.8/java_api_quickstart.html Thu Feb 5 12:21:38 2015 @@ -42,7 +42,7 @@ under the License. <div class="container"> <div class="row"> <div class="col-md-1 af-mobile-nav-bar"> - <a href="index.html" title="Home"> + <a href="http://flink.apache.org"; title="Home"> <img class="hidden-xs hidden-sm img-responsive" src="img/logo.png" alt="Apache Flink Logo"> </a> @@ -273,7 +273,7 @@ is 1</code></pre></div> <span class="o">}</span> <span class="o">}</span></code></pre></div> -<p><a href="https://github.com/apache/incubator-flink/blob/master//flink-examples/flink-java-examples/src/main/java/org/apache/flink/examples/java/wordcount/WordCount.java";>Check GitHub</a> for the full example code.</p> +<p><a href="https://github.com/apache/flink/blob/master//flink-examples/flink-java-examples/src/main/java/org/apache/flink/examples/java/wordcount/WordCount.java";>Check GitHub</a> for the full example code.</p> <p>For a complete overview over our API, have a look at the <a href="programming_guide.html">Programming Guide</a> and <a href="examples.html">further example programs</a>. If you have any trouble, ask on our <a href="http://mail-archives.apache.org/mod_mbox/incubator-flink-dev/";>Mailing List</a>. We are happy to provide help.</p> Modified: flink/site/docs/0.8/local_execution.html URL: http://svn.apache.org/viewvc/flink/site/docs/0.8/local_execution.html?rev=1657551&r1=1657550&r2=1657551&view=diff ============================================================================== --- flink/site/docs/0.8/local_execution.html (original) +++ flink/site/docs/0.8/local_execution.html Thu Feb 5 12:21:38 2015 @@ -42,7 +42,7 @@ under the License. <div class="container"> <div class="row"> <div class="col-md-1 af-mobile-nav-bar"> - <a href="index.html" title="Home"> + <a href="http://flink.apache.org"; title="Home"> <img class="hidden-xs hidden-sm img-responsive" src="img/logo.png" alt="Apache Flink Logo"> </a> Modified: flink/site/docs/0.8/local_setup.html URL: http://svn.apache.org/viewvc/flink/site/docs/0.8/local_setup.html?rev=1657551&r1=1657550&r2=1657551&view=diff ============================================================================== --- flink/site/docs/0.8/local_setup.html (original) +++ flink/site/docs/0.8/local_setup.html Thu Feb 5 12:21:38 2015 @@ -42,7 +42,7 @@ under the License. <div class="container"> <div class="row"> <div class="col-md-1 af-mobile-nav-bar"> - <a href="index.html" title="Home"> + <a href="http://flink.apache.org"; title="Home"> <img class="hidden-xs hidden-sm img-responsive" src="img/logo.png" alt="Apache Flink Logo"> </a> Modified: flink/site/docs/0.8/programming_guide.html URL: http://svn.apache.org/viewvc/flink/site/docs/0.8/programming_guide.html?rev=1657551&r1=1657550&r2=1657551&view=diff ============================================================================== --- flink/site/docs/0.8/programming_guide.html (original) +++ flink/site/docs/0.8/programming_guide.html Thu Feb 5 12:21:38 2015 @@ -42,7 +42,7 @@ under the License. <div class="container"> <div class="row"> <div class="col-md-1 af-mobile-nav-bar"> - <a href="index.html" title="Home"> + <a href="http://flink.apache.org"; title="Home"> <img class="hidden-xs hidden-sm img-responsive" src="img/logo.png" alt="Apache Flink Logo"> </a> @@ -362,7 +362,7 @@ programs with a <code>main()</code> meth <p>We will now give an overview of each of those steps but please refer to the respective sections for more details. Note that all -<a href="https://github.com/apache/incubator-flink/blob/master//flink-java/src/main/java/org/apache/flink/api/java";>core classes of the Java API</a> +<a href="https://github.com/apache/flink/blob/master//flink-java/src/main/java/org/apache/flink/api/java";>core classes of the Java API</a> are found in the package <code>org.apache.flink.api.java</code>.</p> <p>The <code>ExecutionEnvironment</code> is the basis for all Flink programs. You can @@ -457,7 +457,7 @@ programs with a <code>main()</code> meth <p>We will now give an overview of each of those steps but please refer to the respective sections for more details. Note that all core classes of the Scala API are found in the package -<a href="https://github.com/apache/incubator-flink/blob/master//flink-scala/src/main/scala/org/apache/flink/api/scala";>org.apache.flink.api.scala</a>.</p> +<a href="https://github.com/apache/flink/blob/master//flink-scala/src/main/scala/org/apache/flink/api/scala";>org.apache.flink.api.scala</a>.</p> <p>The <code>ExecutionEnvironment</code> is the basis for all Flink programs. You can obtain one using these static methods on class <code>ExecutionEnvironment</code>:</p> @@ -1578,7 +1578,7 @@ than one position to use composite keys <p>In order to access fields more intuitively and to generate more readable code, it is also possible to extend a subclass of Tuple. You can add getters and setters with custom names that delegate to the field positions. See this -<a href="https://github.com/apache/incubator-flink/blob/master//flink-examples/flink-java-examples/src/main/java/org/apache/flink/examples/java/relational/TPCHQuery3.java";>example</a> for an +<a href="https://github.com/apache/flink/blob/master//flink-examples/flink-java-examples/src/main/java/org/apache/flink/examples/java/relational/TPCHQuery3.java";>example</a> for an illustration how to make use of that mechanism.</p> <p>Note that if you are extending from a Tuple and add fields to your class, it will be treated as a POJO.</p> @@ -1651,7 +1651,7 @@ Examples for that are methods that creat also generic functions like <code>MapFunction<I, O></code> may need extra type information.</p> <p>The -<a href="https://github.com/apache/incubator-flink/blob/master//flink-java/src/main/java/org/apache/flink/api/java/typeutils/ResultTypeQueryable.java";>ResultTypeQueryable</a> +<a href="https://github.com/apache/flink/blob/master//flink-java/src/main/java/org/apache/flink/api/java/typeutils/ResultTypeQueryable.java";>ResultTypeQueryable</a> interface can be implemented by input formats and functions to tell the API explicitly about their return type. The <em>input types</em> that the functions are invoked with can usually be inferred by the result types of the previous operations.</p> @@ -1665,7 +1665,7 @@ usually be inferred by the result types <p>Data sources create the initial data sets, such as from files or from Java collections. The general mechanism of creating data sets is abstracted behind an -<a href="https://github.com/apache/incubator-flink/blob/master//flink-core/src/main/java/org/apache/flink/api/common/io/InputFormat.java";>InputFormat</a>. +<a href="https://github.com/apache/flink/blob/master//flink-core/src/main/java/org/apache/flink/api/common/io/InputFormat.java";>InputFormat</a>. Flink comes with several built-in formats to create data sets from common file formats. Many of them have shortcut methods on the <em>ExecutionEnvironment</em>.</p> @@ -1768,7 +1768,7 @@ parallel.</li> <p>Data sources create the initial data sets, such as from files or from Java collections. The general mechanism of creating data sets is abstracted behind an -<a href="https://github.com/apache/incubator-flink/blob/master//flink-core/src/main/java/org/apache/flink/api/common/io/InputFormat.java";>InputFormat</a>. +<a href="https://github.com/apache/flink/blob/master//flink-core/src/main/java/org/apache/flink/api/common/io/InputFormat.java";>InputFormat</a>. Flink comes with several built-in formats to create data sets from common file formats. Many of them have shortcut methods on the <em>ExecutionEnvironment</em>.</p> @@ -1863,7 +1863,7 @@ parallel.</li> <p>Data sinks consume DataSets and are used to store or return them. Data sink operations are described using an -<a href="https://github.com/apache/incubator-flink/blob/master//flink-core/src/main/java/org/apache/flink/api/common/io/OutputFormat.java";>OutputFormat</a>. +<a href="https://github.com/apache/flink/blob/master//flink-core/src/main/java/org/apache/flink/api/common/io/OutputFormat.java";>OutputFormat</a>. Flink comes with a variety of built-in output formats that are encapsulated behind operations on the DataSet:</p> @@ -1934,7 +1934,7 @@ same time run additional transformations <div data-lang="scala"> <p>Data sinks consume DataSets and are used to store or return them. Data sink operations are described using an -<a href="https://github.com/apache/incubator-flink/blob/master//flink-core/src/main/java/org/apache/flink/api/common/io/OutputFormat.java";>OutputFormat</a>. +<a href="https://github.com/apache/flink/blob/master//flink-core/src/main/java/org/apache/flink/api/common/io/OutputFormat.java";>OutputFormat</a>. Flink comes with a variety of built-in output formats that are encapsulated behind operations on the DataSet:</p> @@ -2144,7 +2144,7 @@ divided by the number of iterations mult <span class="n">env</span><span class="o">.</span><span class="na">execute</span><span class="o">(</span><span class="s">"Iterative Pi Example"</span><span class="o">);</span></code></pre></div> <p>You can also check out the -<a href="https://github.com/apache/incubator-flink/blob/master//flink-examples/flink-java-examples/src/main/java/org/apache/flink/examples/java/clustering/KMeans.java";>K-Means example</a>, +<a href="https://github.com/apache/flink/blob/master//flink-examples/flink-java-examples/src/main/java/org/apache/flink/examples/java/clustering/KMeans.java";>K-Means example</a>, which uses a BulkIteration to cluster a set of unlabeled points.</p> <h4 id="delta-iterations">Delta Iterations</h4> @@ -2236,7 +2236,7 @@ divided by the number of iterations mult <span class="n">env</span><span class="o">.</span><span class="n">execute</span><span class="o">(</span><span class="s">"Iterative Pi Example"</span><span class="o">);</span></code></pre></div> <p>You can also check out the -<a href="https://github.com/apache/incubator-flink/blob/master//flink-examples/flink-scala-examples/src/main/scala/org/apache/flink/examples/scala/clustering/KMeans.scala";>K-Means example</a>, +<a href="https://github.com/apache/flink/blob/master//flink-examples/flink-scala-examples/src/main/scala/org/apache/flink/examples/scala/clustering/KMeans.scala";>K-Means example</a>, which uses a BulkIteration to cluster a set of unlabeled points.</p> <h4 id="delta-iterations-1">Delta Iterations</h4> @@ -2400,7 +2400,7 @@ Collection.</p> <p>Make sure that the names (<code>broadcastSetName</code> in the previous example) match when registering and accessing broadcasted data sets. For a complete example program, have a look at -<a href="https://github.com/apache/incubator-flink/blob/master//flink-examples/flink-java-examples/src/main/java/org/apache/flink/examples/java/clustering/KMeans.java#L96";>K-Means Algorithm</a>.</p> +<a href="https://github.com/apache/flink/blob/master//flink-examples/flink-java-examples/src/main/java/org/apache/flink/examples/java/clustering/KMeans.java#L96";>K-Means Algorithm</a>.</p> </div> <div data-lang="scala"> @@ -2424,7 +2424,7 @@ accessing broadcasted data sets. For a c <p>Make sure that the names (<code>broadcastSetName</code> in the previous example) match when registering and accessing broadcasted data sets. For a complete example program, have a look at -<a href="https://github.com/apache/incubator-flink/blob/master//flink-examples/flink-scala-examples/src/main/scala/org/apache/flink/examples/scala/clustering/KMeans.scala#L96";>KMeans Algorithm</a>.</p> +<a href="https://github.com/apache/flink/blob/master//flink-examples/flink-scala-examples/src/main/scala/org/apache/flink/examples/scala/clustering/KMeans.scala#L96";>KMeans Algorithm</a>.</p> </div> </div> @@ -2505,15 +2505,15 @@ results and send the result to the clien quickly want to find out more about your data.</p> <p>Flink currently has the following <strong>built-in accumulators</strong>. Each of them implements the -<a href="https://github.com/apache/incubator-flink/blob/master//flink-core/src/main/java/org/apache/flink/api/common/accumulators/Accumulator.java";>Accumulator</a> +<a href="https://github.com/apache/flink/blob/master//flink-core/src/main/java/org/apache/flink/api/common/accumulators/Accumulator.java";>Accumulator</a> interface.</p> <ul> - <li><a href="https://github.com/apache/incubator-flink/blob/master//flink-core/src/main/java/org/apache/flink/api/common/accumulators/IntCounter.java";><strong>IntCounter</strong></a>, -<a href="https://github.com/apache/incubator-flink/blob/master//flink-core/src/main/java/org/apache/flink/api/common/accumulators/LongCounter.java";><strong>LongCounter</strong></a> -and <a href="https://github.com/apache/incubator-flink/blob/master//flink-core/src/main/java/org/apache/flink/api/common/accumulators/DoubleCounter.java";><strong>DoubleCounter</strong></a>: + <li><a href="https://github.com/apache/flink/blob/master//flink-core/src/main/java/org/apache/flink/api/common/accumulators/IntCounter.java";><strong>IntCounter</strong></a>, +<a href="https://github.com/apache/flink/blob/master//flink-core/src/main/java/org/apache/flink/api/common/accumulators/LongCounter.java";><strong>LongCounter</strong></a> +and <a href="https://github.com/apache/flink/blob/master//flink-core/src/main/java/org/apache/flink/api/common/accumulators/DoubleCounter.java";><strong>DoubleCounter</strong></a>: See below for an example using a counter.</li> - <li><a href="https://github.com/apache/incubator-flink/blob/master//flink-core/src/main/java/org/apache/flink/api/common/accumulators/Histogram.java";><strong>Histogram</strong></a>: + <li><a href="https://github.com/apache/flink/blob/master//flink-core/src/main/java/org/apache/flink/api/common/accumulators/Histogram.java";><strong>Histogram</strong></a>: A histogram implementation for a discrete number of bins. Internally it is just a map from Integer to Integer. You can use this to compute distributions of values, e.g. the distribution of words-per-line for a word count program.</li> @@ -2550,7 +2550,7 @@ name.</p> <p>A note on accumulators and iterations: Currently the result of accumulators is only available after the overall job ended. We plan to also make the result of the previous iteration available in the next iteration. You can use -<a href="https://github.com/apache/incubator-flink/blob/master//flink-java/src/main/java/org/apache/flink/api/java/operators/IterativeDataSet.java#L98";>Aggregators</a> +<a href="https://github.com/apache/flink/blob/master//flink-java/src/main/java/org/apache/flink/api/java/operators/IterativeDataSet.java#L98";>Aggregators</a> to compute per-iteration statistics and base the termination of iterations on such statistics.</p> <p><strong>Custom accumulators:</strong></p> @@ -2560,8 +2560,8 @@ interface. Feel free to create a pull re with Flink.</p> <p>You have the choice to implement either -<a href="https://github.com/apache/incubator-flink/blob/master//flink-core/src/main/java/org/apache/flink/api/common/accumulators/Accumulator.java";>Accumulator</a> -or <a href="https://github.com/apache/incubator-flink/blob/master//flink-core/src/main/java/org/apache/flink/api/common/accumulators/SimpleAccumulator.java";>SimpleAccumulator</a>.</p> +<a href="https://github.com/apache/flink/blob/master//flink-core/src/main/java/org/apache/flink/api/common/accumulators/Accumulator.java";>Accumulator</a> +or <a href="https://github.com/apache/flink/blob/master//flink-core/src/main/java/org/apache/flink/api/common/accumulators/SimpleAccumulator.java";>SimpleAccumulator</a>.</p> <p><code>Accumulator<V,R></code> is most flexible: It defines a type <code>V</code> for the value to add, and a result type <code>R</code> for the final result. E.g. for a histogram, <code>V</code> is a number and <code>R</code> i @@ -2712,7 +2712,7 @@ strategies.</p> <p>After these steps, a detailed execution plan will be visualized.</p> -<p><img alt="A flink job execution graph." src="img/plan_visualizer2.png" width="80%" /></p> +<p><img alt="A flink job execution graph." src="img/plan_visualizer.png" width="80%" /></p> <p><strong>Web Interface</strong></p> Modified: flink/site/docs/0.8/run_example_quickstart.html URL: http://svn.apache.org/viewvc/flink/site/docs/0.8/run_example_quickstart.html?rev=1657551&r1=1657550&r2=1657551&view=diff ============================================================================== --- flink/site/docs/0.8/run_example_quickstart.html (original) +++ flink/site/docs/0.8/run_example_quickstart.html Thu Feb 5 12:21:38 2015 @@ -42,7 +42,7 @@ under the License. <div class="container"> <div class="row"> <div class="col-md-1 af-mobile-nav-bar"> - <a href="index.html" title="Home"> + <a href="http://flink.apache.org"; title="Home"> <img class="hidden-xs hidden-sm img-responsive" src="img/logo.png" alt="Apache Flink Logo"> </a> Modified: flink/site/docs/0.8/scala_api_quickstart.html URL: http://svn.apache.org/viewvc/flink/site/docs/0.8/scala_api_quickstart.html?rev=1657551&r1=1657550&r2=1657551&view=diff ============================================================================== --- flink/site/docs/0.8/scala_api_quickstart.html (original) +++ flink/site/docs/0.8/scala_api_quickstart.html Thu Feb 5 12:21:38 2015 @@ -42,7 +42,7 @@ under the License. <div class="container"> <div class="row"> <div class="col-md-1 af-mobile-nav-bar"> - <a href="index.html" title="Home"> + <a href="http://flink.apache.org"; title="Home"> <img class="hidden-xs hidden-sm img-responsive" src="img/logo.png" alt="Apache Flink Logo"> </a> @@ -266,7 +266,7 @@ is 1</code></pre></div> <span class="o">}</span> <span class="o">}</span></code></pre></div> -<p><a href="https://github.com/apache/incubator-flink/blob/master//flink-examples/flink-scala-examples/src/main/scala/org/apache/flink/examples/scala/wordcount/WordCount.scala";>Check GitHub</a> for the full example code.</p> +<p><a href="https://github.com/apache/flink/blob/master//flink-examples/flink-scala-examples/src/main/scala/org/apache/flink/examples/scala/wordcount/WordCount.scala";>Check GitHub</a> for the full example code.</p> <p>For a complete overview over our API, have a look at the <a href="programming_guide.html">Programming Guide</a> and <a href="examples.html">further example programs</a>. If you have any trouble, ask on our <a href="http://mail-archives.apache.org/mod_mbox/incubator-flink-dev/";>Mailing List</a>. We are happy to provide help.</p> Modified: flink/site/docs/0.8/setup_quickstart.html URL: http://svn.apache.org/viewvc/flink/site/docs/0.8/setup_quickstart.html?rev=1657551&r1=1657550&r2=1657551&view=diff ============================================================================== --- flink/site/docs/0.8/setup_quickstart.html (original) +++ flink/site/docs/0.8/setup_quickstart.html Thu Feb 5 12:21:38 2015 @@ -42,7 +42,7 @@ under the License. <div class="container"> <div class="row"> <div class="col-md-1 af-mobile-nav-bar"> - <a href="index.html" title="Home"> + <a href="http://flink.apache.org"; title="Home"> <img class="hidden-xs hidden-sm img-responsive" src="img/logo.png" alt="Apache Flink Logo"> </a> @@ -177,10 +177,10 @@ under the License. <p> <div class="tab-content text-center"> <div class="tab-pane active" id="bin-hadoop1"> - <a class="btn btn-info btn-lg" onclick="_gaq.push(['_trackEvent','Action','download-quickstart-setup-1',this.href]);" href="http://www.apache.org/dyn/closer.cgi/incubator/flink/flink-0.7.0-incubating/flink-0.7.0-incubating-bin-hadoop1.tgz";><i class="icon-download"> </i> Download Flink for Hadoop 1.2</a> + <a class="btn btn-info btn-lg" onclick="_gaq.push(['_trackEvent','Action','download-quickstart-setup-1',this.href]);" href="http://www.apache.org/dyn/closer.cgi/flink/flink-0.8.0/flink-0.8.0-bin-hadoop1.tgz";><i class="icon-download"> </i> Download Flink for Hadoop 1.2</a> </div> <div class="tab-pane" id="bin-hadoop2"> - <a class="btn btn-info btn-lg" onclick="_gaq.push(['_trackEvent','Action','download-quickstart-setup-2',this.href]);" href="http://www.apache.org/dyn/closer.cgi/incubator/flink/flink-0.7.0-incubating/flink-0.7.0-incubating-bin-hadoop2.tgz";><i class="icon-download"> </i> Download Flink for Hadoop 2</a> + <a class="btn btn-info btn-lg" onclick="_gaq.push(['_trackEvent','Action','download-quickstart-setup-2',this.href]);" href="http://www.apache.org/dyn/closer.cgi/flink/flink-0.8.0/flink-0.8.0-bin-hadoop2.tgz";><i class="icon-download"> </i> Download Flink for Hadoop 2</a> </div> </div> </p> Modified: flink/site/docs/0.8/spargel_guide.html URL: http://svn.apache.org/viewvc/flink/site/docs/0.8/spargel_guide.html?rev=1657551&r1=1657550&r2=1657551&view=diff ============================================================================== --- flink/site/docs/0.8/spargel_guide.html (original) +++ flink/site/docs/0.8/spargel_guide.html Thu Feb 5 12:21:38 2015 @@ -42,7 +42,7 @@ under the License. <div class="container"> <div class="row"> <div class="col-md-1 af-mobile-nav-bar"> - <a href="index.html" title="Home"> + <a href="http://flink.apache.org"; title="Home"> <img class="hidden-xs hidden-sm img-responsive" src="img/logo.png" alt="Apache Flink Logo"> </a> Modified: flink/site/docs/0.8/streaming_guide.html URL: http://svn.apache.org/viewvc/flink/site/docs/0.8/streaming_guide.html?rev=1657551&r1=1657550&r2=1657551&view=diff ============================================================================== --- flink/site/docs/0.8/streaming_guide.html (original) +++ flink/site/docs/0.8/streaming_guide.html Thu Feb 5 12:21:38 2015 @@ -42,7 +42,7 @@ under the License. <div class="container"> <div class="row"> <div class="col-md-1 af-mobile-nav-bar"> - <a href="index.html" title="Home"> + <a href="http://flink.apache.org"; title="Home"> <img class="hidden-xs hidden-sm img-responsive" src="img/logo.png" alt="Apache Flink Logo"> </a> Modified: flink/site/docs/0.8/web_client.html URL: http://svn.apache.org/viewvc/flink/site/docs/0.8/web_client.html?rev=1657551&r1=1657550&r2=1657551&view=diff ============================================================================== --- flink/site/docs/0.8/web_client.html (original) +++ flink/site/docs/0.8/web_client.html Thu Feb 5 12:21:38 2015 @@ -42,7 +42,7 @@ under the License. <div class="container"> <div class="row"> <div class="col-md-1 af-mobile-nav-bar"> - <a href="index.html" title="Home"> + <a href="http://flink.apache.org"; title="Home"> <img class="hidden-xs hidden-sm img-responsive" src="img/logo.png" alt="Apache Flink Logo"> </a> Modified: flink/site/docs/0.8/yarn_setup.html URL: http://svn.apache.org/viewvc/flink/site/docs/0.8/yarn_setup.html?rev=1657551&r1=1657550&r2=1657551&view=diff ============================================================================== --- flink/site/docs/0.8/yarn_setup.html (original) +++ flink/site/docs/0.8/yarn_setup.html Thu Feb 5 12:21:38 2015 @@ -42,7 +42,7 @@ under the License. <div class="container"> <div class="row"> <div class="col-md-1 af-mobile-nav-bar"> - <a href="index.html" title="Home"> + <a href="http://flink.apache.org"; title="Home"> <img class="hidden-xs hidden-sm img-responsive" src="img/logo.png" alt="Apache Flink Logo"> </a> @@ -173,7 +173,7 @@ under the License. <p>Start YARN session with 4 Task Managers (each with 4 GB of Heapspace):</p> -<div class="highlight"><pre><code class="language-bash">wget http://artfiles.org/apache.org/incubator/flink/flink-0.7.0-incubating/flink-0.7.0-incubating-bin-hadoop2-yarn.tgz +<div class="highlight"><pre><code class="language-bash">wget http://mirror.23media.de/apache/flink/flink-0.8.0/flink-0.8.0-bin-hadoop2-yarn.tgz tar xvzf flink-0.8.0-bin-hadoop2-yarn.tgz <span class="nb">cd </span>flink-yarn-0.8.0/ ./bin/yarn-session.sh -n <span class="m">4</span> -jm <span class="m">1024</span> -tm 4096</code></pre></div>
