Repository: flink-web Updated Branches: refs/heads/asf-site 630f25830 -> e418ca0f2
merge FAQ from main repository and use variables for URLs Project: http://git-wip-us.apache.org/repos/asf/flink-web/repo Commit: http://git-wip-us.apache.org/repos/asf/flink-web/commit/e418ca0f Tree: http://git-wip-us.apache.org/repos/asf/flink-web/tree/e418ca0f Diff: http://git-wip-us.apache.org/repos/asf/flink-web/diff/e418ca0f Branch: refs/heads/asf-site Commit: e418ca0f2e590ed0da960d8cfd38d18b6a428a10 Parents: 630f258 Author: Maximilian Michels <[email protected]> Authored: Wed Jul 1 11:16:55 2015 +0200 Committer: Maximilian Michels <[email protected]> Committed: Wed Jul 1 11:19:47 2015 +0200 ---------------------------------------------------------------------- content/faq.html | 25 ++++++++++++++++++++++--- faq.md | 42 ++++++++++++++++++++++++++++++++---------- 2 files changed, 54 insertions(+), 13 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/flink-web/blob/e418ca0f/content/faq.html ---------------------------------------------------------------------- diff --git a/content/faq.html b/content/faq.html index 2884f16..85fa392 100644 --- a/content/faq.html +++ b/content/faq.html @@ -5,7 +5,7 @@ <meta http-equiv="X-UA-Compatible" content="IE=edge"> <meta name="viewport" content="width=device-width, initial-scale=1"> <!-- The above 3 meta tags *must* come first in the head; any other head content must come *after* these tags --> - <title>Apache Flink: F.A.Q.</title> + <title>Apache Flink: Frequently Asked Questions (FAQ)</title> <link rel="shortcut icon" href="/favicon.ico" type="image/x-icon"> <link rel="icon" href="/favicon.ico" type="image/x-icon"> @@ -142,9 +142,28 @@ <div class="row"> <div class="col-sm-8 col-sm-offset-2"> <div class="row"> - <div class="col-sm-12"><h1>F.A.Q.</h1></div> + <div class="col-sm-12"><h1>Frequently Asked Questions (FAQ)</h1></div> </div> +<!-- +Licensed to the Apache Software Foundation (ASF) under one +or more contributor license agreements. See the NOTICE file +distributed with this work for additional information +regarding copyright ownership. The ASF licenses this file +to you under the Apache License, Version 2.0 (the +"License"); you may not use this file except in compliance +with the License. You may obtain a copy of the License at + + http://www.apache.org/licenses/LICENSE-2.0 + +Unless required by applicable law or agreed to in writing, +software distributed under the License is distributed on an +"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +KIND, either express or implied. See the License for the +specific language governing permissions and limitations +under the License. +--> + <p>The following questions are frequently asked with regard to the Flink project <strong>in general</strong>. If you have further questions, make sure to consult the <a href="">documentation</a> or <a href="">ask the community</a>.</p> <div class="page-toc"> @@ -276,7 +295,7 @@ parallelism has to be 1 and set it accordingly.</p> <p>The parallelism can be set in numerous ways to ensure a fine-grained control over the execution of a Flink program. See the <a href="http://ci.apache.org/projects/flink/flink-docs-master/setup/config.html#common-options";>Configuration guide</a> for detailed instructions on how to -set the parallelism. Also check out <a href="http://ci.apache.org/projects/flink/flink-docs-master/setup/config.html#configuring-taskmanager-processing-slots";>this figure</a> detailing +set the parallelism. Also check out <a href="http://ci.apache.org/projects/flink/flink-docs-master/setup/config.html#configuring-taskmanager-processing-slots";>this figure</a> detailing how the processing slots and parallelism are related to each other.</p> <h2 id="errors">Errors</h2> http://git-wip-us.apache.org/repos/asf/flink-web/blob/e418ca0f/faq.md ---------------------------------------------------------------------- diff --git a/faq.md b/faq.md index a8c0c8e..85299e8 100644 --- a/faq.md +++ b/faq.md @@ -1,11 +1,33 @@ --- -title: "F.A.Q." +title: "Frequently Asked Questions (FAQ)" --- +<!-- +Licensed to the Apache Software Foundation (ASF) under one +or more contributor license agreements. See the NOTICE file +distributed with this work for additional information +regarding copyright ownership. The ASF licenses this file +to you under the Apache License, Version 2.0 (the +"License"); you may not use this file except in compliance +with the License. You may obtain a copy of the License at + + http://www.apache.org/licenses/LICENSE-2.0 + +Unless required by applicable law or agreed to in writing, +software distributed under the License is distributed on an +"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +KIND, either express or implied. See the License for the +specific language governing permissions and limitations +under the License. +--> The following questions are frequently asked with regard to the Flink project **in general**. If you have further questions, make sure to consult the [documentation]() or [ask the community](). {% toc %} + + + + ## General ### Is Flink a Hadoop Project? @@ -60,10 +82,10 @@ of the master and the worker where the exception occurred ### How do I debug Flink programs? -- When you start a program locally with the [LocalExecutor](http://ci.apache.org/projects/flink/flink-docs-master/apis/local_execution.html), +- When you start a program locally with the [LocalExecutor]({{site.docs-snapshot}}/apis/local_execution.html), you can place breakpoints in your functions and debug them like normal Java/Scala programs. -- The [Accumulators](http://ci.apache.org/projects/flink/flink-docs-master/apis/programming_guide.html#accumulators--counters) are very helpful in +- The [Accumulators]({{ site.docs-snapshot }}/apis/programming_guide.html#accumulators--counters) are very helpful in tracking the behavior of the parallel execution. They allow you to gather information inside the program's operations and show them after the program execution. @@ -86,8 +108,8 @@ parallelism has to be 1 and set it accordingly. The parallelism can be set in numerous ways to ensure a fine-grained control over the execution of a Flink program. See -the [Configuration guide](http://ci.apache.org/projects/flink/flink-docs-master/setup/config.html#common-options) for detailed instructions on how to -set the parallelism. Also check out [this figure](http://ci.apache.org/projects/flink/flink-docs-master/setup/config.html#configuring-taskmanager-processing-slots) detailing +the [Configuration guide]({{ site.docs-snapshot }}/setup/config.html#common-options) for detailed instructions on how to +set the parallelism. Also check out [this figure]({{ site.docs-snapshot }}/setup/config.html#configuring-taskmanager-processing-slots) detailing how the processing slots and parallelism are related to each other. ## Errors @@ -122,7 +144,7 @@ def myFunction[T: TypeInformation](input: DataSet[T]): DataSet[Seq[T]] = { } ~~~ -See [Type Extraction and Serialization](http://ci.apache.org/projects/flink/flink-docs-master/internals/types_serialization.html) for +See [Type Extraction and Serialization]({{ site.docs-snapshot }}/internals/types_serialization.html) for an in-depth discussion of how Flink handles types. ### I get an error message saying that not enough buffers are available. How do I fix this? @@ -132,7 +154,7 @@ you need to adapt the number of network buffers via the config parameter `taskmanager.network.numberOfBuffers`. As a rule-of-thumb, the number of buffers should be at least `4 * numberOfNodes * numberOfTasksPerNode^2`. See -[Configuration Reference](http://ci.apache.org/projects/flink/flink-docs-master/setup/config.html) for details. +[Configuration Reference]({{ site.docs-snapshot }}/setup/config.html) for details. ### My job fails early with a java.io.EOFException. What could be the cause? @@ -250,7 +272,7 @@ destage operations to disk, if necessary. By default, the system reserves around 70% of the memory. If you frequently run applications that need more memory in the user-defined functions, you can reduce that value using the configuration entries `taskmanager.memory.fraction` or `taskmanager.memory.size`. See the -[Configuration Reference](http://ci.apache.org/projects/flink/flink-docs-master/setup/config.html) for details. This will leave more memory to JVM heap, +[Configuration Reference]({{ site.docs-snapshot }}/setup/config.html) for details. This will leave more memory to JVM heap, but may cause data processing tasks to go to disk more often. ### Why do the TaskManager log files become so huge? @@ -367,9 +389,9 @@ open source project in the next versions. ### Are Hadoop-like utilities, such as Counters and the DistributedCache supported? -[Flink's Accumulators](http://ci.apache.org/projects/flink/flink-docs-master/apis/programming_guide.html#accumulators--counters) work very similar like +[Flink's Accumulators]({{ site.docs-snapshot }}/apis/programming_guide.html#accumulators--counters) work very similar like [Hadoop's counters, but are more powerful. Flink has a {% github /flink-core/src/main/java/org/apache/flink/api/common/cache/DistributedCache.java "Distributed Cache" %} that is deeply integrated with the APIs. Please refer to the {% github /flink-java/src/main/java/org/apache/flink/api/java/ExecutionEnvironment.java#L561 "JavaDocs" %} for details on how to use it. -In order to make data sets available on all tasks, we encourage you to use [Broadcast Variables](http://ci.apache.org/projects/flink/flink-docs-master/apis/programming_guide.html#broadcast-variables) instead. They are more efficient and easier to use than the distributed cache. +In order to make data sets available on all tasks, we encourage you to use [Broadcast Variables]({{ site.docs-snapshot }}/apis/programming_guide.html#broadcast-variables) instead. They are more efficient and easier to use than the distributed cache.
