Remove incubating references from examples
Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/6b3c2f6a Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/6b3c2f6a Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/6b3c2f6a Branch: refs/heads/master Commit: 6b3c2f6a1e85734d85871196409f956c67ecff80 Parents: 88e749e Author: Davor Bonaci <[email protected]> Authored: Tue Dec 27 13:11:41 2016 -0800 Committer: Davor Bonaci <[email protected]> Committed: Tue Dec 27 13:45:48 2016 -0800 ---------------------------------------------------------------------- examples/java/README.md | 16 ++++++++-------- .../java/org/apache/beam/examples/WordCount.java | 4 ++-- .../org/apache/beam/examples/complete/README.md | 14 +++++++------- .../org/apache/beam/examples/cookbook/README.md | 14 +++++++------- .../beam/examples/cookbook/TriggerExample.java | 4 ++-- 5 files changed, 26 insertions(+), 26 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/beam/blob/6b3c2f6a/examples/java/README.md ---------------------------------------------------------------------- diff --git a/examples/java/README.md b/examples/java/README.md index 2b5edf5..b58153e 100644 --- a/examples/java/README.md +++ b/examples/java/README.md @@ -26,21 +26,21 @@ the development of more complex pipelines. ## Word Count A good starting point for new users is our set of -[word count](https://github.com/apache/incubator-beam/blob/master/examples/java/src/main/java/org/apache/beam/examples) examples, which computes word frequencies. This series of four successively more detailed pipelines is described in detail in the accompanying [walkthrough](https://cloud.google.com/dataflow/examples/wordcount-example). +[word count](https://github.com/apache/beam/blob/master/examples/java/src/main/java/org/apache/beam/examples) examples, which computes word frequencies. This series of four successively more detailed pipelines is described in detail in the accompanying [walkthrough](https://cloud.google.com/dataflow/examples/wordcount-example). -1. [`MinimalWordCount`](https://github.com/apache/incubator-beam/blob/master/examples/java/src/main/java/org/apache/beam/examples/MinimalWordCount.java) is the simplest word count pipeline and introduces basic concepts like [Pipelines](https://cloud.google.com/dataflow/model/pipelines), +1. [`MinimalWordCount`](https://github.com/apache/beam/blob/master/examples/java/src/main/java/org/apache/beam/examples/MinimalWordCount.java) is the simplest word count pipeline and introduces basic concepts like [Pipelines](https://cloud.google.com/dataflow/model/pipelines), [PCollections](https://cloud.google.com/dataflow/model/pcollection), [ParDo](https://cloud.google.com/dataflow/model/par-do), and [reading and writing data](https://cloud.google.com/dataflow/model/reading-and-writing-data) from external storage. -1. [`WordCount`](https://github.com/apache/incubator-beam/blob/master/examples/java/src/main/java/org/apache/beam/examples/WordCount.java) introduces Dataflow best practices like [PipelineOptions](https://cloud.google.com/dataflow/pipelines/constructing-your-pipeline#Creating) and custom [PTransforms](https://cloud.google.com/dataflow/model/composite-transforms). +1. [`WordCount`](https://github.com/apache/beam/blob/master/examples/java/src/main/java/org/apache/beam/examples/WordCount.java) introduces Dataflow best practices like [PipelineOptions](https://cloud.google.com/dataflow/pipelines/constructing-your-pipeline#Creating) and custom [PTransforms](https://cloud.google.com/dataflow/model/composite-transforms). -1. [`DebuggingWordCount`](https://github.com/apache/incubator-beam/blob/master/examples/java/src/main/java/org/apache/beam/examples/DebuggingWordCount.java) +1. [`DebuggingWordCount`](https://github.com/apache/beam/blob/master/examples/java/src/main/java/org/apache/beam/examples/DebuggingWordCount.java) shows how to view live aggregators in the [Dataflow Monitoring Interface](https://cloud.google.com/dataflow/pipelines/dataflow-monitoring-intf), get the most out of [Cloud Logging](https://cloud.google.com/dataflow/pipelines/logging) integration, and start writing [good tests](https://cloud.google.com/dataflow/pipelines/testing-your-pipeline). -1. [`WindowedWordCount`](https://github.com/apache/incubator-beam/blob/master/examples/java/src/main/java/org/apache/beam/examples/WindowedWordCount.java) shows how to run the same pipeline over either unbounded PCollections in streaming mode or bounded PCollections in batch mode. +1. [`WindowedWordCount`](https://github.com/apache/beam/blob/master/examples/java/src/main/java/org/apache/beam/examples/WindowedWordCount.java) shows how to run the same pipeline over either unbounded PCollections in streaming mode or bounded PCollections in batch mode. ## Building and Running @@ -99,14 +99,14 @@ example, input file pattern of `c:\*.txt` should be entered as `c:\\*.txt`. ## Beyond Word Count -After you've finished running your first few word count pipelines, take a look at the [cookbook](https://github.com/apache/incubator-beam/blob/master/examples/java/src/main/java/org/apache/beam/examples/cookbook) +After you've finished running your first few word count pipelines, take a look at the [cookbook](https://github.com/apache/beam/blob/master/examples/java/src/main/java/org/apache/beam/examples/cookbook) directory for some common and useful patterns like joining, filtering, and combining. -The [complete](https://github.com/apache/incubator-beam/blob/master/examples/java/src/main/java/org/apache/beam/examples/complete) +The [complete](https://github.com/apache/beam/blob/master/examples/java/src/main/java/org/apache/beam/examples/complete) directory contains a few realistic end-to-end pipelines. See the -[Java 8](https://github.com/apache/incubator-beam/tree/master/examples/java8/src/main/java/org/apache/beam/examples) +[Java 8](https://github.com/apache/beam/tree/master/examples/java8/src/main/java/org/apache/beam/examples) examples as well. This directory includes a Java 8 version of the MinimalWordCount example, as well as series of examples in a simple 'mobile gaming' domain. This series introduces some advanced concepts and provides http://git-wip-us.apache.org/repos/asf/beam/blob/6b3c2f6a/examples/java/src/main/java/org/apache/beam/examples/WordCount.java ---------------------------------------------------------------------- diff --git a/examples/java/src/main/java/org/apache/beam/examples/WordCount.java b/examples/java/src/main/java/org/apache/beam/examples/WordCount.java index d4da542..224d7db 100644 --- a/examples/java/src/main/java/org/apache/beam/examples/WordCount.java +++ b/examples/java/src/main/java/org/apache/beam/examples/WordCount.java @@ -44,8 +44,8 @@ import org.apache.beam.sdk.values.PCollection; * pipeline, for introduction of additional concepts. * * <p>For a detailed walkthrough of this example, see - * <a href="http://beam.incubator.apache.org/use/walkthroughs/";> - * http://beam.incubator.apache.org/use/walkthroughs/ + * <a href="http://beam.apache.org/use/walkthroughs/";> + * http://beam.apache.org/use/walkthroughs/ * </a> * * <p>Basic concepts, also in the MinimalWordCount example: http://git-wip-us.apache.org/repos/asf/beam/blob/6b3c2f6a/examples/java/src/main/java/org/apache/beam/examples/complete/README.md ---------------------------------------------------------------------- diff --git a/examples/java/src/main/java/org/apache/beam/examples/complete/README.md b/examples/java/src/main/java/org/apache/beam/examples/complete/README.md index b0b6f9d..2b416c6 100644 --- a/examples/java/src/main/java/org/apache/beam/examples/complete/README.md +++ b/examples/java/src/main/java/org/apache/beam/examples/complete/README.md @@ -22,34 +22,34 @@ This directory contains end-to-end example pipelines that perform complex data processing tasks. They include: <ul> - <li><a href="https://github.com/apache/incubator-beam/blob/master/examples/java/src/main/java/org/apache/beam/examples/complete/AutoComplete.java";>AutoComplete</a> + <li><a href="https://github.com/apache/beam/blob/master/examples/java/src/main/java/org/apache/beam/examples/complete/AutoComplete.java";>AutoComplete</a> — An example that computes the most popular hash tags for every prefix, which can be used for auto-completion. Demonstrates how to use the same pipeline in both streaming and batch, combiners, and composite transforms.</li> - <li><a href="https://github.com/apache/incubator-beam/blob/master/examples/java/src/main/java/org/apache/beam/examples/complete/StreamingWordExtract.java";>StreamingWordExtract</a> + <li><a href="https://github.com/apache/beam/blob/master/examples/java/src/main/java/org/apache/beam/examples/complete/StreamingWordExtract.java";>StreamingWordExtract</a> — A streaming pipeline example that inputs lines of text from a Cloud Pub/Sub topic, splits each line into individual words, capitalizes those words, and writes the output to a BigQuery table. </li> - <li><a href="https://github.com/apache/incubator-beam/blob/master/examples/java/src/main/java/org/apache/beam/examples/complete/TfIdf.java";>TfIdf</a> + <li><a href="https://github.com/apache/beam/blob/master/examples/java/src/main/java/org/apache/beam/examples/complete/TfIdf.java";>TfIdf</a> — An example that computes a basic TF-IDF search table for a directory or Cloud Storage prefix. Demonstrates joining data, side inputs, and logging. </li> - <li><a href="https://github.com/apache/incubator-beam/blob/master/examples/java/src/main/java/org/apache/beam/examples/complete/TopWikipediaSessions.java";>TopWikipediaSessions</a> + <li><a href="https://github.com/apache/beam/blob/master/examples/java/src/main/java/org/apache/beam/examples/complete/TopWikipediaSessions.java";>TopWikipediaSessions</a> — An example that reads Wikipedia edit data from Cloud Storage and computes the user with the longest string of edits separated by no more than an hour within each month. Demonstrates using Cloud Dataflow <code>Windowing</code> to perform time-based aggregations of data. </li> - <li><a href="https://github.com/apache/incubator-beam/blob/master/examples/java/src/main/java/org/apache/beam/examples/complete/TrafficMaxLaneFlow.java";>TrafficMaxLaneFlow</a> + <li><a href="https://github.com/apache/beam/blob/master/examples/java/src/main/java/org/apache/beam/examples/complete/TrafficMaxLaneFlow.java";>TrafficMaxLaneFlow</a> — A streaming Beam Example using BigQuery output in the <code>traffic sensor</code> domain. Demonstrates the Cloud Dataflow streaming runner, sliding windows, Cloud Pub/Sub topic ingestion, the use of the <code>AvroCoder</code> to encode a custom class, and custom <code>Combine</code> transforms. </li> - <li><a href="https://github.com/apache/incubator-beam/blob/master/examples/java/src/main/java/org/apache/beam/examples/complete/TrafficRoutes.java";>TrafficRoutes</a> + <li><a href="https://github.com/apache/beam/blob/master/examples/java/src/main/java/org/apache/beam/examples/complete/TrafficRoutes.java";>TrafficRoutes</a> — A streaming Beam Example using BigQuery output in the <code>traffic sensor</code> domain. Demonstrates the Cloud Dataflow streaming runner, <code>GroupByKey</code>, keyed state, sliding windows, and Cloud @@ -57,6 +57,6 @@ This directory contains end-to-end example pipelines that perform complex data p </li> </ul> -See the [documentation](http://beam.incubator.apache.org/get-started/quickstart/) and the [Examples +See the [documentation](http://beam.apache.org/get-started/quickstart/) and the [Examples README](../../../../../../../../../README.md) for information about how to run these examples. http://git-wip-us.apache.org/repos/asf/beam/blob/6b3c2f6a/examples/java/src/main/java/org/apache/beam/examples/cookbook/README.md ---------------------------------------------------------------------- diff --git a/examples/java/src/main/java/org/apache/beam/examples/cookbook/README.md b/examples/java/src/main/java/org/apache/beam/examples/cookbook/README.md index 105fb4b..dab4e73 100644 --- a/examples/java/src/main/java/org/apache/beam/examples/cookbook/README.md +++ b/examples/java/src/main/java/org/apache/beam/examples/cookbook/README.md @@ -24,12 +24,12 @@ commonly-used data analysis patterns that you would likely incorporate into a larger Dataflow pipeline. They include: <ul> - <li><a href="https://github.com/apache/incubator-beam/blob/master/examples/java/src/main/java/org/apache/beam/examples/cookbook/BigQueryTornadoes.java";>BigQueryTornadoes</a> + <li><a href="https://github.com/apache/beam/blob/master/examples/java/src/main/java/org/apache/beam/examples/cookbook/BigQueryTornadoes.java";>BigQueryTornadoes</a> — An example that reads the public samples of weather data from Google BigQuery, counts the number of tornadoes that occur in each month, and writes the results to BigQuery. Demonstrates reading/writing BigQuery, counting a <code>PCollection</code>, and user-defined <code>PTransforms</code>.</li> - <li><a href="https://github.com/apache/incubator-beam/blob/master/examples/java/src/main/java/org/apache/beam/examples/cookbook/CombinePerKeyExamples.java";>CombinePerKeyExamples</a> + <li><a href="https://github.com/apache/beam/blob/master/examples/java/src/main/java/org/apache/beam/examples/cookbook/CombinePerKeyExamples.java";>CombinePerKeyExamples</a> — An example that reads the public "Shakespeare" data, and for each word in the dataset that exceeds a given length, generates a string containing the list of play names in which that word appears. @@ -37,13 +37,13 @@ larger Dataflow pipeline. They include: transform, which lets you combine the values in a key-grouped <code>PCollection</code>. </li> - <li><a href="https://github.com/apache/incubator-beam/blob/master/examples/java/src/main/java/org/apache/beam/examples/cookbook/DistinctExample.java";>DistinctExample</a> + <li><a href="https://github.com/apache/beam/blob/master/examples/java/src/main/java/org/apache/beam/examples/cookbook/DistinctExample.java";>DistinctExample</a> — An example that uses Shakespeare's plays as plain text files, and removes duplicate lines across all the files. Demonstrates the <code>Distinct</code>, <code>TextIO.Read</code>, and <code>TextIO.Write</code> transforms, and how to wire transforms together. </li> - <li><a href="https://github.com/apache/incubator-beam/blob/master/examples/java/src/main/java/org/apache/beam/examples/cookbook/FilterExamples.java";>FilterExamples</a> + <li><a href="https://github.com/apache/beam/blob/master/examples/java/src/main/java/org/apache/beam/examples/cookbook/FilterExamples.java";>FilterExamples</a> — An example that shows different approaches to filtering, including selection and projection. It also shows how to dynamically set parameters by defining and using new pipeline options, and use how to use a value derived @@ -51,14 +51,14 @@ larger Dataflow pipeline. They include: <code>Options</code> configuration, and using pipeline-derived data as a side input. </li> - <li><a href="https://github.com/apache/incubator-beam/blob/master/examples/java/src/main/java/org/apache/beam/examples/cookbook/JoinExamples.java";>JoinExamples</a> + <li><a href="https://github.com/apache/beam/blob/master/examples/java/src/main/java/org/apache/beam/examples/cookbook/JoinExamples.java";>JoinExamples</a> — An example that shows how to join two collections. It uses a sample of the <a href="http://goo.gl/OB6oin";>GDELT "world event" data</a>, joining the event <code>action</code> country code against a table that maps country codes to country names. Demonstrates the <code>Join</code> operation, and using multiple input sources. </li> - <li><a href="https://github.com/apache/incubator-beam/blob/master/examples/java/src/main/java/org/apache/beam/examples/cookbook/MaxPerKeyExamples.java";>MaxPerKeyExamples</a> + <li><a href="https://github.com/apache/beam/blob/master/examples/java/src/main/java/org/apache/beam/examples/cookbook/MaxPerKeyExamples.java";>MaxPerKeyExamples</a> — An example that reads the public samples of weather data from BigQuery, and finds the maximum temperature (<code>mean_temp</code>) for each month. Demonstrates the <code>Max</code> statistical combination transform, and how to @@ -66,6 +66,6 @@ larger Dataflow pipeline. They include: </li> </ul> -See the [documentation](http://beam.incubator.apache.org/get-started/quickstart/) and the [Examples +See the [documentation](http://beam.apache.org/get-started/quickstart/) and the [Examples README](../../../../../../../../../README.md) for information about how to run these examples. http://git-wip-us.apache.org/repos/asf/beam/blob/6b3c2f6a/examples/java/src/main/java/org/apache/beam/examples/cookbook/TriggerExample.java ---------------------------------------------------------------------- diff --git a/examples/java/src/main/java/org/apache/beam/examples/cookbook/TriggerExample.java b/examples/java/src/main/java/org/apache/beam/examples/cookbook/TriggerExample.java index bf3afca..af4a692 100644 --- a/examples/java/src/main/java/org/apache/beam/examples/cookbook/TriggerExample.java +++ b/examples/java/src/main/java/org/apache/beam/examples/cookbook/TriggerExample.java @@ -75,8 +75,8 @@ import org.joda.time.Instant; * * <p>Before running this example, it will be useful to familiarize yourself with Beam triggers * and understand the concept of 'late data', - * See: <a href="http://beam.incubator.apache.org/use/walkthroughs/";> - * http://beam.incubator.apache.org/use/walkthroughs/</a> + * See: <a href="http://beam.apache.org/use/walkthroughs/";> + * http://beam.apache.org/use/walkthroughs/</a> * * <p>The example is configured to use the default BigQuery table from the example common package * (there are no defaults for a general Beam pipeline).
