Repository: flink Updated Branches: refs/heads/master 9d8a34881 -> f428aa7a7
[docs] improve setup guide for google compute engine Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/f428aa7a Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/f428aa7a Diff: http://git-wip-us.apache.org/repos/asf/flink/diff/f428aa7a Branch: refs/heads/master Commit: f428aa7a704fcffd2d1b0adfb341d6fafadcf04b Parents: 9d8a348 Author: Maximilian Michels <[email protected]> Authored: Fri Jul 3 10:52:35 2015 +0200 Committer: Maximilian Michels <[email protected]> Committed: Fri Jul 3 10:55:27 2015 +0200 ---------------------------------------------------------------------- docs/setup/gce_setup.md | 19 +++++++++++++++++-- 1 file changed, 17 insertions(+), 2 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/flink/blob/f428aa7a/docs/setup/gce_setup.md ---------------------------------------------------------------------- diff --git a/docs/setup/gce_setup.md b/docs/setup/gce_setup.md index e4b2316..15477dd 100644 --- a/docs/setup/gce_setup.md +++ b/docs/setup/gce_setup.md @@ -36,7 +36,11 @@ steps below. ## Install Google Cloud SDK Please follow the instructions on how to setup the -[Google Cloud SDK](https://cloud.google.com/sdk/). +[Google Cloud SDK](https://cloud.google.com/sdk/). In particular, make sure to +authenticate with Google Cloud using the following command: + + gcloud auth login + ## Install bdutil @@ -58,7 +62,6 @@ staging files. A new bucket can be created with gsutil: gsutil mb gs://<bucket_name> - ## Adapt the bdutil config To deploy Flink with bdutil, adapt at least the following variables in @@ -68,6 +71,12 @@ bdutil_env.sh. PROJECT="<compute_engine_project_name>" NUM_WORKERS=<number_of_workers> + # set this to 'n1-standard-2' if you're using the free trial + GCE_MACHINE_TYPE="<gce_machine_type>" + + # for example: "europe-west1-d" + GCE_ZONE="<gce_zone>" + ## Adapt the Flink config bdutil's Flink extension handles the configuration for you. You may additionally @@ -87,3 +96,9 @@ To bring up the Flink cluster on Google Compute Engine, execute: ./bdutil shell cd /home/hadoop/flink-install/bin ./flink run ../examples/flink-java-examples-*-WordCount.jar gs://dataflow-samples/shakespeare/othello.txt gs://<bucket_name>/output + +## Shut down your cluster + +Shutting down a cluster is as simple as executing + + ./bdutil -e extensions/flink/flink_env.sh delete
