Jarosław Śmietanka created AIRFLOW-2789:
-------------------------------------------
Summary: Add ability to create single node cluster to
DataprocClusterCreateOperator
Key: AIRFLOW-2789
URL: https://issues.apache.org/jira/browse/AIRFLOW-2789
Project: Apache Airflow
Issue Type: Improvement
Components: contrib, gcp, operators
Affects Versions: 2.0.0, 1.10.1
Reporter: Jarosław Śmietanka
Assignee: Jarosław Śmietanka
In GCP, it is possible to set up [Single node
clusters|https://cloud.google.com/dataproc/docs/concepts/configuring-clusters/single-node-clusters]
Since the minimal size of the cluster (without this modification) is 3 (one
master + two workers). It may be very helpful while doing, for example,
small-scale non-critical data processing or building proof-of-concept.
Since I already have a code which does that, I volunteer to bring it to the
community :)
This improvement won't change many components and should not require
groundbreaking changes to DataprocClusterCreateOperator.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
