This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/main by this push:
new b48f959ae9 Update DataprocCreateCluster operator to use 'label'
parameter properly (#30741)
b48f959ae9 is described below
commit b48f959ae93703f52721999ef04f459fe56dcf58
Author: VladaZakharova <[email protected]>
AuthorDate: Thu Apr 20 22:51:50 2023 +0000
Update DataprocCreateCluster operator to use 'label' parameter properly
(#30741)
---
airflow/providers/google/cloud/operators/dataproc.py | 8 +++++---
1 file changed, 5 insertions(+), 3 deletions(-)
diff --git a/airflow/providers/google/cloud/operators/dataproc.py
b/airflow/providers/google/cloud/operators/dataproc.py
index 090cadb8d8..6ca7b4d9dc 100644
--- a/airflow/providers/google/cloud/operators/dataproc.py
+++ b/airflow/providers/google/cloud/operators/dataproc.py
@@ -110,7 +110,6 @@ class ClusterGenerator:
``pd-standard`` (Persistent Disk Hard Disk Drive).
:param worker_disk_size: Disk size for the worker nodes
:param num_preemptible_workers: The # of preemptible worker nodes to spin
up
- :param labels: dict of labels to add to the cluster
:param zone: The zone where the cluster will be located. Set to None to
auto-zone. (templated)
:param network_uri: The network uri to be used for machine communication,
cannot be
specified with subnetwork_uri
@@ -412,10 +411,13 @@ class
DataprocCreateClusterOperator(GoogleCloudBaseOperator):
For more information on how to use this operator, take a look at the
guide:
:ref:`howto/operator:DataprocCreateClusterOperator`
- :param project_id: The ID of the google cloud project in which
+ :param project_id: The ID of the Google cloud project in which
to create the cluster. (templated)
:param cluster_name: Name of the cluster to create
- :param labels: Labels that will be assigned to created cluster
+ :param labels: Labels that will be assigned to created cluster. Please,
notice that
+ adding labels to ClusterConfig object in cluster_config parameter will
not lead
+ to adding labels to the cluster. Labels for the clusters could be only
set by passing
+ values to parameter of DataprocCreateCluster operator.
:param cluster_config: Required. The cluster config to create.
If a dict is provided, it must be of the same form as the protobuf
message
:class:`~google.cloud.dataproc_v1.types.ClusterConfig`
