Dan Sedov created AIRFLOW-4492:
----------------------------------
Summary: Dataproc operator does not capture error from create
cluster failure
Key: AIRFLOW-4492
URL: https://issues.apache.org/jira/browse/AIRFLOW-4492
Project: Apache Airflow
Issue Type: Bug
Components: operators
Reporter: Dan Sedov
Assignee: Dan Sedov
This line [1] captures the detail message as exception when cluster enters the
ERROR state, however, Dataproc does not populate the detail field if cluster
creation fails.
The correct behavior is to poll on Operation and report the error from the
Operation, instead of polling on the cluster.
[[1]
https://github.com/apache/airflow/blob/master/airflow/contrib/operators/dataproc_operator.py#L252|https://github.com/apache/airflow/blob/master/airflow/contrib/operators/dataproc_operator.py#L252]
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
