[
https://issues.apache.org/jira/browse/AIRFLOW-4492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16840706#comment-16840706
]
ASF GitHub Bot commented on AIRFLOW-4492:
-----------------------------------------
potiuk commented on pull request #5269: [AIRFLOW-4492] Rebase Dataproc Cluster
operators to poll Operations
URL: https://github.com/apache/airflow/pull/5269
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
> Dataproc operator does not capture error from create cluster failure
> --------------------------------------------------------------------
>
> Key: AIRFLOW-4492
> URL: https://issues.apache.org/jira/browse/AIRFLOW-4492
> Project: Apache Airflow
> Issue Type: Bug
> Components: operators
> Reporter: Dan Sedov
> Assignee: Dan Sedov
> Priority: Minor
>
> This line [1] captures the detail message as exception when cluster enters
> the ERROR state, however, Dataproc does not populate the detail field if
> cluster creation fails.
> The correct behavior is to poll on Operation and report the error from the
> Operation, instead of polling on the cluster.
> [[1]
> https://github.com/apache/airflow/blob/master/airflow/contrib/operators/dataproc_operator.py#L252|https://github.com/apache/airflow/blob/master/airflow/contrib/operators/dataproc_operator.py#L252]
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
