blcksrx commented on issue #32363: URL: https://github.com/apache/airflow/issues/32363#issuecomment-1816855841
@renxunsaky @eladkal Just to clarify that in the https://github.com/apache/airflow/pull/31798 I fixed the compatibility issue and the operator works as like before (with deleting the same app) as before. When a user adds this argument `watch=True` to the operator. the operator monitors the whole state of the SparkApplication and streams the logs to the output and deletes the k8s pod. The whole idea is that an operators (such as mysql transfer) is responsible to open the connection, transfer data, monitor the states and finally close the connection (do the cleanup process). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
