agonen opened a new issue #10791: URL: https://github.com/apache/airflow/issues/10791
we have a long-running task in airflow (5hr and more) I would like the following abilities : 1. when waiting for the pod starts or finishes, the log gets prints every 2 sec (this creates a lot of logging lines ) can we expose this as a parameter ? 2. can we have a parameter to fire an forget (after the pod started running) and the monitor the status of the task using sensor this can free the worker and reduce resources https://github.com/apache/airflow/blob/10ce31127f1ff87176158935925afce46a989917/airflow/kubernetes/pod_launcher.py#L140 ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
