Github-dm-CDE commented on issue #33688:
URL: https://github.com/apache/airflow/issues/33688#issuecomment-1697628036
> Any chance to see the logs with debug turned on for tasks as asked above
@Github-dm-CDE ? And a bit more info on the deployment of yours ?
Regarding the logs, I first have to clarify this with my team and would
possibly report back tomorrow.
Regarding the deployment: Airflow runs on 3 RHEL8 VM hosts as a .pex file.
The host from the screenshot runs on a 10Core CPU with 60GB RAM. The deployment
of the Airflow .pex file and the necessary Dag Configs and other code is done
via Ansible. Ansible loads the files from our Git repos onto the hosts and
links them in the {{airflow_home}}/active directory. Other CLIs that we use
from Airflow are also deployed as .pex files via Ansible.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
