GitHub user bejota added a comment to the discussion: Integrating Airflow with SLURM
Hello @ecodina , We have a similar workflow as you describe. We are collecting seismic data, so replace "Simulation" with "Migration". We still have individual job or job array monitoring in place but have not run at full scale yet, so not much to report there. We are still using Airflow version 2.10. Have you tried migrating to Airflow v3 yet? If so, have you made any changes in the workflow? GitHub link: https://github.com/apache/airflow/discussions/24076#discussioncomment-14639895 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
