GitHub user AshutoshSrivastavaDev added a comment to the discussion: Facing intermittent issue in DAG
@potiuk Thanks again for the advice! I've made the sync process more atomic as suggested. I have a very basic (maybe even naive) question: I'm running the Airflow scheduler using: `nohup airflow scheduler > scheduler.log &` To clear the log as it grows, I occasionally do: `> scheduler.log` After doing this, the log file remains at 0 bytes. Does this mean the scheduler has stopped or is facing issues writing to the log file? Or is this expected behavior? Also, I observed that on 2 out of our 3 master nodes, the scheduler.log file has been stuck at 0 bytes for the past few days—possibly since this import error started showing up. We restarted the Airflow scheduler on both of those nodes, and since then, the issue seems to have gone away. Could this have been the root cause? GitHub link: https://github.com/apache/airflow/discussions/50390#discussioncomment-13129739 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
