V0lantis commented on issue #23361: URL: https://github.com/apache/airflow/issues/23361#issuecomment-1133220533
Thank you @tanelk for your quick reaction time ! Here is some answers to your question : > @V0lantis it would be great to see few more lines of the stacktrace to know where the exception is happening for > you. You can find here ([just_scheduler_logs.log](https://github.com/apache/airflow/files/8743394/just_scheduler_logs.log)) the full stack trace of one of my scheduler with the issue discussed above. > Also any chance you can take a look at the database log to see what queries are acccosiated with the two >processes/transactions. From this we can only see on half of the problem. I fortunately found it, I didn't know I had access to it. I give you the full log (removing some data from our company). There is a lot of `2022-05-20 17:10:09 UTC:172.17.45.29(42506):airflow@airflow:[22919]:ERROR: duplicate key value violates unique constraint "variable_key_key"`, but with a control-f you can find the `transaction_id` which is referenced from the scheduler logs given above. I am running on an Airflow 2.2.4. There are some custom plugins (not many though), simply plugins which are creating new dags from a given template. We are communicating to pg (pg 12.7 by the way) through pgbouncer. Hope that will help understand what is the issue :+1: -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
