fredthomsen opened a new issue #16952:
URL: https://github.com/apache/airflow/issues/16952


   **Description**
   
   A way to set a custom secrets backend to be lower priority than the built-in 
`airflow.secrets.environment_variables.EnvironmentVariablesBackend` and 
`airflow.secrets.metastore.MetastoreBackend`.
   
   **Use case / motivation**
   When creating a our own secrets backend utilizing Secret Server, our team 
noticed you cannot configure the the custom backend to be a lower priority than 
the default secrets backends.  In certain cases, we have DAGs that write to 
different sets of external systems and being able to change one of those 
external systems easily via environment variable to test certain conditions is 
a very simple way to validate things, and we also have several variables that 
have no need of security and checking the env vars first eliminates that 
network call/load to a busy system.  
   
   Now as a workaround, I do realize we can have our own secrets backend check 
available env vars first, but this does seem a bit clunky given the current 
design.  
   
   The goal would be to be able to toggle a custom backend to be lower priority 
such that the metastore and env vars are checked first.
   
   **Are you willing to submit a PR?**
   
   Yes, definitely.
   
   **Related Issues**
   
   You could argue #16404 is slightly related.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


Reply via email to