thcidale0808 commented on pull request #21223:
URL: https://github.com/apache/airflow/pull/21223#issuecomment-1037443067
@potiuk , please find below a proposed solution and answers to your
questions:
## Solution:
Create a state file and a pool config sync cli and api to sync to database
and config. The state file will be the source of true. When user call the
config sync using the cli or api, the core flow will be: [state file → DB
(models), state file → conf (hot reload)].
The state file will be generated when airflow is initiated based on the
config and env variables.
The state file will be updated when the user create or change a pool using
the current UI.
For changes of the environment variables, the user will also need to call
the sync process using the new api or cli and pass the boolean argument
—env-var. This will update the state file based on the env vars and then
execute the core flow.
Example: When user create or update a pool using the UI or the importer,
will update the state file and then call the sync process.
## Questions:
Based on the solution above, please find below answer to your questions:
- I updated the environment value and the pool has not been updated ? Why?
Is it explained somewhere? How can I update it?
R: Call pool config sync cli or api passing the argument —env-var. This
will update the state file and execute the core flow.
- I removed the pool from environment but it has not been removed? Why ? How
can I remove the pool without using CLI or UI or API since I could create one ?
R: Similar with previous question. Call the pool config sync cli or api
passing the argument —env-var
- How can I rename a pool by changing the environment/config ?
R: For env variables changes, call pool config sync cli or api passing
the argument —env-var. This will update the state file and execute the core
flow. Similarly, for config change, call the sync using —config
- How can I update pool value without using CLI or UI or API ?
R: Using the current UI. This will also update the state file which will
be the source of the true for the sync process.
- If I already updated my pool value via DB, what happens if I change the
value in the environment or conf?
R: This will a sync issue. So upon executing the dag use the pool, log a
warning letting the user know that there’s a mismatch between the DB and the
state file and asking to change the values using the UI or env variables and
execute the sync process.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
