stephen-bracken opened a new issue, #70133: URL: https://github.com/apache/airflow/issues/70133
### Description Json config settings like `[core] dag_bundle_config_list` and `[secrets_backend] backend_kwargs` can become quite large and cumbersome. The linux kernel sets a maximum total size limit of 256MB for environment variables, so adding large json blobs to the environment variables risks running into these limits. To work around this, json files could be loaded into the config using the same technique as secrets by specifying a path to a json file in the config and reading the file at runtime using `json.load()`. ### Use case/motivation Like with config settings tagged as secrets, update the `conf.getjson()` method to also attempt to load json config settings from a path specified using a suffix, e.g. `dag_bundle_config_list_file=/opt/airflow/config/dag_bundles.json` would read the setting `dag_bundle_config_list` from `/opt/airflow/config/dag_bundles.json` ### Related issues #65449 ### Are you willing to submit a PR? - [x] Yes I am willing to submit a PR! ### Code of Conduct - [x] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
