baha-bouali opened a new pull request, #71278:
URL: https://github.com/apache/airflow/pull/71278
Part of #70265 (related: #67056). Migrates #70270.
## Why
#67056 decoupled remote logging from the hardcoded branches in
`airflow_local_settings.py`:
core and the Task SDK now resolve the handler via ProvidersManager dispatch
on the
`[logging] remote_base_log_folder` URL scheme, instantiating the provider
class through a
no-arg `from_config()` classmethod. This migrates the `hdfs` scheme.
## What
- Add `HdfsRemoteLogIO.from_config()`, mirroring the legacy
`airflow_local_settings.py`
branch — including stripping to `urlsplit(...).path` for `remote_base`
(the legacy branch
drops the `hdfs://host` part and keeps only the path), the
`[logging] remote_task_handler_kwargs` IO-kwargs merge, and `expanduser` on
`base_log_folder`, so behavior is unchanged for existing configs.
- Register the `hdfs` scheme under `remote-logging:` in
`providers/apache/hdfs/provider.yaml`
and mirror it in `get_provider_info.py`.
- Add tests mirroring `TestS3RemoteLogIOFromConfig` from
`providers/amazon/tests/unit/amazon/aws/log/test_s3_task_handler.py`.
---
##### Was generative AI tooling used to co-author this PR?
- [X] Yes (please specify the tool below)
Assisted by Claude Sonnet 5, Reviewed by the submitter
---
* Read the **[Pull Request
Guidelines](https://github.com/apache/airflow/blob/main/contributing-docs/05_pull_requests.rst#pull-request-guidelines)**
for more information.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
