schizophrenicmaniac opened a new pull request, #77127:
URL: https://github.com/apache/airflow/pull/77127

   `WasbRemoteLogIO.read` listed blobs with `get_blobs_list`, which walks a 
single level with `delimiter="/"`. For a watcher's log directory on a 
triggerer, that listing returns `trigger.log` plus the `rotated/` prefix 
instead of the parts inside it. Reading `rotated/` then fails with 
BlobNotFound, which gets logged and added to the sources on every read, and the 
rotated parts (most of a busy watcher's history) never show up.
   
   When the requested path ends in `/`, `read` now lists with 
`get_blobs_list_recursive`, so nested blobs like `rotated/trigger.log.1` are 
listed and read directly. Task log reads don't end in `/`, so they still go 
through `get_blobs_list` and behave the same as before.
   
   Added tests for both cases: a directory read picks up and reads the rotated 
part with no read errors, and a file read still uses the one-level listing.
   
   closes: #77057
   related: #76560
   
   ---
   
   ##### Was generative AI tooling used to co-author this PR?
   
   - [ ] Yes (please specify the tool below)
   
   ---
   
   * Read the **[Pull Request 
Guidelines](https://github.com/apache/airflow/blob/main/contributing-docs/05_pull_requests.rst#pull-request-guidelines)**
 for more information. Note: commit author/co-author name and email in commits 
become permanently public when merged.
   * For fundamental code changes, an Airflow Improvement Proposal 
([AIP](https://cwiki.apache.org/confluence/display/AIRFLOW/Airflow+Improvement+Proposals))
 is needed.
   * When adding dependency, check compliance with the [ASF 3rd Party License 
Policy](https://www.apache.org/legal/resolved.html#category-x).
   * For significant user-facing changes create newsfragment: 
`{pr_number}.significant.rst`, in 
[airflow-core/newsfragments](https://github.com/apache/airflow/tree/main/airflow-core/newsfragments).
 You can add this file in a follow-up commit after the PR is created so you 
know the PR number.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to