The GitHub Actions job "Docs 404 check (beta)" on 
flink.git/argoyal+01/flink-decouple-remote-retention has failed.
Run started by GitHub user argoyal2212 (triggered by argoyal2212).

Head commit for run:
22abdde35ed2153e002cccc00b3c3e59e9832cac / Archit Goyal 
<[email protected]>
[FLINK-37155][historyserver] Decouple remote archive retention from local 
processing limit

Adds historyserver.archive.retain-remote-beyond-local-limit (default
false, backward compatible). When enabled, job archives beyond
historyserver.archive.retained-jobs are no longer polled/processed
locally, but are kept in the remote archive directory instead of
being deleted. Such archives remain reachable on demand via the
existing lazyFetchArchiveProactively on-demand fetch path when
historyserver.archive.load.mode is set to LAZY.

This closes a gap left after FLINK-39911/FLINK-40097 introduced the
pluggable ArchiveStorage backend and on-demand lazy archive loading:
retainedStrategy.shouldRetain() still gated both local processing
and remote deletion together, so operators could not keep an
unbounded remote archive history while only actively
polling/caching a small recent window locally.

This addresses the remaining scope of FLIP-505 / FLINK-37155: the
on-demand per-job fetch and recently-viewed-job prioritization goals
of that FLIP are already covered by FLINK-39911/FLINK-40097; this
change covers the remaining decouple-local-vs-remote-retention goal.

- HistoryServerOptions: new HISTORY_SERVER_RETAIN_REMOTE_BEYOND_LOCAL_LIMIT 
option.
- HistoryServerArchiveFetcher: new constructor overload taking the flag;
  scanArchives() now routes archives beyond the retained limit to a new
  cleanupLocalArchivesBeyondRetainedLimit() (local-only cleanup) instead
  of cleanupArchivesBeyondRetainedLimit() (local+remote) when enabled.
- HistoryServer: reads and wires the new option into the job archive fetcher.
- Regenerated 
docs/layouts/shortcodes/generated/history_server_configuration.html.
- Added HistoryServerArchiveFetcherTest coverage for both the default
  (remote-deleted) and opted-in (remote-retained, still fetchable
  on-demand) behavior.

Co-authored-by: Copilot <[email protected]>

Report URL: https://github.com/apache/flink/actions/runs/32807938419

With regards,
GitHub Actions via GitBox

Reply via email to