lasdf1234 opened a new pull request, #13985:
URL: https://github.com/apache/gravitino/pull/13985
### What changes were proposed in this pull request?
Implement expand-pool fan-out (ยง5.2.1). **Depends on #13897** (register
`policy-expand` leases); this PR sits on top of that branch.
- Replace the `policy-expand` no-op with `PolicyExpandPipeline` that loads
the policy, lists tag-bound tables (capped by `expand.enqueueBatchSize`), and
enqueues one-shot `cron-job` rows (`table:{tableId}:{policyId}`) via
`scheduleIfNotExists`
- Reschedule the expand lease to the next Quartz fire, or remove it when the
policy is missing / disabled / blank `timeTrigger` / non-maintenance
- Autocommit wrapper for `SchedulerClient` against the entity-store
DataSource (`defaultAutoCommit=false`)
**Out of scope:** cron-pool Spark submit, commit-job path, hierarchical
nearest-policy expansion.
### Why are the changes needed?
Fix: #13984
Parent: #13760. Registration alone (#13983 / #13897) only inserts expand
leases; without this pick handler, due leases never produce `cron-job` rows.
### Does this PR introduce _any_ user-facing change?
No. Internal scheduler behavior only; uses existing
`gravitino.maintenance.expand.enqueueBatchSize`.
### How was this patch tested?
- `./gradlew :plugins:tms:test -PskipITs --tests
'org.apache.gravitino.maintenance.scheduler.*'`
- Unit coverage: `TestPolicyExpandPipeline` (skip / enqueue / next-due),
`TestCronJobScheduler` (idempotent enqueue + batch cap)
Made with [Cursor](https://cursor.com)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
