Video Link ->
https://drive.google.com/file/d/1cO7Jh8vW3Lji2WwD9Gx4GTzRhA1X6v6o/view?usp=drive_link
Meeting Purpose
Discuss Polaris community updates, including HMS integration, event API,
and task delegation service proposals.
Key Takeaways
- HMS integration: Agreement to support HMS Federation while preserving
multi-tenancy capabilities
- Event API: Consensus on need for before/after event correlation;
further discussion needed on implementation details
- Task delegation: Ongoing debate between immediate implementation vs.
waiting for task refactoring; security concerns to be addressed
TopicsHMS Integration
- Majority agreed to support HMS Federation to enable HMS users to use
Polaris and migrate to Iceberg catalog
- Concerns raised about potential single-tenant limitations and Java
version compatibility
- Proposed solution: Use dynamic class loading to avoid linking all
dependencies to main Polaris binary
- Agreement to clearly segregate multi-tenant vs. single-tenant
deployment modes
Event API Proposal
- Robert proposed a more concise API with before/after event correlation
and error handling
- Debate on implementation details, including:
- Removing persistence dependencies
- Handling of request IDs
- Balancing generic vs. specific event types
- Agreement to schedule a separate meeting to discuss event API details
further
Task Delegation Service
- William proposed a delegation service for immediate value, targeting
Polaris 1.1 release
- Robert raised concerns about refactoring prerequisites and security
considerations
- Debate on whether to implement delegation service with current task
implementation (v1) or wait for new async task proposal (v2)
- Discussion on deprecation timeline for v1 task infrastructure once v2
is implemented
Task Refactoring and Async Proposal
- Robert working on refactoring to remove dependencies on persistence
and entities
- Timeline for completion unclear, blocking some integration efforts
- Proposal to potentially release work-in-progress PRs to facilitate
integration
Next Steps
- Robert to review the latest version of the delegation service proposal
document
- William to provide more details on current task API usage beyond drop
table purge
- Schedule follow-up meetings for:
1. Event API detailed discussion
2. Task delegation and refactoring next steps
- Robert to share relevant PRs for review to unblock integration efforts
- Community to discuss and agree on deprecation policy for duplicated
APIs (suggestion: keep for 3 releases)
