Hi everyone,

I'd like to propose Apache Cassandra as another backend for Polaris'
existing NoSQL persistence implementation.

I've opened a draft PR [6024] with the implementation so there is something
concrete to review alongside this discussion.

This would give operators who already run Cassandra another option for
storing Polaris metadata using infrastructure and operational experience
they already have.
Following the recent DynamoDB integration, it also extends the choice of
databases available through the existing NoSQL framework.

The implementation uses the existing NoSQL backend interface and
catalog-state model.
Cassandra stores the metadata objects and references, with lightweight
transactions implementing conditional reference updates.
The catalog-reference update remains the publication point for a catalog
change set.

The draft includes:
- The Cassandra adapter and Java-driver configuration.
- Server and Admin Tool integration, including authentication, TLS, metrics,
  and readiness checks.
- Backend tests, wiring into the shared persistence and correctness suites,
  and a server mTLS smoke test.
- Configuration and bootstrap documentation.

Cassandra is selected explicitly through the NoSQL backend configuration.
The draft adds its driver dependencies to the server and Admin Tool
distributions.
It keeps Cassandra-specific implementation and configuration in the backend
module.

The proposed baseline for new deployments is Cassandra 5.0 or later.
Operators create the keyspace with the replication settings appropriate for
their deployment; Polaris initializes its tables during bootstrap.

I'd welcome feedback on adding this backend and on the implementation,
particularly:
- Whether the consistency settings and conditional operations satisfy the
  existing NoSQL persistence contract.
- Gaps in test coverage or operational documentation.
- Dependency, packaging, or maintenance concerns with the proposed
integration.

The PR is a draft to support that discussion, and I can split it into
smaller reviewable changes as needed.

Thanks,
Robert

[6024] https://github.com/apache/polaris/pull/6024

Reply via email to