Hi everyone, I'd like to propose Apache Cassandra as another backend for Polaris' existing NoSQL persistence implementation.
I've opened a draft PR [6024] with the implementation so there is something concrete to review alongside this discussion. This would give operators who already run Cassandra another option for storing Polaris metadata using infrastructure and operational experience they already have. Following the recent DynamoDB integration, it also extends the choice of databases available through the existing NoSQL framework. The implementation uses the existing NoSQL backend interface and catalog-state model. Cassandra stores the metadata objects and references, with lightweight transactions implementing conditional reference updates. The catalog-reference update remains the publication point for a catalog change set. The draft includes: - The Cassandra adapter and Java-driver configuration. - Server and Admin Tool integration, including authentication, TLS, metrics, and readiness checks. - Backend tests, wiring into the shared persistence and correctness suites, and a server mTLS smoke test. - Configuration and bootstrap documentation. Cassandra is selected explicitly through the NoSQL backend configuration. The draft adds its driver dependencies to the server and Admin Tool distributions. It keeps Cassandra-specific implementation and configuration in the backend module. The proposed baseline for new deployments is Cassandra 5.0 or later. Operators create the keyspace with the replication settings appropriate for their deployment; Polaris initializes its tables during bootstrap. I'd welcome feedback on adding this backend and on the implementation, particularly: - Whether the consistency settings and conditional operations satisfy the existing NoSQL persistence contract. - Gaps in test coverage or operational documentation. - Dependency, packaging, or maintenance concerns with the proposed integration. The PR is a draft to support that discussion, and I can split it into smaller reviewable changes as needed. Thanks, Robert [6024] https://github.com/apache/polaris/pull/6024
