Hi all, I've opened issue #5135 proposing a per-user Iceberg warehouse model for Texera, where each user registers one or more warehouses backed by their own S3 bucket (Bring-Your-Own-S3). This builds on the REST Catalog Service work from #4126 and makes Lakekeeper multi-tenant, so storage cost follows the data owner.
The issue lays out two alternative designs (Warehouse↔CU binding vs. Warehouse↔Execution binding), the registration / runtime flows with sequence diagrams. For details, please check the link below. I'd really appreciate your feedback. Link: https://github.com/apache/texera/issues/5135 Thanks!
