adnanhemani opened a new pull request, #1844: URL: https://github.com/apache/polaris/pull/1844
As per my [proposal on the Dev ML](https://lists.apache.org/thread/nfp40hmwryybznxtgffvy4c5l5kk19ho), this is the implementation of persisting Polaris Events to a persistence. The overall goal for this PR is to store Events in the Polaris persistence layer - which will later be used to power the Iceberg Events API. High-level overview of the changes: * Created a new persistence table and model for Events * Implemented a new persistence method to flush events to said table * Implemented an in-memory and file-based buffer implementation for flushing events to the persistence * Created configurations for enabling all of these features * Modified PolarisEventListener and PolarisEvents to optimally achieve this goal * Created new sample events for CreateTable (explicitly part of the Iceberg Events API spec) and CreateCatalog (which is not explicitly part of the Iceberg Events API spec and will be served as a CustomOperation). Here are the following upcoming items that will be updated in this PR soon: * Testing for the new code paths added Upcoming items that will be tackled in subsequent PRs (and were excluded to ensure that this PR contains only the end-to-end MVP): * Support for multiple datasources to store the events * Allowing multiple event listeners to be set * Additional event types and related instrumentation -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@polaris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
