jbonofre opened a new pull request, #4613: URL: https://github.com/apache/polaris/pull/4613
Directories allow users to point Polaris at a location/prefix on an object store (S3, GCS, Azure) containing objects (including unstructured data like images, videos, documents) and automatically track the objects via an Iceberg table with objecr-level metadata (location, size, content type, checksum, last modified, etc.). When a directory is created, Polaris stores the directory configuration (name, location, scan filters, scan schedule) as a DIRECTORY entity and also creates an associated Iceberg table with the predefined schema. ## Checklist - [X] ๐ก๏ธ Don't disclose security issues! (contact [email protected]) - [X] ๐ Clearly explained why the changes are needed, or linked related issues: Fixes # - [X] ๐งช Added/updated tests with good coverage, or manually tested (and explained how) - [X] ๐ก Added comments for complex logic - [ ] ๐งพ Updated `CHANGELOG.md` (if needed) - [X] ๐ Updated documentation in `site/content/in-dev/unreleased` (if needed) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
