paleolimbot opened a new issue, #1150:
URL: https://github.com/apache/sedona-db/issues/1150
While we allow file formats and table providers to be plugged in via Python,
we don't have a layer for catalogs. We should add the ability for this!
```python
class MyCatalogProvider(CatalogProvider):
def list_catalogs(self):
...
```
This stack would mirror the CatalogProviderList / CatalogProvider /
SchemaProvider stack from DataFusion, although we should arguably make it
arbitrarily nestable to support catalogs that allow that.
This is in preparation for supporting providers like Iceberg (REST catalog)
that have a catalog-like hierarchy built in. It will also help with things like
Overture that benefit from a metadata cache with very specific parameters /
schemas that are expensive to compute but are mostly known ahead of time.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
