cccs-jc opened a new issue #1941: URL: https://github.com/apache/iceberg/issues/1941
We are using the HadoopCatalog. We find this approach much simpler than the Hive based catalog. Using the HadoopCatalog all information is on disk which means we can also leverage the role based access of the storage for users that access files directly or via iceberg tables. However the HadoopCatalog listTables method assumes that all folders in a catalog are accessible by the user/client and throws a RuntimeIOException if it's unable to read from a folder. https://github.com/apache/iceberg/blob/ab6a5e9ebf2f580fb7be21fb00f1f543726f43eb/core/src/main/java/org/apache/iceberg/hadoop/HadoopCatalog.java#L143 This prevents us from leveraging the storage access controls with the iceberg HadoopCatalog. Looking at the code it would be easy enough to support a filtered view of the catalog based on access controls. For backward compatibility there could be a flag that would let you configure the HadoopCatalog to either filter inaccessible folders or throw an exception like it does currently. Are there any plans to support this feature? ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
