kbendick commented on a change in pull request #4300: URL: https://github.com/apache/iceberg/pull/4300#discussion_r826503965
########## File path: docs/drill/_index.md ########## @@ -0,0 +1,23 @@ +--- +title: "Drill" +bookIconImage: ../img/drill-logo.png +bookFlatSection: true +weight: 430 +bookExternalUrlNewWindow: https://drill.apache.org/docs/iceberg-format-plugin/ Review comment: The concern isn't with trying to be schema-free necessarily, but with having the source of truth come from a location on the file store. Iceberg requires an atomic compare and swap operation to be able to correctly determine the current metadata file that acts as the root of the table at all times. Where this becomes dangerous is with multiple concurrent writers when using file based approach. However, it seems like there's maybe a zookeeper component involved in the Iceberg config? https://github.com/apache/drill/blob/00d0cb18e63cfd010038ed590c725fbfba86f817/distribution/src/main/resources/drill-metastore-override-example.conf#L46-L64 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
