kbendick commented on a change in pull request #4300: URL: https://github.com/apache/iceberg/pull/4300#discussion_r826503965
########## File path: docs/drill/_index.md ########## @@ -0,0 +1,23 @@ +--- +title: "Drill" +bookIconImage: ../img/drill-logo.png +bookFlatSection: true +weight: 430 +bookExternalUrlNewWindow: https://drill.apache.org/docs/iceberg-format-plugin/ Review comment: The concern isn't with schema-free necessarily, but with having the source of truth come from a location on the file store. Iceberg requires an atomic compare and swap operation to be able to correctly determine the correct current metadata files at all times. Where this becomes dangerous is with multiple concurrent writers when using file based approach. However, it seems like there's maybe a zookeeper component involved in the Iceberg config? https://github.com/apache/drill/blob/00d0cb18e63cfd010038ed590c725fbfba86f817/distribution/src/main/resources/drill-metastore-override-example.conf#L46-L64 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
