danielcweeks opened a new pull request #1945: URL: https://github.com/apache/iceberg/pull/1945
This reverts commit c882ac9249229078bf89caf48de688c399e858f9. @jackye1995 I wanted to propose reverting #1863 and going back to the HEAD operation for `exists()` and `contentLength()` FileIO operations. There was some discussion on the dev list and apparently there's some level of confirmation that negative caching with HEAD operations is covered (and possibly strong consistency?) in the recent announcement around S3 consistency. Iceberg isn't using this operation for consistency and the major concern I have is that the LIST operation cost appears to be 10X (or more) than the HEAD operation, which could really add up depending on usage. I just wanted to put this up for discussion and see if there's any real advantage at this point to using LIST. (cc @giovannifumarola, @kbendick, @massdosage and @rdblue since you were all on the original thread) ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
