szehon-ho commented on issue #4012: URL: https://github.com/apache/iceberg/issues/4012#issuecomment-1030489321
@amogh-jahagirdar @jackye1995 are you guys working on it? I chatted with @dramaticlly , maybe we can give it a try if you haven't started it yet? Was thinking we can have a new FileIO method like delete(Iterator<File>) , and default it to calling delete one by one, but in S3FileIO case can call S3#DeleteObjects like you say? It does get a bit messier with the the user-facing API BaseDeleteOrphanFilesSparkAction.deleteWith(), not sure if we might need to add another bulk API there or just have the default implementation use the better FileIO method -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
