kbendick commented on code in PR #5972:
URL: https://github.com/apache/iceberg/pull/5972#discussion_r996385312
##########
core/src/main/java/org/apache/iceberg/hadoop/HadoopFileIO.java:
##########
@@ -78,7 +78,7 @@ public OutputFile newOutputFile(String path) {
@Override
public void deleteFile(String path) {
- Path toDelete = new Path(path);
+ Path toDelete = new Path(path.replaceAll("s3", "s3a"));
Review Comment:
Also, how much if any of the equivalency checking can we defer to the
various hadoop libraries (cloud shims, native HDFS) would be good to know as
well.
But I can see cases where we'd want to be able to control it ourselves
(cross cloud interactions for disaster recovery, etc).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
