nhuantho opened a new issue, #14863: URL: https://github.com/apache/iceberg/issues/14863
### Feature Request / Improvement ## What: * When I used both HadoopFileIO and S3FileIO, I met a problem with different behavior handling slashes between the two FileIO libraries. * For example: * S3FileIO * <img width="1205" height="97" alt="Image" src="https://github.com/user-attachments/assets/cc663bf1-dac7-4c0b-b067-e6aa2432d47d"; /> * HadoopFileIO * <img width="1314" height="96" alt="Image" src="https://github.com/user-attachments/assets/19dd4f59-0972-4e7b-933c-132b4245e834"; /> * Then I checked the logic in `hadoop.fs.Path.java`, I saw a logic to detect and replace `"/+" to "/"` * <img width="554" height="68" alt="Image" src="https://github.com/user-attachments/assets/bbc6b4b7-924a-4c2e-9c58-180f3137f51a"; /> * <img width="518" height="79" alt="Image" src="https://github.com/user-attachments/assets/c753e20c-dc03-426a-a27b-974572e4a14c"; /> * So I want to add logic to self-control this behavior. ## Solution * Extend `org/apache/hadoop/fs/Path.java` and override some functions * Add `spark.sql.catalog.catalog.hadoop.fs.s3a.path.remove.duplicated.slashes` with value `true|false` ### Query engine None ### Willingness to contribute - [ ] I can contribute this improvement/feature independently - [x] I would be willing to contribute this improvement/feature with guidance from the Iceberg community - [ ] I cannot contribute this improvement/feature at this time -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
