srstrickland commented on PR #1429: URL: https://github.com/apache/iceberg-python/pull/1429#issuecomment-3423334847
Hi- I think supporting the native s3table interface has merit; in particular because the rest path involves an extra hop (and involvement with the glue team in AWS)... and more tangibly, might suffer from issues like this one: https://github.com/apache/iceberg-python/issues/2511, which has had a major impact on our data flows for over a month. AWS confirmed that this was _only_ a problem with rest / glue, whereas native s3table interactions would not have been impacted (and we're still waiting for the fix to be deployed). It would be great if we could just swap out a different catalog that interacts directly with s3tables. I'm a bit disappointed to find that https://github.com/apache/iceberg-python/issues/1404 was closed (and likely this PR abandoned) in favor of only supporting rest interactions. Can we revisit that decision? Thanks all 🙏 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
