dhallam commented on issue #3032: URL: https://github.com/apache/iceberg-python/issues/3032#issuecomment-3880109690
@jayceslesar A scenario we are looking to cover is where AWS Firehose (which commits to Iceberg via AWS Glue) fails to commit after its retries (for some reason, e.g. a blip in IAM or maybe an OCC conflict with a housekeeping task) - so ends up with failed commits at rest. So it's effectively that commit that we want to retry - but all we have are the files in parquet in partitioned prefixes, just not commited to the table - and we're trying to figure out the most efficient and effective way to do that. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
