sungwy opened a new pull request, #18199: URL: https://github.com/apache/iceberg/pull/18199
This is a proof of concept, and not inteded for merge. It underpins the use case analysis in [FILE type on IRC-governed tables](https://docs.google.com/document/d/1g4u66tGC2FOYj6DEWRZNBZahx4xCk0HaA98W7ff3Dr4) and the endpoint proposed in [Batch Signing for the Iceberg REST Catalog](https://docs.google.com/document/d/1A1mSy-c79ZYQ1zcEcVlagev1wwQOaiLo_uRobmqZSOU) A vendor stand-in package under test, org.apache.iceberg.spark.vendor registers a table valued function that uses mapPartition to batch signing calls to the IRC endpoint, reducing number of calls from N where N = number of FILE column rows to ceil(N / batch_size) Scope determination and API design by human. Code scaffolded with Claude, reviewed by human -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
