CTTY opened a new issue, #2065:
URL: https://github.com/apache/iceberg-rust/issues/2065

   ### Is your feature request related to a problem or challenge?
   
   As discussed 
[here](https://github.com/apache/iceberg-rust/pull/1885#discussion_r2558091741),
 we currently don't have a way to do batch deletes leveraging APIs like S3's 
DeleteObjects or Azure's BlobBatch
   
   ### Describe the solution you'd like
   
   Took a look at OpenDal and ObjectStore and noticed that they already have 
`delete_iter` and `delete_stream` to support this. From the iceberg side we can 
add `delete_iter` as well. Iterator can be easily converted to stream for 
ObjectStore's Storage implementation.
   
   plus the paths to delete should be less than 1000(S3) and 256(Azure). 
pipelining the paths to backend storage won't be really necessary since the 
bottleneck is obviously the actual delete operation
   
   ### Willingness to contribute
   
   I can contribute to this feature independently


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to