rajarshisarkar commented on issue #4508: URL: https://github.com/apache/iceberg/issues/4508#issuecomment-1089817910
> It is often expensive, especially if it involve remote reads through network. Certain stream operation such as backward seek and small reads characteristics by Avro library can have high latency depending on the target file system / cloud connector. Thanks, for bringing this up. We also recently noticed this while using S3 as the target file system. The use case was for high throughput streaming jobs with a lot of snapshots. Do let me know if you would like to collaborate on this work. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
