Xuanwo commented on issue #6995: URL: https://github.com/apache/opendal/issues/6995#issuecomment-3646728855
Hi, thank you @amunra for bringing this up. > The data in our object store is often overwritten on the same path quickly. That's an interesting use case, and `into_futures_async_read` does have issues here. We need `stat` here because it's required to get the length so we can implement `AsyncSeek` correctly. Also, the file size is needed to allow us to do concurrent reading. There are two possible workarounds and two possible fixes here: - Workaround: Always carry `version_id` while reading the file. - Workaround: Use opendal's own `Reader` without converting it into `FuturesAsyncRead`, where we don't need to get the total file size. - Fix: `stat` will return a `version_id`, so we can always carry the version_id to read data. - Fix: Delay resolving the file size until users try to call `seek`, though we might still need to properly handle the correct version_id. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
