dentiny commented on issue #7909: URL: https://github.com/apache/opendal/issues/7909#issuecomment-4960595250
Hi @chitralverma thanks for raising this! I actually like buffer-based solution a lot, one big reason is for caller-owned memory, it's hard to implement [hedged request](https://github.com/apache/opendal/issues/7189). In terms of DuckDB integration, which both of us care about, I raise a separate issue [here](https://github.com/duckdb/duckdb/discussions/21546). In the latest v2.0 coming late this year, I introduced a buffer-wise data structure [here](https://github.com/duckdb/duckdb/blob/main/src/include/duckdb/storage/external_file_cache/file_buffer_handle_group.hpp), which should play with opendal better, but it's only used for DuckDB external file cache for now, and it needs some work to change the interface and prove it's more performant. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
