mbutrovich commented on PR #2100:
URL: https://github.com/apache/iceberg-rust/pull/2100#issuecomment-3837052752
I'm also considering caching `FileMetadata` alongside `ParquetMetaData`,
since I think this code:
```
let (file_metadata, parquet_reader) =
try_join!(parquet_file.metadata(), parquet_file.reader())?;
```
results in redundant `HEAD` requests if tasks refer to the same file.
@Xuanwo does OpenDAL do any sort of caching for that, or should I implement
that here along with `ParquetMetaData` (maybe it's best not to assume anything
about underlying `Storage` implementations based on @CTTY's recent work)?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
