wgtmac commented on issue #513: URL: https://github.com/apache/iceberg-cpp/issues/513#issuecomment-3758383955
You might want to follow https://github.com/apache/iceberg-cpp/blob/main/src/iceberg/file_reader.h#L71 to add a `read.arrow.use-large-list` key with `false` as the default value. Then, set `ArrowReaderProperties::set_list_type(...)` for Parquet reader based on the that property: https://github.com/apache/arrow/blob/25b7247f9713ad837636019124466b4e752d3409/cpp/src/parquet/properties.h#L1183. For completeness, perhaps we should also support Avro reader as well (can be a separate change of course). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
