Igosuki commented on issue #83: URL: https://github.com/apache/arrow-datafusion/issues/83#issuecomment-984500054
The indexed map access code will work on the plan so the only thing the parquet reader has to do is simply deserialize nested structures recursively. As long as there is a struct for string keys, or a list for int keys at the corresponding level, it will return the proper column. @houqp I see that support in parquet2 was added (have not tested the arrow2 branch yet) https://github.com/jorgecarleitao/parquet2/pull/64 so it's only a matter of adding it to the reader. As for arrow-rs it looks like it's still not done https://github.com/apache/arrow-rs/blob/master/parquet/src/arrow/array_reader.rs#L803 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
