sunchao commented on pull request #32071: URL: https://github.com/apache/spark/pull/32071#issuecomment-814594810
Thanks for the review. I'm not sure if these are intended for nested types - they were introduced in #9774 and soon replaced by the vectorized value readers. For nested reader we might want to do something differently instead of reusing the parquet-mr classes, such as decode a batch of def/rep levels at a time according to the batch size. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
