alippai commented on issue #38818: URL: https://github.com/apache/arrow/issues/38818#issuecomment-1825216069
Sounds like we are facing three problems: 1.) unused dict values are not pruned in dict pages 2.) same dictionary pages are not reused when writing 3.) when reading the same dictionary page it’s not cached I wonder why didn’t I see this with integer-integer dictionary -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
