alippai commented on issue #38818: URL: https://github.com/apache/arrow/issues/38818#issuecomment-1825242918
Ah, you are right. That would be a weird hack. On the other hand reading the spec further it looks like the statistics are storing the values. Only one row group should be read. I can try strace tomorrow, but I have a feeling all row groups are read. I would be surprised if reading a dictionary with 10k values would take 0.5s -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
