lazear commented on issue #5490: URL: https://github.com/apache/arrow-rs/issues/5490#issuecomment-2006047407
OK, so I did some profiling... the biggest culprit appears to be farther down in my stack (gzip compression of the streaming newline-delimited JSON...), which delays returning any responses until the stream is finished - which in the case of filters being applied, requires the entire file to be parsed first. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
