alamb commented on issue #8502: URL: https://github.com/apache/arrow-datafusion/issues/8502#issuecomment-1870282821
> However, I am not sure about properly benchmarking the solution (as stated in the PR) and perhaps some more tests are needed? I am looking forward to your feedback. I think a good test would be to find a largish JSON input file and show some benchmark reading numbers I don't know of any existing benchmarks we have for reading large JSON files. Maybe we could add a benchmark for reading from large JSON (any CSV?) files in https://github.com/apache/arrow-datafusion/tree/main/benchmarks#datafusion-benchmarks Something like ``` bench.sh run parse ``` That would measure the speed of parsing a large JSON file -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
