parthchandra commented on pull request #35262: URL: https://github.com/apache/spark/pull/35262#issuecomment-1022462107
> > Updated the JDK 8 benchmark results as well. > > After comparing the new bench data, I find that the data corresponding to `Parquet Data Page V2` in the two test cases `String with Nulls Scan (50.0%) ` and `String with Nulls Scan (95.0%)` is relatively slower than the previous pr (although the CPU frequency of the testing machine is reduced): > > before after > String with Nulls Scan (50.0%) 145.7 ns/per row 228.7 ns/per row > String with Nulls Scan (95.0%) 25.2 ns/per row 77.9 ns/per row It's hard to reasonably compare the numbers across runs (even though the difference is substantial) because of the difference in the environment. Let me do a profile run to see if any obvious bottlenecks stand out. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
