peter-toth commented on issue #28041: [WIP][SPARK-30564][SQL] Improved extra new line and comment remove URL: https://github.com/apache/spark/pull/28041#issuecomment-604923815 Results for the benchmark in the JIRA (https://issues.apache.org/jira/browse/SPARK-30564) before this PR: ``` parsing large select: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ 2500 select expressions 314 806 612 0.0 313617893.0 0.0X ``` After this PR: ``` parsing large select: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ 2500 select expressions 120 131 11 0.0 120476036.0 0.0X ``` https://github.com/apache/spark/pull/27078/files#diff-8d27bbf2f73a68bf0c2025f0702f7332R74 before this PR: ``` deeply nested struct field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ 250 deep x 400 rows (read in-mem) 1239 1256 25 0.1 12387.6 0.0X ``` After this PR: ``` deeply nested struct field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ 250 deep x 400 rows (read in-mem) 233 250 13 0.4 2329.8 0.1X ```
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
