yaooqinn commented on issue #26622: [WIP][SPARK-28023][Test] Cheap UTF8String Trim URL: https://github.com/apache/spark/pull/26622#issuecomment-556984749 #### normal trim v.s. inside trim The result shows 10~20% perfomance improvement @cloud-fan ```java [info] Java HotSpot(TM) 64-Bit Server VM 1.8.0_231-b11 on Mac OS X 10.15.1 [info] Intel(R) Core(TM) i5-5287U CPU @ 2.90GHz [info] Cast String to Numeric: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative [info] ------------------------------------------------------------------------------------------------------------------------ [info] cast(trim(str) as int) as c_int 4259 5270 1110 1.9 519.9 1.0X [info] cast(trim(str) as long) as c_long 4081 5663 1372 2.0 498.2 1.0X [info] cast(str as int) as c_int 4071 4254 176 2.0 496.9 1.0X [info] cast(str as long) as c_long 4121 5087 1272 2.0 503.1 1.0X [info] ```
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
