pitrou edited a comment on pull request #8494: URL: https://github.com/apache/arrow/pull/8494#issuecomment-712849550
Before: * Parsing raw values: ``` FloatParsing<FloatType> 39763 ns 39758 ns 52350 items_per_second=25.152M/s FloatParsing<DoubleType> 29812 ns 29808 ns 68765 items_per_second=33.5483M/s ``` * CSV converter performance: ``` FloatConversion 199539 ns 199508 ns 3498 items_per_second=40.0986M/s ``` * Reading a CSV file of floating-point numbers (single-threaded): ``` 276 MB (10000000 rows) in 1.481 s. => 187 MB/s. 276 MB (10000000 rows) in 1.441 s. => 192 MB/s. 276 MB (10000000 rows) in 1.417 s. => 195 MB/s. 276 MB (10000000 rows) in 1.418 s. => 195 MB/s. 276 MB (10000000 rows) in 1.430 s. => 193 MB/s. ``` ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
