Github user Fokko commented on the issue:

    https://github.com/apache/spark/pull/21596
  
    It took some time, but here it is, current master:
    ```
    MacBook-Pro-van-Fokko:dist fokkodriesprong$ cat /tmp/spark-master.txt
    Preparing data for benchmarking ...
    Running benchmark: JSON schema inferring
      Running case: No encoding
      Stopped after 3 iterations, 153857 ms
      Running case: UTF-8 is set
      Stopped after 3 iterations, 210849 ms
    
    Java HotSpot(TM) 64-Bit Server VM 1.8.0_172-b11 on Mac OS X 10.13.5
    Intel(R) Core(TM) i7-7820HQ CPU @ 2.90GHz
    
    JSON schema inferring:                   Best/Avg Time(ms)    Rate(M/s)   
Per Row(ns)   Relative
    
------------------------------------------------------------------------------------------------
    No encoding                                 43607 / 51286          2,3      
   436,1       1,0X
    UTF-8 is set                                69107 / 70283          1,4      
   691,1       0,6X
    
    Preparing data for benchmarking ...
    Running benchmark: JSON per-line parsing
      Running case: No encoding
      Stopped after 3 iterations, 32557 ms
      Running case: UTF-8 is set
      Stopped after 3 iterations, 52323 ms
    
    Java HotSpot(TM) 64-Bit Server VM 1.8.0_172-b11 on Mac OS X 10.13.5
    Intel(R) Core(TM) i7-7820HQ CPU @ 2.90GHz
    
    JSON per-line parsing:                   Best/Avg Time(ms)    Rate(M/s)   
Per Row(ns)   Relative
    
------------------------------------------------------------------------------------------------
    No encoding                                 10157 / 10853          9,8      
   101,6       1,0X
    UTF-8 is set                                17310 / 17441          5,8      
   173,1       0,6X
    
    Preparing data for benchmarking ...
    Running benchmark: JSON parsing of wide lines
      Running case: No encoding
      Stopped after 3 iterations, 74416 ms
      Running case: UTF-8 is set
      Stopped after 3 iterations, 88192 ms
    
    Java HotSpot(TM) 64-Bit Server VM 1.8.0_172-b11 on Mac OS X 10.13.5
    Intel(R) Core(TM) i7-7820HQ CPU @ 2.90GHz
    
    JSON parsing of wide lines:              Best/Avg Time(ms)    Rate(M/s)   
Per Row(ns)   Relative
    
------------------------------------------------------------------------------------------------
    No encoding                                 24311 / 24806          0,4      
  2431,1       1,0X
    UTF-8 is set                                27971 / 29398          0,4      
  2797,1       0,9X
    ```
    
    New Jackson:
    ```
    Java HotSpot(TM) 64-Bit Server VM 1.8.0_172-b11 on Mac OS X 10.13.5
    Intel(R) Core(TM) i7-7820HQ CPU @ 2.90GHz
    
    JSON schema inferring:                   Best/Avg Time(ms)    Rate(M/s)   
Per Row(ns)   Relative
    
------------------------------------------------------------------------------------------------
    No encoding                                 45615 / 46109          2,2      
   456,2       1,0X
    UTF-8 is set                                67516 / 69291          1,5      
   675,2       0,7X
    
    Preparing data for benchmarking ...
    Running benchmark: JSON per-line parsing
      Running case: No encoding
      Stopped after 3 iterations, 36206 ms
      Running case: UTF-8 is set
      Stopped after 3 iterations, 63400 ms
    
    Java HotSpot(TM) 64-Bit Server VM 1.8.0_172-b11 on Mac OS X 10.13.5
    Intel(R) Core(TM) i7-7820HQ CPU @ 2.90GHz
    
    JSON per-line parsing:                   Best/Avg Time(ms)    Rate(M/s)   
Per Row(ns)   Relative
    
------------------------------------------------------------------------------------------------
    No encoding                                 11803 / 12069          9,2      
   118,0       1,0X
    UTF-8 is set                                19500 / 21134          5,1      
   195,0       0,6X
    
    Preparing data for benchmarking ...
    Running benchmark: JSON parsing of wide lines
      Running case: No encoding
      Stopped after 3 iterations, 69479 ms
      Running case: UTF-8 is set
      Stopped after 3 iterations, 82703 ms
    
    Java HotSpot(TM) 64-Bit Server VM 1.8.0_172-b11 on Mac OS X 10.13.5
    Intel(R) Core(TM) i7-7820HQ CPU @ 2.90GHz
    
    JSON parsing of wide lines:              Best/Avg Time(ms)    Rate(M/s)   
Per Row(ns)   Relative
    
------------------------------------------------------------------------------------------------
    No encoding                                 23044 / 23160          0,4      
  2304,4       1,0X
    UTF-8 is set                                27194 / 27568          0,4      
  2719,4       0,8X
    ```


---

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to