andygrove commented on PR #4254:
URL: 
https://github.com/apache/datafusion-comet/pull/4254#issuecomment-4392934450

   ## before
   
   tbd
   
   ## after
   
   ```
   Running benchmark: var_samp
     Running case: Spark
     Stopped after 30 iterations, 2045 ms
     Running case: Comet (Scan)
     Stopped after 40 iterations, 2035 ms
     Running case: Comet (Scan + Exec)
     Stopped after 90 iterations, 2012 ms
   
   OpenJDK 64-Bit Server VM 17.0.17+10 on Mac OS X 26.3.1
   Apple M3 Ultra
   var_samp:                                 Best Time(ms)   Avg Time(ms)   
Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
   
------------------------------------------------------------------------------------------------------------------------
   Spark                                                66             68       
    2         15.9          62.8       1.0X
   Comet (Scan)                                         49             51       
    2         21.5          46.5       1.4X
   Comet (Scan + Exec)                                  21             22       
    1         49.9          20.0       3.1X
   
   Running benchmark: var_pop
     Running case: Spark
     Stopped after 30 iterations, 2010 ms
     Running case: Comet (Scan)
     Stopped after 41 iterations, 2033 ms
     Running case: Comet (Scan + Exec)
     Stopped after 93 iterations, 2005 ms
   
   OpenJDK 64-Bit Server VM 17.0.17+10 on Mac OS X 26.3.1
   Apple M3 Ultra
   var_pop:                                  Best Time(ms)   Avg Time(ms)   
Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
   
------------------------------------------------------------------------------------------------------------------------
   Spark                                                65             67       
    2         16.0          62.5       1.0X
   Comet (Scan)                                         48             50       
    1         21.8          45.9       1.4X
   Comet (Scan + Exec)                                  21             22       
    1         50.6          19.8       3.2X
   
   Running benchmark: stddev_samp
     Running case: Spark
     Stopped after 30 iterations, 2034 ms
     Running case: Comet (Scan)
     Stopped after 40 iterations, 2035 ms
     Running case: Comet (Scan + Exec)
     Stopped after 93 iterations, 2017 ms
   
   OpenJDK 64-Bit Server VM 17.0.17+10 on Mac OS X 26.3.1
   Apple M3 Ultra
   stddev_samp:                              Best Time(ms)   Avg Time(ms)   
Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
   
------------------------------------------------------------------------------------------------------------------------
   Spark                                                65             68       
    1         16.0          62.3       1.0X
   Comet (Scan)                                         49             51       
    1         21.2          47.1       1.3X
   Comet (Scan + Exec)                                  21             22       
    1         50.8          19.7       3.2X
   
   Running benchmark: stddev_pop
     Running case: Spark
     Stopped after 31 iterations, 2056 ms
     Running case: Comet (Scan)
     Stopped after 40 iterations, 2003 ms
     Running case: Comet (Scan + Exec)
     Stopped after 93 iterations, 2003 ms
   
   OpenJDK 64-Bit Server VM 17.0.17+10 on Mac OS X 26.3.1
   Apple M3 Ultra
   stddev_pop:                               Best Time(ms)   Avg Time(ms)   
Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
   
------------------------------------------------------------------------------------------------------------------------
   Spark                                                64             66       
    1         16.4          60.9       1.0X
   Comet (Scan)                                         48             50       
    1         21.6          46.2       1.3X
   Comet (Scan + Exec)                                  21             22       
    1         50.6          19.8       3.1X
   
   Running benchmark: covar_samp
     Running case: Spark
     Stopped after 27 iterations, 2022 ms
     Running case: Comet (Scan)
     Stopped after 34 iterations, 2016 ms
     Running case: Comet (Scan + Exec)
     Stopped after 75 iterations, 2004 ms
   
   OpenJDK 64-Bit Server VM 17.0.17+10 on Mac OS X 26.3.1
   Apple M3 Ultra
   covar_samp:                               Best Time(ms)   Avg Time(ms)   
Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
   
------------------------------------------------------------------------------------------------------------------------
   Spark                                                73             75       
    2         14.4          69.6       1.0X
   Comet (Scan)                                         56             59       
    2         18.6          53.7       1.3X
   Comet (Scan + Exec)                                  26             27       
    1         40.9          24.5       2.8X
   
   Running benchmark: covar_pop
     Running case: Spark
     Stopped after 27 iterations, 2018 ms
     Running case: Comet (Scan)
     Stopped after 35 iterations, 2027 ms
     Running case: Comet (Scan + Exec)
     Stopped after 76 iterations, 2021 ms
   
   OpenJDK 64-Bit Server VM 17.0.17+10 on Mac OS X 26.3.1
   Apple M3 Ultra
   covar_pop:                                Best Time(ms)   Avg Time(ms)   
Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
   
------------------------------------------------------------------------------------------------------------------------
   Spark                                                73             75       
    2         14.4          69.5       1.0X
   Comet (Scan)                                         56             58       
    2         18.7          53.5       1.3X
   Comet (Scan + Exec)                                  25             27       
    2         41.1          24.3       2.9X
   
   Running benchmark: corr
     Running case: Spark
     Stopped after 25 iterations, 2067 ms
     Running case: Comet (Scan)
     Stopped after 31 iterations, 2053 ms
     Running case: Comet (Scan + Exec)
     Stopped after 61 iterations, 2000 ms
   
   OpenJDK 64-Bit Server VM 17.0.17+10 on Mac OS X 26.3.1
   Apple M3 Ultra
   corr:                                     Best Time(ms)   Avg Time(ms)   
Stdev(ms)    Rate(M/s)   Per Row(ns)   Relative
   
------------------------------------------------------------------------------------------------------------------------
   Spark                                                80             83       
    5         13.1          76.1       1.0X
   Comet (Scan)                                         64             66       
    2         16.4          61.0       1.2X
   Comet (Scan + Exec)                                  32             33       
    1         32.6          30.7       2.5X
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to