I second any effort to update, automate, and communicate the results of spark-perf (https://github.com/databricks/spark-perf)
On Fri, Jul 8, 2016 at 12:28 PM, Eric Liang <[email protected]> wrote: > Something like speed.pypy.org > <http://speed.pypy.org/timeline/#/?exe=3,6,1,5&base=2+472&ben=grid&env=1&revs=200&equid=off> > or > the Chrome performance dashboards <https://chromeperf.appspot.com/> would > be very useful. > > On Fri, Jul 8, 2016 at 9:50 AM Holden Karau <[email protected]> wrote: > >> There are also the spark-perf and spark-sql-perf projects in the >> Databricks github (although I see an open issue for Spark 2.0 support in >> one of them). >> >> On Friday, July 8, 2016, Ted Yu <[email protected]> wrote: >> >>> Found a few issues: >>> >>> [SPARK-6810] Performance benchmarks for SparkR >>> [SPARK-2833] performance tests for linear regression >>> [SPARK-15447] Performance test for ALS in Spark 2.0 >>> >>> Haven't found one for Spark core. >>> >>> On Fri, Jul 8, 2016 at 8:58 AM, Michael Allman <[email protected]> >>> wrote: >>> >>>> Hello, >>>> >>>> I've seen a few messages on the mailing list regarding Spark >>>> performance concerns, especially regressions from previous versions. It got >>>> me thinking that perhaps an automated performance regression suite would be >>>> a worthwhile contribution? Is anyone working on this? Do we have a Jira >>>> issue for it? >>>> >>>> I cannot commit to taking charge of such a project. I just thought it >>>> would be a great contribution for someone who does have the time and the >>>> chops to build it. >>>> >>>> Cheers, >>>> >>>> Michael >>>> --------------------------------------------------------------------- >>>> To unsubscribe e-mail: [email protected] >>>> >>>> >>> >> >> -- >> Cell : 425-233-8271 >> Twitter: https://twitter.com/holdenkarau >> >> -- Michael Gummelt Software Engineer Mesosphere
