Yes, it would be perfect. Do you have any work planned or schedule on this
problem? Let me know if there is something I could help with.
Thanks,
Karol
2013/11/8 Vlad Niculae <zephy...@gmail.com>
> It should be written in such a way so that you can add more benchmarks
> with a PR to that repo (the master branch) and it should "just work".
> Many parts of the framework are still hackish though.
>
> Yours,
> Vlad
>
> On Fri, Nov 8, 2013 at 7:53 PM, Karol Pysniak <kpysn...@gmail.com> wrote:
> > Awesome, thanks Vlad, that's exactly what I've been looking for!
> >
> > Thanks,
> > Karol
> >
> >
> > 2013/11/8 Vlad Niculae <zephy...@gmail.com>
> >>
> >> We have an instance of vbench continuously running [1] that I did as a
> >> GSoC project last year.
> >>
> >> For some reason it seems that the links don't generate properly now,
> >> but it still works (though all data got lost in a jenkins setup
> >> incident this summer).
> >>
> >> Here are some linear model benchmarks for example [2]
> >>
> >> Until I fix the bug you can get the data from the github repo [3]
> >>
> >> Yours,
> >> Vlad
> >>
> >>
> >> [1] http://scikit-learn.github.io/scikit-learn-speed
> >> [2]
> http://scikit-learn.github.io/scikit-learn-speed/vb_linear_model.html
> >> [3] https://github.com/scikit-learn/scikit-learn-speed
> >>
> >> On Fri, Nov 8, 2013 at 7:33 PM, Skipper Seabold <jsseab...@gmail.com>
> >> wrote:
> >> > On Fri, Nov 8, 2013 at 6:30 PM, Karol Pysniak <kpysn...@gmail.com>
> >> > wrote:
> >> >> Hi All,
> >> >>
> >> >> Has there any been discussion on adding some automated benchmarks for
> >> >> both
> >> >> speed and accuracy of the algorithms we have? I think it would very
> >> >> interesting if such a script could be automatically executed after
> >> >> every
> >> >> commit so that we could follow the performance of scikit-learn or, at
> >> >> least,
> >> >> have such a script generally available on local machines. What do you
> >> >> think
> >> >> about this? There are already benchmark scripts, but it's quite hard
> to
> >> >> compare the impact of commits on the library.
> >> >>
> >> >> Would there be an interest in such a tool?
> >> >>
> >> >
> >> > For speed: https://github.com/pydata/vbench
> >> >
> >> > Skipper
> >> >
> >> >
> >> >
> ------------------------------------------------------------------------------
> >> > November Webinars for C, C++, Fortran Developers
> >> > Accelerate application performance with scalable programming models.
> >> > Explore
> >> > techniques for threading, error checking, porting, and tuning. Get the
> >> > most
> >> > from the latest Intel processors and coprocessors. See abstracts and
> >> > register
> >> >
> >> >
> http://pubads.g.doubleclick.net/gampad/clk?id=60136231&iu=/4140/ostg.clktrk
> >> > _______________________________________________
> >> > Scikit-learn-general mailing list
> >> > Scikit-learn-general@lists.sourceforge.net
> >> > https://lists.sourceforge.net/lists/listinfo/scikit-learn-general
> >>
> >>
> >>
> ------------------------------------------------------------------------------
> >> November Webinars for C, C++, Fortran Developers
> >> Accelerate application performance with scalable programming models.
> >> Explore
> >> techniques for threading, error checking, porting, and tuning. Get the
> >> most
> >> from the latest Intel processors and coprocessors. See abstracts and
> >> register
> >>
> >>
> http://pubads.g.doubleclick.net/gampad/clk?id=60136231&iu=/4140/ostg.clktrk
> >> _______________________________________________
> >> Scikit-learn-general mailing list
> >> Scikit-learn-general@lists.sourceforge.net
> >> https://lists.sourceforge.net/lists/listinfo/scikit-learn-general
> >
> >
> >
> >
> ------------------------------------------------------------------------------
> > November Webinars for C, C++, Fortran Developers
> > Accelerate application performance with scalable programming models.
> Explore
> > techniques for threading, error checking, porting, and tuning. Get the
> most
> > from the latest Intel processors and coprocessors. See abstracts and
> > register
> >
> http://pubads.g.doubleclick.net/gampad/clk?id=60136231&iu=/4140/ostg.clktrk
> > _______________________________________________
> > Scikit-learn-general mailing list
> > Scikit-learn-general@lists.sourceforge.net
> > https://lists.sourceforge.net/lists/listinfo/scikit-learn-general
> >
>
>
> ------------------------------------------------------------------------------
> November Webinars for C, C++, Fortran Developers
> Accelerate application performance with scalable programming models.
> Explore
> techniques for threading, error checking, porting, and tuning. Get the most
> from the latest Intel processors and coprocessors. See abstracts and
> register
> http://pubads.g.doubleclick.net/gampad/clk?id=60136231&iu=/4140/ostg.clktrk
> _______________________________________________
> Scikit-learn-general mailing list
> Scikit-learn-general@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/scikit-learn-general
>
------------------------------------------------------------------------------
November Webinars for C, C++, Fortran Developers
Accelerate application performance with scalable programming models. Explore
techniques for threading, error checking, porting, and tuning. Get the most
from the latest Intel processors and coprocessors. See abstracts and register
http://pubads.g.doubleclick.net/gampad/clk?id=60136231&iu=/4140/ostg.clktrk
_______________________________________________
Scikit-learn-general mailing list
Scikit-learn-general@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/scikit-learn-general
