Re: AutoML Engine

2019-09-10 Thread Lucas Bonatto Miguel
This is really exciting.

I can see you're using autosklearn as the base, which I consider a smart
decision.

The code looks straightforward, which is great. One thing that I noticed in
your branch is that your engine is kind of duplicated, in the
public-engines root folder and also in the
python-toolbox/management/templates folder. I'm not sure I follow the idea
of creating a new engine template specific for automl. I think the engine
template would be the same we have for any kind of engine, with the
difference that the algorithm being used is from an automl package.

Other than that I think some attention to the README on the root of your
public engine would help us and whoever wants to use this engine as a base
to understand your decisions and the specificities of your solution.

Great work, I hope to see an MR for it soon,

Best,
Lucas

On Tue, Sep 10, 2019 at 7:29 PM Daniel Takabayashi <
daniel.takabaya...@gmail.com> wrote:

> Hi Lucas,
>
> Awesome that you guys are trying to bring autoML inside Marvin.
> Could you explain the implementation and tools did you used to get the
> automl solution working inside Marvin?
>
> Thanks,
> Taka
>
> Em ter, 10 de set de 2019 às 13:28, Wei Chen 
> escreveu:
>
> > That's will be nice.
> > I am not able to see your attached images btw.
> >
> > Best Regards
> > Wei
> >
> > On Wed, Sep 11, 2019 at 2:29 AM Lucas Cardoso Silva <
> > cardosolucas61@gmail.com> wrote:
> >
> > > Hi guys.
> > >
> > > We at B2W-UFSCar Lab have been studying AutoML and have developed a
> > > prototype AutoML engine for Marvin, trying to understand it better.
> > >
> > > What do you think about integrating this engine into Marvin? There is
> an
> > > open issue about this:
> > >
> >
> https://issues.apache.org/jira/projects/MARVIN/issues/MARVIN-46?filter=allopenissues
> > >
> > > Here are some print screens to show you the basic idea:
> > >
> > > - marvin1.png: CLI command to create a new AutoML project
> > > - marvin2.png: Dialog to select the desired library to install
> > > - marvin3.png: Notebook running a sample AutoML trainer
> > >
> > > If you want to take a look in the current prototype, it is on a local
> > fork
> > > of GitHub "dev" branch:
> https://github.com/cardosolucas/incubator-marvin
> > >
> > > Iris example engine:
> > >
> >
> https://github.com/cardosolucas/incubator-marvin/tree/develop/public-engines/iris-automl-engine
> > >
> > > Thanks,
> > > Lucas.
> > >
> > >
> > >
> >
>


Re: AutoML Engine

2019-09-10 Thread Lucas Cardoso Silva
Thank you for your interest!
For now we focus only on ease of use for the user, so we have implemented a
setup and configuration script for 3 widely used AutoML tools:
auto-sklearn, H2O and TPOT.
Auto-sklearn is fully functional and we have an example in public engines.
The others presented some problems regarding the model serialization, but
we are already looking for a solution. For future works, we thought it
would be interesting to include autokeras (for deep learning) and to work
with other parts of the pipeline such as data preprocessing, as well as
improving the support and usability of these tools for Marvin users.
I think the mailing list server doesn't allow attachments, so I uploaded
the images to imgur:

https://imgur.com/a/ltEi1XB

Thanks,
Lucas

Em ter, 10 de set de 2019 às 19:29, Daniel Takabayashi <
daniel.takabaya...@gmail.com> escreveu:

> Hi Lucas,
>
> Awesome that you guys are trying to bring autoML inside Marvin.
> Could you explain the implementation and tools did you used to get the
> automl solution working inside Marvin?
>
> Thanks,
> Taka
>
> Em ter, 10 de set de 2019 às 13:28, Wei Chen 
> escreveu:
>
> > That's will be nice.
> > I am not able to see your attached images btw.
> >
> > Best Regards
> > Wei
> >
> > On Wed, Sep 11, 2019 at 2:29 AM Lucas Cardoso Silva <
> > cardosolucas61@gmail.com> wrote:
> >
> > > Hi guys.
> > >
> > > We at B2W-UFSCar Lab have been studying AutoML and have developed a
> > > prototype AutoML engine for Marvin, trying to understand it better.
> > >
> > > What do you think about integrating this engine into Marvin? There is
> an
> > > open issue about this:
> > >
> >
> https://issues.apache.org/jira/projects/MARVIN/issues/MARVIN-46?filter=allopenissues
> > >
> > > Here are some print screens to show you the basic idea:
> > >
> > > - marvin1.png: CLI command to create a new AutoML project
> > > - marvin2.png: Dialog to select the desired library to install
> > > - marvin3.png: Notebook running a sample AutoML trainer
> > >
> > > If you want to take a look in the current prototype, it is on a local
> > fork
> > > of GitHub "dev" branch:
> https://github.com/cardosolucas/incubator-marvin
> > >
> > > Iris example engine:
> > >
> >
> https://github.com/cardosolucas/incubator-marvin/tree/develop/public-engines/iris-automl-engine
> > >
> > > Thanks,
> > > Lucas.
> > >
> > >
> > >
> >
>


Re: AutoML Engine

2019-09-10 Thread Daniel Takabayashi
Hi Lucas,

Awesome that you guys are trying to bring autoML inside Marvin.
Could you explain the implementation and tools did you used to get the
automl solution working inside Marvin?

Thanks,
Taka

Em ter, 10 de set de 2019 às 13:28, Wei Chen  escreveu:

> That's will be nice.
> I am not able to see your attached images btw.
>
> Best Regards
> Wei
>
> On Wed, Sep 11, 2019 at 2:29 AM Lucas Cardoso Silva <
> cardosolucas61@gmail.com> wrote:
>
> > Hi guys.
> >
> > We at B2W-UFSCar Lab have been studying AutoML and have developed a
> > prototype AutoML engine for Marvin, trying to understand it better.
> >
> > What do you think about integrating this engine into Marvin? There is an
> > open issue about this:
> >
> https://issues.apache.org/jira/projects/MARVIN/issues/MARVIN-46?filter=allopenissues
> >
> > Here are some print screens to show you the basic idea:
> >
> > - marvin1.png: CLI command to create a new AutoML project
> > - marvin2.png: Dialog to select the desired library to install
> > - marvin3.png: Notebook running a sample AutoML trainer
> >
> > If you want to take a look in the current prototype, it is on a local
> fork
> > of GitHub "dev" branch: https://github.com/cardosolucas/incubator-marvin
> >
> > Iris example engine:
> >
> https://github.com/cardosolucas/incubator-marvin/tree/develop/public-engines/iris-automl-engine
> >
> > Thanks,
> > Lucas.
> >
> >
> >
>


Re: AutoML Engine

2019-09-10 Thread Wei Chen
That's will be nice.
I am not able to see your attached images btw.

Best Regards
Wei

On Wed, Sep 11, 2019 at 2:29 AM Lucas Cardoso Silva <
cardosolucas61@gmail.com> wrote:

> Hi guys.
>
> We at B2W-UFSCar Lab have been studying AutoML and have developed a
> prototype AutoML engine for Marvin, trying to understand it better.
>
> What do you think about integrating this engine into Marvin? There is an
> open issue about this:
> https://issues.apache.org/jira/projects/MARVIN/issues/MARVIN-46?filter=allopenissues
>
> Here are some print screens to show you the basic idea:
>
> - marvin1.png: CLI command to create a new AutoML project
> - marvin2.png: Dialog to select the desired library to install
> - marvin3.png: Notebook running a sample AutoML trainer
>
> If you want to take a look in the current prototype, it is on a local fork
> of GitHub "dev" branch: https://github.com/cardosolucas/incubator-marvin
>
> Iris example engine:
> https://github.com/cardosolucas/incubator-marvin/tree/develop/public-engines/iris-automl-engine
>
> Thanks,
> Lucas.
>
>
>