Re: AutoML Engine

2019-09-10 Thread Lucas Cardoso Silva
t; That's will be nice. > > I am not able to see your attached images btw. > > > > Best Regards > > Wei > > > > On Wed, Sep 11, 2019 at 2:29 AM Lucas Cardoso Silva < > > cardosolucas61@gmail.com> wrote: > > > > > Hi guys. > >

AutoML Engine

2019-09-10 Thread Lucas Cardoso Silva
Hi guys. We at B2W-UFSCar Lab have been studying AutoML and have developed a prototype AutoML engine for Marvin, trying to understand it better. What do you think about integrating this engine into Marvin? There is an open issue about this:

Marvin Architecture Validation

2019-12-03 Thread Lucas Cardoso Silva
Hi guys, I am considering using Marvin as an artifact for my master's dissertation. The idea is to conduct a formal architectural design and validation process in an Open Source environment. While conducting the process we should produce sufficient documentation to guide developers through the

Re: report

2020-03-04 Thread Lucas Cardoso Silva
Looks fine to me. Regards, Lucas Cardoso Em qua, 4 de mar de 2020 12:20, Zhang Yifei escreveu: > Hello guys, > > We just updated our report at > https://cwiki.apache.org/confluence/display/INCUBATOR/March2020 > Please feel free to suggest any changes. > > Many thanks. > > -- >

Communication between CLI and Docker container in the new architecture.

2020-03-05 Thread Lucas Cardoso Silva
I think we could define better how we will make the communication CLI with the Docker development instance in the new architecture. The container needs a running process to stay active. We could make a communication via API endpoints to keep a web service running on the container receiving

Re: Communication between CLI and Docker container in the new architecture.

2020-04-17 Thread Lucas Cardoso Silva
the clients. What do you think? > > Daniel Lucrédio > > Em seg., 30 de mar. de 2020 às 14:38, Lucas Cardoso Silva < > cardosolucas61@gmail.com> escreveu: > > > What do you think about using the Pyro4 library to maintain the daemon? > The > > license

Re: Communication between CLI and Docker container in the new architecture.

2020-03-13 Thread Lucas Cardoso Silva
> Couldn't the developer just run the CLI from inside the container, > opening > > a shell inside it? > > > > []s > > > > Daniel > > > > Em qui., 5 de mar. de 2020 às 13:31, Lucas Cardoso Silva < > > cardosolucas61@gmail.com> escreveu:

Re: Communication between CLI and Docker container in the new architecture.

2020-03-13 Thread Lucas Cardoso Silva
MRookq5UfTuFkzzU0ugtjvR3rF3deY > > > Em sex., 13 de mar. de 2020 às 11:19, Lucas Cardoso Silva < > cardosolucas61@gmail.com> escreveu: > > > I thought about using a flask application, which can become very fast and > > scalable with a Python WSGI server for produc

Re: Communication between CLI and Docker container in the new architecture.

2020-03-30 Thread Lucas Cardoso Silva
/irmen/Pyro4 Best regards, Lucas Cardoso Em qui., 19 de mar. de 2020 às 16:24, Lucas Cardoso Silva < cardosolucas61@gmail.com> escreveu: > Great! I will do some tests with the "daemon" approach and report any > updates. Thanks! > > Em ter., 17 de mar. de 2020

Re: Daemon gRPC

2020-05-08 Thread Lucas Cardoso Silva
to establish a connection. https://grpc.io/docs/guides/auth/#with-server-authentication-ssltls-4 Em sex., 8 de mai. de 2020 às 02:24, Wei Chen escreveu: > One question, should we include authentication information into the proto > spec? > > On Fri, May 8, 2020 at 10:35 AM Lucas C

Re: Daemon gRPC

2020-05-15 Thread Lucas Cardoso Silva
an issue and MR for it? > > Best, > > On Fri, May 8, 2020 at 9:27 AM Lucas Cardoso Silva < > cardosolucas61@gmail.com> wrote: > > > I believe that we must keep both options. For develop in a controlled > > environment, the insecure server option is easier. B

MR for daemon gRPC code

2020-05-15 Thread Lucas Cardoso Silva
Hello everyone. I created this topic to discuss how we will MR the gRPC daemon code and the new architecture approach. I thought about creating an issue and a new branch for this, since there are many changes in the code and we are not sure if they will be put in the standard development

Re: Communication between CLI and Docker container in the new architecture.

2020-03-19 Thread Lucas Cardoso Silva
> this problem, basically, we need to have a Marvin agent running inside the > container responsible to receive and run the commands from outside. But I > didn't get the part related to Jupyter. > > > Em sex., 13 de mar. de 2020 às 15:15, Lucas Cardoso Silva < > cardosoluca

Daemon gRPC

2020-05-07 Thread Lucas Cardoso Silva
I did a grpc implementation for the daemon, as discussed earlier. I would like to know your opinion about this code. To complete the changes, only a user interface module would be missing, which I can do until the beginning of next week. All unit tests have also been adapted and the daemon has a

Marvin's Community Meeting

2020-09-14 Thread Lucas Cardoso Silva
Hey guys, In another thread we discussed the possibility of a meeting to address some issues that are too complex to be discussed through the mailing list. So I took the initiative to try to organize it. Everyone is invited to speak and watch, but nothing is required. Here are the meeting notes

Re: Septembr Report

2020-09-01 Thread Lucas Cardoso Silva
+1 Em seg., 31 de ago. de 2020 às 12:03, Zhang Yifei escreveu: > Hello guys, > > Here is our report > > https://cwiki.apache.org/confluence/display/INCUBATOR/September2020#marvin-ai > > Please feel free to make any updates. > > > Best regards >

Documentation improvement

2020-10-09 Thread Lucas Cardoso Silva
Hi guys! As discussed in the other threads, we will improve our documentation. I created an issue on ReadTheDocs setup: https://issues.apache.org/jira/projects/MARVIN/issues/MARVIN-76 We need someone with access to the infrastructure to do some of this work. I also made a sketch of a new

Re: Presentation of the architectural proposal

2020-08-26 Thread Lucas Cardoso Silva
used about your e-mail, I couldn't get your point. > > > Could you please be a little more specific? > > > > > > Thanks, > > > Taka > > > > > > Em sáb., 15 de ago. de 2020 às 14:32, Lucas Cardoso Silva < > > > cardosolucas61@gmail

Re: Moving to python 3

2020-08-26 Thread Lucas Cardoso Silva
de 2020 às 14:43, Bruno Sette < > brunosilvase...@gmail.com> > escreveu: > > > +1 > > > > Em qui, 6 de ago de 2020 16:02, Lucas Cardoso Silva < > > cardosolucas61@gmail.com> escreveu: > > > > > I made a pull request to change our component

Re: Marvin’s mission discussion

2020-08-15 Thread Lucas Cardoso Silva
e only thing I would change would be to mention what sort of > > applications. Although we have AI in the name, one may mistakenly think > > Marvin is intended to serve any type of application. > > > > Best > > > > On Fri, Aug 14, 2020 at 11:37 AM Lucas Cardo

Re: Architecture meeting

2020-09-24 Thread Lucas Cardoso Silva
Hello guys, the meeting was interrupted but I believe we were almost finishing anyway. It was a good discussion! My notes: 1. We need to work continuously on the documentation, as it is currently a weak spot. We discussed and more or less agreed on the following: - Let's use ReadTheDocs for the

Re: Marvin's Community Meeting

2020-09-21 Thread Lucas Cardoso Silva
-ijqw-pmh (I have unlimited access on this platform). If you have any questions, please let me know. Thank you :) Best regards, Lucas Cardoso Em seg., 14 de set. de 2020 às 16:57, Lucas Cardoso Silva < cardosolucas61@gmail.com> escreveu: > Hey guys, > > In another thre

Re: Marvin's Community Meeting

2020-09-22 Thread Lucas Cardoso Silva
meeting notes caught my attention. Unfortunately, due to the >>> time zone, I wouldn't be able to join. Could someone collate the meeting >>> notes from the meeting and send it to the group. Would help in >>> contribution. >>> >>> >>> On Tue, 15 Sep,

Re: Cookiecutter for templates and plugins

2020-05-27 Thread Lucas Cardoso Silva
Sure, Iet's make this work. Best regards, Lucas Cardoso Em ter., 26 de mai. de 2020 às 19:43, Zhang Yifei escreveu: > Hello Lucas, > > It looks very interesting, do you have any availability this week? > Let's talk about it. > > Em sex., 22 de mai. de 2020 às 18:44, L

Re: June report

2020-05-28 Thread Lucas Cardoso Silva
Hi Zhang, LGTM. Best regards, Lucas Cardoso Em qui, 28 de mai de 2020 14:15, Zhang Yifei escreveu: > Hello guys, > > Please take a look at our report here > > We need to finish it as soon as possible. > > If anyone has

Cookiecutter for templates and plugins

2020-05-22 Thread Lucas Cardoso Silva
Marvin uses his own code to generate the engines. I would like to propose the use of the Cookiecutter library. It is an interesting approach with several features included that could easily compose a strategy to allow third parties to develop plugins. This would contribute to, for example,

Re: Marvin’s mission discussion

2020-07-29 Thread Lucas Cardoso Silva
expend our capabilities for inference > > scaling > > > and managing. > > > I am not familiar with Luigi, but it makes sense since we are going to > > > setup data pipelines. > > > > > > Best Regards, > > > Wei > > > > >

Engine Unit Tests

2020-07-01 Thread Lucas Cardoso Silva
I have a question about unit testing on the engine. The test are designed to serve as a framework for the user to write their own tests, or they should work as a standard test, which would work for any user code? I particularly believe in the first option, but I would like a better understanding

Marvin’s mission discussion

2020-07-10 Thread Lucas Cardoso Silva
Hello guys. The time has come for us to take the first step in architectural assessment: the definition of the mission. Basically we have to decide here what is important in Marvin and what is outside the scope of the project. This is important because, during this analysis and the development

Architecture Evaluation process on Marvin-AI

2020-07-07 Thread Lucas Cardoso Silva
Hello everyone. I would like to propose a more in-depth analysis of Marvin's architectural proposal and for that I need your help. The idea isn’t to change the proposal, but to identify architectural approaches and describe scenarios around different contexts of use. This is part of my M.Sc.

Re: Cookiecutter for templates and plugins

2020-06-04 Thread Lucas Cardoso Silva
guys ended up making progress in it? Is there > an > > issue for us to follow and participate? > > > > - Lucas > > > > On Wed, May 27, 2020 at 2:07 PM Lucas Cardoso Silva < > > cardosolucas61@gmail.com> wrote: > > > > > Sure, Iet's make

Re: Marvin’s mission discussion

2020-07-28 Thread Lucas Cardoso Silva
r if we should cut the data preparation stage out for the user to make > their own data pipeline on their data storage. > I figured that preprocessing might be too complex to be generalized for > different ML projects. > > Best Regards > Wei > > > > On Thu, Jul 23, 2020 at

Re: Marvin’s mission discussion

2020-07-22 Thread Lucas Cardoso Silva
is always welcome! Best regards, Lucas Cardoso Em sex., 10 de jul. de 2020 às 13:48, Lucas Cardoso Silva < cardosolucas61@gmail.com> escreveu: > Hello guys. The time has come for us to take the first step in > architectural assessment: the definition of the mission. Basically we have

Re: Marvin’s mission discussion

2020-08-14 Thread Lucas Cardoso Silva
and a standardized pipeline. Thanks for the help, Lucas Cardoso Em qua., 29 de jul. de 2020 às 17:05, Lucas Cardoso Silva < cardosolucas61@gmail.com> escreveu: > Hi guys! > Great Lucas, I will wait a couple of days to see if anyone has other > things to add, and then we can close this

Re: December report

2020-12-01 Thread Lucas Cardoso Silva
+1 Em ter., 1 de dez. de 2020 às 16:34, Zhang Yifei escreveu: > Hello guys, > > Here is our report > > https://cwiki.apache.org/confluence/display/INCUBATOR/December2020#marvin-ai > > please feel free to make any changes. > > > Regards >

Re: [DISCUSS] About ReadTheDocs integration

2020-10-30 Thread Lucas Cardoso Silva
In any case, if we are not allowed to do it, we can compile the source files that we already made using Sphinx. This will generate html files in a ReadTheDocs-like format. A example of a Apache software documentation made this way: https://usergrid.apache.org/docs/ Best regards, Lucas Cardoso Em

Re: Did you saw that?

2020-10-28 Thread Lucas Cardoso Silva
This is very interesting! In our architecture meeting we discussed a lot of possibilities to keep the architecture change on Marvin. Integrate with TFX and data acquisition with beam were some of them. Studying TFX orchestration on Kubeflow I saw that we could use KFP and other Kubeflow features

TFX RFC and how to proceed with it

2021-01-13 Thread Lucas Cardoso Silva
Hi guys! I wrote an RFC containing an implementation of an integration between the Tensorflow Extended framework and Marvin, as foreseen in our architectural meeting. I would like everyone to participate by giving suggestions of modifications and even better solutions that the proposal offers.

Re: June Report

2021-06-09 Thread Lucas Cardoso Silva
+1 On Thu, Jun 3, 2021 at 2:43 PM Zhang Yifei wrote: > Hello guys, > > Here is our initial version of the report: > https://cwiki.apache.org/confluence/display/INCUBATOR/June2021#marvin-ai > > Please feel free to add anything. > > > Best regards > > Yifei Zhang >

Re: Repeating report

2021-03-31 Thread Lucas Cardoso Silva
+1 On Mon, Mar 29, 2021 at 4:35 PM Zhang Yifei wrote: > Hello guys, > > Since our March report did not have signoff by mentors, > we had to send the same report again for April. > > Here is our report : > https://cwiki.apache.org/confluence/display/INCUBATOR/April2021#marvin-ai > > Thanks. > >

Feedback on Architecture Evaluation

2021-03-31 Thread Lucas Cardoso Silva
some questions about some use case scenarios on Apache Marvin-AI. Thanks in advance for your help! Lucas Cardoso Silva

Architecture Meeting

2021-03-10 Thread Lucas Cardoso Silva
Hey guys, In another thread we discussed the possibility of a meeting to address some architecture issues, like the last time. So let's organize it. Everyone is invited to speak and watch, but nothing is required. Here are the meeting notes (

Re: Apache Marvin-AI Meeting

2021-03-16 Thread Lucas Cardoso Silva
BEGIN:VCALENDAR VERSION:2.0 PRODID:-//ical.marudot.com//iCal Event Maker CALSCALE:GREGORIAN BEGIN:VTIMEZONE TZID:America/Sao_Paulo TZURL:http://tzurl.org/zoneinfo-outlook/America/Sao_Paulo X-LIC-LOCATION:America/Sao_Paulo BEGIN:DAYLIGHT TZOFFSETFROM:-0300 TZOFFSETTO:-0200 TZNAME:-02

Architecture meeting

2021-02-26 Thread Lucas Cardoso Silva
Hey guys, hope you're doing well! In the next few days I'll do some PRs regarding the implementation of some features discussed in the other meeting. I would like to propose another meeting next month to discuss these features. I think it is a quick way to discuss the design decisions. Do you guys

Commiter status

2021-09-09 Thread Lucas Cardoso Silva
are going to discuss with all the community some new features and ideas to make the project up and running again, and new guys and girls are coming. Thanks in advance, Lucas Cardoso Silva

December report

2021-11-29 Thread Lucas Cardoso Silva
Hey folks! Please take a look at this month's report: https://cwiki.apache.org/confluence/display/INCUBATOR/December2021#marvin-ai If you guys have any questions, additions or corrections please feel free to point or edit! Best regards, Lucas Cardoso

Re: Request for vision review

2021-11-04 Thread Lucas Cardoso Silva
+1 I think it's a good plan to discuss these changes. On Thu, Nov 4, 2021 at 6:03 PM Lucas Bonatto Miguel wrote: > Hi, > > As the current version of Marvin is not getting enough traction in both > usage and development, some action needs to be taken. After discussing with > a few stakeholders,

Re: New Marvin Release (0.0.6)

2022-02-24 Thread Lucas Cardoso Silva
wrote: > On Wed, Feb 23, 2022 at 12:08 PM Lucas Cardoso Silva < > cardosolucas61@gmail.com> wrote: > > > Hi guys, how are you? Since we are preparing a new release for Marvin, > I'm > > writing this to let you know that I'll start to work to publish this new

New Marvin Release (0.0.6)

2022-02-23 Thread Lucas Cardoso Silva
Hi guys, how are you? Since we are preparing a new release for Marvin, I'm writing this to let you know that I'll start to work to publish this new version. Does anyone have anything to suggest or an impediment of any kind? I'd also like to know if Apache has a guide on releasing versions on Pypi

Re: [ISSUE] MARVIN issue posted on jira

2022-07-12 Thread Lucas Cardoso Silva
Welcome to the community Daniel! I'll take a look at this issue and get back here soon. On Mon, Jul 4, 2022 at 7:15 PM Daniel Lombardi wrote: > Hello Marvin Team, > > Last week, while testing marvin development branch, I found a bug regarding > the generation and updating of the scripts inside

Marvin Report

2022-05-10 Thread Lucas Cardoso Silva
I made a draft of our may/22 report: https://cwiki.apache.org/confluence/display/INCUBATOR/May2022#marvin-ai Please feel free to add anything that may seem necessary. Best regards, Lucas Cardoso Silva

Design proposal draft finished

2022-05-10 Thread Lucas Cardoso Silva
architecture given the latest developments in the MLOps area. Discussions and changes, including in core concepts of the proposal, are very welcome. Link to the draft: https://www.notion.so/WIP-RFC-Scope-Revamp-9cff5b9633094e9f9cc32e92edce145f Best regards, Lucas Cardoso Silva

Re: Missing PPMC and lack of activity on this project

2022-10-27 Thread Lucas Cardoso Silva
Hi everyone, It is indeed hard to keep up with development and community tasks with such low community engagement. I'll follow the community decision on this issue, especially PPMC members. Best regards, Lucas Cardoso On Wed, Oct 26, 2022 at 9:05 PM Justin Mclean wrote: > Hi, > The Incubator