I agree with Rohit, if people want to improve mavin ux that’s fine, but keep it a Marvin thing.
- Marvin outputs a file that says what passed and what failed. - A GUI is going to need constant ongoing maintenance for it to be able to understand tests to give meaningful additional information on tests or add any appreciable value. - It's never going to be able to actually diagnose failures - so you're going to have to read logs anyway. So in summary, the cons seem to heavily outweigh the pros to me. Maybe a very simple TUI which generates the string which is ultimately run might help people. A way to generate the file that describes the configuration of zone(s) that Marvin will be run against might be more helpful. -----Original Message----- From: Wei ZHOU <ustcweiz...@gmail.com> Sent: 30 March 2021 15:51 To: dev@cloudstack.apache.org Subject: Re: [DISCUSS] Marvin tests interaction Can it be a standalone tool with ui ? -Wei On Tue, 30 Mar 2021 at 16:45, Nicolas Vazquez <nicolas.vazq...@shapeblue.com> wrote: > The idea is not to rewrite the tests in Java but to improve how we > interact with the tests and display results. The new service/agent > should not be responsible for testing but to invoke the execution of > the requested tests. This new service, lets say for example 'marvin > agent' will simply receive which tests are needed to run and invoke > them the same way as before. Then, it could use the information in the > logs for individual tests to retrieve back the results to the > management server. I imagine it could work similarly to the VR healths > checks functionality > > > Regards, > > Nicolas Vazquez > > ________________________________ > From: Rohit Yadav <rohit.ya...@shapeblue.com> > Sent: Tuesday, March 30, 2021 6:17 AM > To: dev@cloudstack.apache.org <dev@cloudstack.apache.org> > Subject: Re: [DISCUSS] Marvin tests interaction > > Sorry all, I don't agree - the thing being tested shouldn't be > responsible for testing (unless it's a well-defined limited set of > self-testing features, for example a set of sanity/intergrity checks). > > Unless we're saying the service/feature is used to run tests for other > (nested?) CloudStack environments. The other issue is (and unless the > idea is to re-write tests in Java) most tests are written in Python, > so the CloudStack plugin/service would still fork and need to run > Python tests somehow (directly or via a runner such as nose) or > explore use of Jython or Python on JVM (which may make it complex). > > > Regards. > > ________________________________ > From: Suresh Anaparti <suresh.anapa...@shapeblue.com> > Sent: Tuesday, March 30, 2021 11:23 > To: dev@cloudstack.apache.org <dev@cloudstack.apache.org> > Subject: Re: [DISCUSS] Marvin tests interaction > > +1, added my thoughts in the ticket. This can ease/reduce the Dev & QA > testing efforts. Also, it's good to see the testing results in the UI > itself. > > Regards, > Suresh > > On 30/03/21, 9:41 AM, "David Jumani" <david.jum...@shapeblue.com> wrote: > > +1 on the idea and on Rakesh's suggestions! > ________________________________ > From: Rakesh v <www.rakeshv....@gmail.com< > http://www.rakeshv....@gmail.com<http://www.rakeshv....@gmail.com< > http://www.rakeshv....@gmail.com>>> > Sent: Monday, March 29, 2021 11:50 PM > To: dev@cloudstack.apache.org <dev@cloudstack.apache.org> > Subject: Re: [DISCUSS] Marvin tests interaction > > I have added my thoughts in the issue link. Hope that's useful to you. > > Sent from my iPhone > > > david.jum...@shapeblue.com > www.shapeblue.com<http://www.shapeblue.com> > 3 London Bridge Street, 3rd floor, News Building, London SE1 9SGUK > @shapeblue > > > > > suresh.anapa...@shapeblue.com > www.shapeblue.com<http://www.shapeblue.com> > 3 London Bridge Street, 3rd floor, News Building, London SE1 9SGUK > @shapeblue > > > > > rohit.ya...@shapeblue.com > www.shapeblue.com<http://www.shapeblue.com> > 3 London Bridge Street, 3rd floor, News Building, London SE1 9SGUK > @shapeblue > > > > > nicolas.vazq...@shapeblue.com > www.shapeblue.com > 3 London Bridge Street, 3rd floor, News Building, London SE1 9SGUK > @shapeblue > > > > > On Mar 29, 2021, at 4:51 AM, Nicolas Vazquez < > nicolas.vazq...@shapeblue.com> wrote: > > > > Hi, > > > > I would like to propose an idea to improve the interaction with > the marvin tests through the management server. This could be useful > for development and test environments in which tests could be easily > started, configured and their results monitored through the UI. > > > > This could be achieved by creating a new service in charge of > the execution of the tests and sending results back to the management > server, so it can display them. A more detailed description: > https://github.com/apache/cloudstack/issues/4799 > > > > I would like to hear your thoughts and ideas about it. Would you > find this useful? > > > > > > Regards, > > > > Nicolas Vazquez > > > > nicolas.vazq...@shapeblue.com > > www.shapeblue.com<http://www.shapeblue.com> > > 3 London Bridge Street, 3rd floor, News Building, London SE1 9SGUK > > @shapeblue > > > > > > > >
