Re: Contribution request for 'Sparky'
Hello Alexey, Happy New Year! On 26/12/2025 12:09, Alexey Melezhik wrote: Hey, Roland! Did you manage to check the demo out? Yes, I've looked at it. I'm wondering what Sparky can do that either openQA or autopkgtest cannot do... Also I noticed in [1] that it mentions Ubuntu, not Debian, so I'm confused _what_ is tested. See for an extensive example of console-based testing one of the openSUSE tests [2]. The Debian tests on openQA are currently all GUI-based, but it might be that in some future there will also be console-based tests, depending on the use case. So my previous question still stands: > Can you provide a comparison chart to compare your tool with e.g. > openQA, autopkgtest, ...? With kind regards, Roland Clobus [1] https://sparky.sparrowhub.io/report/debian-demo/27809#Report/ [2] https://openqa.opensuse.org/tests/5500924 OpenPGP_signature.asc Description: OpenPGP digital signature
Re: Contribution request for 'Sparky'
Hey, Roland! Did you manage to check the demo out? On Wed, Dec 24, 2025 at 11:16 AM Roland Clobus wrote: > Hello Alexey, > > On 23/12/2025 18:56, Alexey Melezhik wrote: > > Ok, the idea is to adopt something similar to Debian - > > https://git.resf.org/testing/Sparky_Getting_Started > git.resf.org/testing/Sparky_Getting_Started> > > It looks a bit like the functionality that is present in autopkgtest: > running commands and verifying their output. > Note that openQA is targeting graphical tests (although SUSE has an > impressive amount of tests running purely on the console). > > Can you provide a comparison chart to compare your tool with e.g. > openQA, autopkgtest, ...? > > Do you have a server where the tool can be seen live? > > With kind regards, > Roland Clobus >
Re: Contribution request for 'Sparky'
Once you run a test in report page artifacts tab you will get OS release information attached On Wed, Dec 24, 2025 at 4:28 PM Alexey Melezhik wrote: > Hi Roland. Ok here is a demo server - > https://sparky.sparrowhub.io/project/debian-demo > > It has 3 tests scenarios for Ubuntu / Debian: > > - Python-ssl - checks that ssl lib is installed and TLS is of required > version and python3 TLS binding works > > - Redis - installs and checks redis, including authentication > configuration > > -NSD - installs bind9 server and check its example configuration using > host and dig commands > > I removed some interesting features here like installing Linux from qemu > image or container , etc - for demonstration purpose only and to have focus > on the concept > > Please let me what you think > > > Source code for scenarios could be found here - > https://github.com/melezhik/ci.sparrowhub/tree/master/projects/debian-demo > > Tests written on Bash and Python , but many other languages could be used > . Tests resides under tasks/ directory . Other files - are Sparky main > scenario and configuration ( written on Raku/YAML ) > > > To run demo please use these credentials: > > Login - debian > Password - debian > > They are limited to this project only > > > > > On Wed, Dec 24, 2025 at 11:16 AM Roland Clobus wrote: > >> Hello Alexey, >> >> On 23/12/2025 18:56, Alexey Melezhik wrote: >> > Ok, the idea is to adopt something similar to Debian - >> > https://git.resf.org/testing/Sparky_Getting_Started > > git.resf.org/testing/Sparky_Getting_Started> >> >> It looks a bit like the functionality that is present in autopkgtest: >> running commands and verifying their output. >> Note that openQA is targeting graphical tests (although SUSE has an >> impressive amount of tests running purely on the console). >> >> Can you provide a comparison chart to compare your tool with e.g. >> openQA, autopkgtest, ...? >> >> Do you have a server where the tool can be seen live? >> >> With kind regards, >> Roland Clobus >> >
Re: Contribution request for 'Sparky'
Hi Roland. Ok here is a demo server - https://sparky.sparrowhub.io/project/debian-demo It has 3 tests scenarios for Ubuntu / Debian: - Python-ssl - checks that ssl lib is installed and TLS is of required version and python3 TLS binding works - Redis - installs and checks redis, including authentication configuration -NSD - installs bind9 server and check its example configuration using host and dig commands I removed some interesting features here like installing Linux from qemu image or container , etc - for demonstration purpose only and to have focus on the concept Please let me what you think Source code for scenarios could be found here - https://github.com/melezhik/ci.sparrowhub/tree/master/projects/debian-demo Tests written on Bash and Python , but many other languages could be used . Tests resides under tasks/ directory . Other files - are Sparky main scenario and configuration ( written on Raku/YAML ) To run demo please use these credentials: Login - debian Password - debian They are limited to this project only On Wed, Dec 24, 2025 at 11:16 AM Roland Clobus wrote: > Hello Alexey, > > On 23/12/2025 18:56, Alexey Melezhik wrote: > > Ok, the idea is to adopt something similar to Debian - > > https://git.resf.org/testing/Sparky_Getting_Started > git.resf.org/testing/Sparky_Getting_Started> > > It looks a bit like the functionality that is present in autopkgtest: > running commands and verifying their output. > Note that openQA is targeting graphical tests (although SUSE has an > impressive amount of tests running purely on the console). > > Can you provide a comparison chart to compare your tool with e.g. > openQA, autopkgtest, ...? > > Do you have a server where the tool can be seen live? > > With kind regards, > Roland Clobus >
Re: Contribution request for 'Sparky'
Ok , I have skimmed through the autopkgtest, looks like this is more embedded into a package unit test thing , while sparky is more like integrated testing with more general approach, closer to end to end testing , once a demo server is ready you will be able to see it On Wed, Dec 24, 2025 at 11:16 AM Roland Clobus wrote: > Hello Alexey, > > On 23/12/2025 18:56, Alexey Melezhik wrote: > > Ok, the idea is to adopt something similar to Debian - > > https://git.resf.org/testing/Sparky_Getting_Started > git.resf.org/testing/Sparky_Getting_Started> > > It looks a bit like the functionality that is present in autopkgtest: > running commands and verifying their output. > Note that openQA is targeting graphical tests (although SUSE has an > impressive amount of tests running purely on the console). > > Can you provide a comparison chart to compare your tool with e.g. > openQA, autopkgtest, ...? > > Do you have a server where the tool can be seen live? > > With kind regards, > Roland Clobus >
Re: Contribution request for 'Sparky'
Hey, Roland! i don’t have a comparison charts , I am going to spin up a quick demo so you can play with it In two words. Yes This is about launching a command and analyzing output , but Sparky is more then that , I will look at autopkgtest and try to provide some comparison though Thanks On Wed, Dec 24, 2025 at 11:16 AM Roland Clobus wrote: > Hello Alexey, > > On 23/12/2025 18:56, Alexey Melezhik wrote: > > Ok, the idea is to adopt something similar to Debian - > > https://git.resf.org/testing/Sparky_Getting_Started > git.resf.org/testing/Sparky_Getting_Started> > > It looks a bit like the functionality that is present in autopkgtest: > running commands and verifying their output. > Note that openQA is targeting graphical tests (although SUSE has an > impressive amount of tests running purely on the console). > > Can you provide a comparison chart to compare your tool with e.g. > openQA, autopkgtest, ...? > > Do you have a server where the tool can be seen live? > > With kind regards, > Roland Clobus >
Re: Contribution request for 'Sparky'
Hello Alexey, On 23/12/2025 18:56, Alexey Melezhik wrote: Ok, the idea is to adopt something similar to Debian - https://git.resf.org/testing/Sparky_Getting_Started git.resf.org/testing/Sparky_Getting_Started> It looks a bit like the functionality that is present in autopkgtest: running commands and verifying their output. Note that openQA is targeting graphical tests (although SUSE has an impressive amount of tests running purely on the console). Can you provide a comparison chart to compare your tool with e.g. openQA, autopkgtest, ...? Do you have a server where the tool can be seen live? With kind regards, Roland Clobus OpenPGP_signature.asc Description: OpenPGP digital signature
