Re: [libvirt PATCH 0/7] docs: ci: Update the CI pages with fresh contents

2023-10-10 Thread Erik Skultety
On Tue, Oct 03, 2023 at 02:56:37PM +0200, Erik Skultety wrote: > On Wed, Sep 27, 2023 at 08:53:41PM +0200, Erik Skultety wrote: > > While we have already descriptive articles on our GitLab CI, there's > > recently > > been some work on the CI front where a few sec

Re: [libvirt PATCH 0/7] docs: ci: Update the CI pages with fresh contents

2023-10-03 Thread Erik Skultety
On Wed, Sep 27, 2023 at 08:53:41PM +0200, Erik Skultety wrote: > While we have already descriptive articles on our GitLab CI, there's recently > been some work on the CI front where a few sections deserve some updates. > > Erik Skultety (7): > docs: ci-runners: Add a

[libvirt PATCH 0/7] docs: ci: Update the CI pages with fresh contents

2023-09-27 Thread Erik Skultety
While we have already descriptive articles on our GitLab CI, there's recently been some work on the CI front where a few sections deserve some updates. Erik Skultety (7): docs: ci-runners: Add a note on a new runner registration process docs: ci: Update the description on the integrati

[libvirt PATCH 3/7] docs: testtck: Tweak the Avocado command to run TCK test suite

2023-09-27 Thread Erik Skultety
While we may have needed to run TCK through Avocado by explicitly using the '--tap' option (still possible), we can get a nice output from Avocado by default leaving the option out which is exactly what we do inside GitLab CI environment. Signed-off-by: Erik Skultety --- docs/testt

[libvirt PATCH 7/7] docs: testtck: Expand the 'Run TCK' section on making use of ci/jobs.sh

2023-09-27 Thread Erik Skultety
onment the same way as we do in GitLab CI or execute everything manually. This patch takes the opportunity to also link to the virtiofs kbase article to give users a different option to get the local libvirt repositories to be used in testing inside a VM. Signed-off-by: Erik Skultety --- docs/t

[libvirt PATCH 2/7] docs: ci: Update the description on the integration CI GitLab variables

2023-09-27 Thread Erik Skultety
This patch mainly fixes an unfinished sentence that was supposed to describe the LIBVIRT_CI_INTEGRATION_RUNNER_TAG variable, but took the opportunity to update the description of the other variable too. Signed-off-by: Erik Skultety --- docs/ci.rst | 8 ++-- 1 file changed, 6 insertions

[libvirt PATCH 4/7] docs: testtck: Improve the documentation on how to get a VM from lcitool

2023-09-27 Thread Erik Skultety
arget from Fedora 36 -> 38. Signed-off-by: Erik Skultety --- docs/testtck.rst | 23 +-- 1 file changed, 17 insertions(+), 6 deletions(-) diff --git a/docs/testtck.rst b/docs/testtck.rst index d7f5483b5f..89760e3f63 100644 --- a/docs/testtck.rst +++ b/docs/testtck.rst @

[libvirt PATCH 1/7] docs: ci-runners: Add a note on a new runner registration process

2023-09-27 Thread Erik Skultety
The documented process should be updated to reflect the new process once GitLab transitions to it completely and drops the old process involving registration tokens as hinted by the note. Signed-off-by: Erik Skultety --- docs/ci-runners.rst | 10 ++ 1 file changed, 10 insertions

[libvirt PATCH 5/7] docs: testing: Adjust the docs on how to run container workloads locally

2023-09-27 Thread Erik Skultety
functionality which only allowed builds, tests and shell (although important to say it could be adjusted with the right meson/ninja args). lcitool also became mandatory as it enables the container execution which replaced a Makefile we used to have for this purpose. Signed-off-by: Erik Skultety

[libvirt PATCH 6/7] docs: testtck: Add a clear note on libvirt + Perl bindings dependency

2023-09-27 Thread Erik Skultety
sers don't feel like building everything on their own. Signed-off-by: Erik Skultety --- docs/testtck.rst | 6 ++ 1 file changed, 6 insertions(+) diff --git a/docs/testtck.rst b/docs/testtck.rst index 89760e3f63..f57af61aa8 100644 --- a/docs/testtck.rst +++ b/docs/testtck.rst @@ -73,6

Re: [libvirt PATCH] gitpublish: Add suppresscc option

2023-09-27 Thread Erik Skultety
On Tue, Sep 19, 2023 at 11:34:19AM +0200, Erik Skultety wrote: > send-email scans the commit messages to figure out the default set of > addresses to put into CC, Acked-by/Reviewed-by, etc-by being among > them. We're quite strict about CC-ing people on libvirt-list, since > mo

[libvirt PATCH] gitpublish: Add suppresscc option

2023-09-19 Thread Erik Skultety
eople solely based on the fact that they've done review of any of previous revisions. Signed-off-by: Erik Skultety --- I noticed this issue when sending https://listman.redhat.com/archives/libvir-list/2023-September/242173.html and publish automatically included Dan. I guess I could have

[libvirt PATCH v3 05/12] ci: jobs.sh: Drop comment about the need for Avocado 98.0

2023-09-19 Thread Erik Skultety
suite sequentially leading to test stability issues, so abandoning the v98.0 in commit 91774931 was a good thing in the end. Signed-off-by: Erik Skultety Reviewed-by: Daniel P. Berrangé --- ci/jobs.sh | 1 - 1 file changed, 1 deletion(-) diff --git a/ci/jobs.sh b/ci/jobs.sh index adb798d127

[libvirt PATCH v3 10/12] ci: jobs.sh: integration: Execute commands via 'run_cmd[_quiet]' helpers

2023-09-19 Thread Erik Skultety
rint some important values for debugging purposes. Signed-off-by: Erik Skultety --- ci/jobs.sh | 26 +- 1 file changed, 13 insertions(+), 13 deletions(-) diff --git a/ci/jobs.sh b/ci/jobs.sh index 8ae3b87228..861e561039 100644 --- a/ci/jobs.sh +++ b/ci/jobs.sh @@ -87,

[libvirt PATCH v3 03/12] ci: integration: Adjust the check for CentOS Stream version

2023-09-19 Thread Erik Skultety
All supported versions of Fedora and CentOS Stream 9 default to modular setup, it's probably better if we cosmetically adjust the CentOS Stream version check to make it explicit that monolithic daemon services ought to be started only on Stream 8. Signed-off-by: Erik Skultety Reviewed-by: D

[libvirt PATCH v3 08/12] ci: jobs.sh: run_integration: Make POSIX-compliant

2023-09-19 Thread Erik Skultety
Neither '&>' nor 'source' are defined in POSIX. Signed-off-by: Erik Skultety Reviewed-by: Daniel P. Berrangé --- ci/jobs.sh | 8 1 file changed, 4 insertions(+), 4 deletions(-) diff --git a/ci/jobs.sh b/ci/jobs.sh index 37bca452fa..b52e45cc8c 100644 --- a/

[libvirt PATCH v3 12/12] ci: jobs.sh: Define and create SCRATCH_DIR for local executions

2023-09-19 Thread Erik Skultety
nvironment for the job every time run_integration function is run. For repeated interactive use case, it is imperative that the developer takes care of their environment. Signed-off-by: Erik Skultety Reviewed-by: Daniel P. Berrangé --- ci/jobs.sh | 7 +++ 1 file changed, 7 insertions(+) diff

[libvirt PATCH v3 06/12] ci: jobs.sh: integration: Use --quiet with virsh

2023-09-19 Thread Erik Skultety
We've not been interested in any extra output from the command at all since we always redirected both stdout and stderr to /dev/null. Future patch will change that slightly, so --quiet will start making sense. Signed-off-by: Erik Skultety Reviewed-by: Daniel P. Berrangé --- ci/jobs.s

[libvirt PATCH v3 09/12] ci: jobs.sh: Introduce a quiet version of run_cmd

2023-09-19 Thread Erik Skultety
applied at parameter passing to run_cmd it's going to be applied to the debug print as well. Let's introduce another helper, run_cmd_quiet which takes care of the I/O redirection and executes the command completely silently. Signed-off-by: Erik Skultety --- ci/jobs.sh | 5 + 1 file c

[libvirt PATCH v3 04/12] ci: integration: Drop the 'install-deps' hidden job and reference

2023-09-19 Thread Erik Skultety
Since the section now only consists of a single command, we can happily move the command to the main integration template job body. Signed-off-by: Erik Skultety Reviewed-by: Daniel P. Berrangé --- ci/integration-template.yml | 6 +- 1 file changed, 1 insertion(+), 5 deletions(-) diff

[libvirt PATCH v3 11/12] ci: jobs.sh: run_integration: Print DAEMONS variable for debugging

2023-09-19 Thread Erik Skultety
EMONS variable that we set depending on the distro we execute the tests on. Signed-off-by: Erik Skultety Reviewed-by: Daniel P. Berrangé --- ci/jobs.sh | 2 ++ 1 file changed, 2 insertions(+) diff --git a/ci/jobs.sh b/ci/jobs.sh index 861e561039..2e6888232f 100644 --- a/ci/jobs.sh +++ b/ci/jo

[libvirt PATCH v3 00/12] Extract the integration job commands to a shell script

2023-09-19 Thread Erik Skultety
es to the vendor locking of Avocado to v98.0 in the past Erik Skultety (12): syntax-check: Drop the shell's 'check for minus' rule ci: integration: Extract the integration CI main recipe to jobs.sh ci: integration: Adjust the check for CentOS Stream version ci: integration: Dr

[libvirt PATCH v3 07/12] ci: jobs.sh: run_integration: Add/Rewrite/Reformat commentaries

2023-09-19 Thread Erik Skultety
f-by: Erik Skultety Reviewed-by: Daniel P. Berrangé --- ci/jobs.sh | 15 --- 1 file changed, 12 insertions(+), 3 deletions(-) diff --git a/ci/jobs.sh b/ci/jobs.sh index 75ea638580..37bca452fa 100644 --- a/ci/jobs.sh +++ b/ci/jobs.sh @@ -84,10 +84,14 @@ run_website_b

[libvirt PATCH v3 01/12] syntax-check: Drop the shell's 'check for minus' rule

2023-09-19 Thread Erik Skultety
SI Applications shall not use obsolescent features." It is however unlikely that the shell implementations would drop support for -[ao] despite POSIX potentially removing them. Signed-off-by: Erik Skultety Reviewed-by: Daniel P. Berrangé --- build-aux/syntax-check.mk | 9 - 1 file

[libvirt PATCH v3 02/12] ci: integration: Extract the integration CI main recipe to jobs.sh

2023-09-19 Thread Erik Skultety
Follow what's been done to other jobs in .gitlab-ci.yml and extract the shell logic from YAML to a function in ci/jobs.sh Signed-off-by: Erik Skultety Reviewed-by: Daniel P. Berrangé --- ci/integration-template.yml | 36 ++-- ci/jobs.sh

Re: [libvirt PATCH 09/12] ci: jobs.sh: run_cmd: Use eval to run commands

2023-09-18 Thread Erik Skultety
On Mon, Sep 18, 2023 at 11:31:53AM +0100, Daniel P. Berrangé wrote: > On Mon, Sep 18, 2023 at 12:22:45PM +0200, Erik Skultety wrote: > > We tried to evade usage of eval in commit 6214ae55f6a, but trying to > > use I/O redirections with a command doesn't have the desired effe

[libvirt PATCH 03/12] ci: integration: Adjust the check for CentOS Stream version

2023-09-18 Thread Erik Skultety
All supported versions of Fedora and CentOS Stream 9 default to modular setup, it's probably better if we cosmetically adjust the CentOS Stream version check to make it explicit that monolithic daemon services ought to be started only on Stream 8. Signed-off-by: Erik Skultety --- ci/jobs.s

[libvirt PATCH 02/12] ci: integration: Extract the integration CI main recipe to jobs.sh

2023-09-18 Thread Erik Skultety
Follow what's been done to other jobs in .gitlab-ci.yml and extract the shell logic from YAML to a function in ci/jobs.sh Signed-off-by: Erik Skultety --- ci/integration-template.yml | 36 ++-- ci/jobs.sh | 32 ++

[libvirt PATCH 09/12] ci: jobs.sh: run_cmd: Use eval to run commands

2023-09-18 Thread Erik Skultety
er to print all commands and use the redirection only on the actual execution of a given command, let's adopt eval on "$@" and allow passing redirections as strings later on. Future patches will demonstrate this. Signed-off-by: Erik Skultety --- ci/jobs.sh | 4 ++-- 1 file changed

[libvirt PATCH 11/12] ci: jobs: run_integration: Print DAEMONS variable for debugging

2023-09-18 Thread Erik Skultety
EMONS variable that we set depending on the distro we execute the tests on. Signed-off-by: Erik Skultety --- ci/jobs.sh | 2 ++ 1 file changed, 2 insertions(+) diff --git a/ci/jobs.sh b/ci/jobs.sh index 27add3d105..e10769527a 100644 --- a/ci/jobs.sh +++ b/ci/jobs.sh @@ -98,6 +98,8 @@ run_integr

[libvirt PATCH 07/12] ci: jobs.sh: run_integration: Add/Rewrite/Reformat commentaries

2023-09-18 Thread Erik Skultety
f-by: Erik Skultety --- ci/jobs.sh | 15 --- 1 file changed, 12 insertions(+), 3 deletions(-) diff --git a/ci/jobs.sh b/ci/jobs.sh index 75ea638580..37bca452fa 100644 --- a/ci/jobs.sh +++ b/ci/jobs.sh @@ -84,10 +84,14 @@ run_website_build() { run_integration() { sudo pip3 ins

[libvirt PATCH 12/12] ci: jobs.sh: Define and create SCRATCH_DIR for local executions

2023-09-18 Thread Erik Skultety
nvironment for the job every time run_integration function is run. For repeated interactive use case, it is imperative that the developer takes care of their environment. Signed-off-by: Erik Skultety --- ci/jobs.sh | 7 +++ 1 file changed, 7 insertions(+) diff --git a/ci/jobs.sh b/ci/job

[libvirt PATCH 08/12] ci: jobs: run_integration: Make POSIX-compliant

2023-09-18 Thread Erik Skultety
Neither '&>' nor 'source' are defined in POSIX. Signed-off-by: Erik Skultety --- ci/jobs.sh | 8 1 file changed, 4 insertions(+), 4 deletions(-) diff --git a/ci/jobs.sh b/ci/jobs.sh index 37bca452fa..f4e83dda2e 100644 --- a/ci/jobs.sh +++ b/ci/jobs.sh @@ -91

[libvirt PATCH 06/12] ci: jobs.sh: integration: Use --quiet with virsh

2023-09-18 Thread Erik Skultety
We've not been interested in any extra output from the command at all since we always redirected both stdout and stderr to /dev/null. Future patch will change that slightly, so --quiet will start making sense. Signed-off-by: Erik Skultety --- ci/jobs.sh | 2 +- 1 file changed, 1 insertion(

[libvirt PATCH 10/12] ci: jobs: integration: Execute raw commands via 'run_cmd' helper

2023-09-18 Thread Erik Skultety
r debugging purposes. Signed-off-by: Erik Skultety --- ci/jobs.sh | 26 +- 1 file changed, 13 insertions(+), 13 deletions(-) diff --git a/ci/jobs.sh b/ci/jobs.sh index 3a89cb1a69..27add3d105 100644 --- a/ci/jobs.sh +++ b/ci/jobs.sh @@ -82,16 +82,16

[libvirt PATCH 05/12] ci: jobs.sh: Drop comment about the need for Avocado 98.0

2023-09-18 Thread Erik Skultety
abandoning the v98.0 was a good thing in the end. Signed-off-by: Erik Skultety --- ci/jobs.sh | 1 - 1 file changed, 1 deletion(-) diff --git a/ci/jobs.sh b/ci/jobs.sh index adb798d127..04e776e9be 100644 --- a/ci/jobs.sh +++ b/ci/jobs.sh @@ -82,7 +82,6 @@ run_website_build

[libvirt PATCH 00/12] Extract the integration job commands to a shell script

2023-09-18 Thread Erik Skultety
anged, so I'm proposing this as a new thing. Here are test pipelines (both integration as well as normal one) after the change: https://gitlab.com/eskultety/libvirt/-/pipelines/1008044353 https://gitlab.com/eskultety/libvirt/-/pipelines/1008098378 Erik Skultety (12): syntax-check: Drop t

[libvirt PATCH 04/12] ci: integration: Drop the 'install-deps' hidden job and reference

2023-09-18 Thread Erik Skultety
Since the section now only consists of a single command, we can happily move the command to the main integration template job body. Signed-off-by: Erik Skultety --- ci/integration-template.yml | 6 +- 1 file changed, 1 insertion(+), 5 deletions(-) diff --git a/ci/integration-template.yml b

[libvirt PATCH 01/12] syntax-check: Drop the shell's 'check for minus' rule

2023-09-18 Thread Erik Skultety
it already. Therefore, drop the rule. Signed-off-by: Erik Skultety --- build-aux/syntax-check.mk | 9 - 1 file changed, 9 deletions(-) diff --git a/build-aux/syntax-check.mk b/build-aux/syntax-check.mk index d7cf109fbd..5718768193 100644 --- a/build-aux/syntax-check.mk +++ b/build-aux/synta

Re: [libvirt PATCH v2 0/5] Add support for vDPA block devices

2023-09-13 Thread Erik Skultety
On Wed, Sep 13, 2023 at 12:57:09PM +0200, Erik Skultety wrote: > On Wed, Sep 13, 2023 at 08:56:35AM +0100, Daniel P. Berrangé wrote: > > On Tue, Sep 12, 2023 at 04:11:01PM -0500, Jonathon Jongsma wrote: > > > On 9/12/23 7:00 AM, Peter Krempa wrote: > > > > On Mon,

[libvirt PATCH] ci: jobs.sh: Add back '--no-suite syntax-check --print-errorlogs'

2023-09-13 Thread Erik Skultety
egression. This patch adds them back. Fixes: 8e660c5286d7e2d07dd61681074bf155592d Signed-off-by: Erik Skultety --- Technically this is a build breaker fix, but sending for review anyway to see if there's an agreement on this approach. ci/jobs.sh | 3 +++ 1 file changed, 3 insertions

Re: [libvirt PATCH v2 0/5] Add support for vDPA block devices

2023-09-13 Thread Erik Skultety
On Wed, Sep 13, 2023 at 08:56:35AM +0100, Daniel P. Berrangé wrote: > On Tue, Sep 12, 2023 at 04:11:01PM -0500, Jonathon Jongsma wrote: > > On 9/12/23 7:00 AM, Peter Krempa wrote: > > > On Mon, Sep 11, 2023 at 16:53:42 -0500, Jonathon Jongsma wrote: > > > > see https://bugzilla.redhat.com/show_bug.

Re: [libvirt PATCH v2 01/35] ci: build.sh: Add variables from .gitlab-ci.yml

2023-09-11 Thread Erik Skultety
On Mon, Sep 11, 2023 at 03:02:15PM +0100, Daniel P. Berrangé wrote: > On Mon, Sep 11, 2023 at 03:43:02PM +0200, Erik Skultety wrote: > > These are common variables we wish to use in containerized environments > > both in GitLab and locally. Having these defined in a single place

[libvirt PATCH v2 33/35] ci: helper: Drop the --meson-args/--ninja-args CLI options

2023-09-11 Thread Erik Skultety
: Erik Skultety Reviewed-by: Daniel P. Berrangé Erik Skultety : --- ci/helper | 15 --- 1 file changed, 15 deletions(-) diff --git a/ci/helper b/ci/helper index b90dc56ede..c734629731 100755 --- a/ci/helper +++ b/ci/helper @@ -75,21 +75,6 @@ class Parser: help="pa

[libvirt PATCH v2 26/35] ci: helper: Add a required_deps higher order helper/decorator

2023-09-11 Thread Erik Skultety
tical helper for this purpose. Signed-off-by: Erik Skultety Reviewed-by: Daniel P. Berrangé Erik Skultety : --- ci/helper | 22 ++ 1 file changed, 22 insertions(+) diff --git a/ci/helper b/ci/helper index 75552774f6..4727145b28 100755 --- a/ci/helper +++ b/ci/helper @@ -14,6 +

[libvirt PATCH v2 22/35] .gitlab-ci.yml: Convert the potfile job to the build.sh usage

2023-09-11 Thread Erik Skultety
Individual shell command executions are replaced by respective functions in the ci/build.sh base script. This will make sure we use the same recipes in GitLab jobs as well as in local executions. Signed-off-by: Erik Skultety Reviewed-by: Daniel P. Berrangé Erik Skultety : --- .gitlab-ci.yml

[libvirt PATCH v2 29/35] ci: helper: Rework _lcitool_run method logic

2023-09-11 Thread Erik Skultety
that will source ci/build.sh and run whatever was specified as --job essentially to simulate the exact steps a GitLab pipeline job would go through. Signed-off-by: Erik Skultety Reviewed-by: Daniel P. Berrangé Erik Skultety : --- ci/helper | 55 +++

[libvirt PATCH v2 23/35] ci: helper: Drop _lcitool_get_targets method

2023-09-11 Thread Erik Skultety
This method unused anywhere, so drop it. Signed-off-by: Erik Skultety Reviewed-by: Daniel P. Berrangé Erik Skultety : --- ci/helper | 4 1 file changed, 4 deletions(-) diff --git a/ci/helper b/ci/helper index fb562d55e1..8986772153 100755 --- a/ci/helper +++ b/ci/helper @@ -163,10 +163,6

[libvirt PATCH v2 06/35] ci: build.sh: Add a wrapper function over the 'build' job

2023-09-11 Thread Erik Skultety
This helper is a shell function transcript of its original GitLab CI counterpart. Signed-off-by: Erik Skultety Erik Skultety : --- ci/build.sh | 5 + 1 file changed, 5 insertions(+) diff --git a/ci/build.sh b/ci/build.sh index 477ccbc7d1..f908bbc5d4 100644 --- a/ci/build.sh +++ b/ci

[libvirt PATCH v2 17/35] .gitlab-ci.yml: Add 'after_script' stage to prep for artifact collection

2023-09-11 Thread Erik Skultety
ocal build inspection in an interactive container shell session Signed-off-by: Erik Skultety Reviewed-by: Daniel P. Berrangé Erik Skultety : --- .gitlab-ci.yml | 11 ++- 1 file changed, 10 insertions(+), 1 deletion(-) diff --git a/.gitlab-ci.yml b/.gitlab-ci.yml index 944a7b7817..1c6af8f

[libvirt PATCH v2 10/35] ci: build.sh: Add a wrapper function over the 'potfile' job

2023-09-11 Thread Erik Skultety
7; and 'libvirt-pot' targets in a serial manner. Signed-off-by: Erik Skultety Erik Skultety : --- ci/build.sh | 11 +++ 1 file changed, 11 insertions(+) diff --git a/ci/build.sh b/ci/build.sh index e6c3225691..d6361f3ade 100644 --- a/ci/build.sh +++ b/ci/build.sh @@ -65,3 +65,14

[libvirt PATCH v2 07/35] ci: build.sh: Add a helper function to create the dist tarball

2023-09-11 Thread Erik Skultety
tions which rely on a shallow copy of the libvirt repo created as: $ git clone --local Even if all changes have been committed, git often complained otherwise. Updating the index in a GitLab environment is a NOP. Signed-off-by: Erik Skultety Erik Skultety : --- ci/build.sh | 10 ++ 1

[libvirt PATCH v2 15/35] ci: build.sh: Drop MESON_ARGS definition from global level

2023-09-11 Thread Erik Skultety
Signed-off-by: Erik Skultety Reviewed-by: Daniel P. Berrangé Erik Skultety : --- ci/build.sh | 10 -- 1 file changed, 10 deletions(-) diff --git a/ci/build.sh b/ci/build.sh index ac649ed9a9..96ee289c4f 100644 --- a/ci/build.sh +++ b/ci/build.sh @@ -13,16 +13,6 @@ if ! [ -t 1 ]; then

[libvirt PATCH v2 31/35] ci: helper: Add a job argparse subparser

2023-09-11 Thread Erik Skultety
The idea behind this subcommand is to follow whatever build job we have defined in the GitLab CI pipeline, so that we only have a single source of truth for the recipes. Adds 'shell' as an extra option for interactive container build debugging. Signed-off-by: Erik Skultety Reviewed-by

[libvirt PATCH v2 35/35] ci: Drop the now unused Makefile

2023-09-11 Thread Erik Skultety
All the functionality this script provided has been incorporated either in the Python ci/helper tool or lcitool directly. Signed-off-by: Erik Skultety Reviewed-by: Daniel P. Berrangé Erik Skultety : --- ci/Makefile | 245 1 file changed, 245

[libvirt PATCH v2 34/35] ci: helper: Drop the _make_run method

2023-09-11 Thread Erik Skultety
We've successfully migrated over to lcitool to take care of the container workload execution, so dropping this 'make' prep code is a prerequisite of finally getting rid of the ci/Makefile script. Signed-off-by: Erik Skultety Reviewed-by: Daniel P. Berrangé Erik Skultety : ---

[libvirt PATCH v2 32/35] ci: helper: Drop original actions

2023-09-11 Thread Erik Skultety
Previous patches added a single 'run' command parametrized with GitLab job specs via '--job' that cover all of these original actions, adding some more in the process. Drop the original actions as we don't need them anymore. Signed-off-by: Erik Skultety Reviewed-by:

[libvirt PATCH v2 24/35] ci: helper: Don't make ':' literal a static part of the image tag

2023-09-11 Thread Erik Skultety
':' is just a connecting character, we can add it to the appropriate place later in the Python script later, but it doesn't make sense to be part of the image 'tag' string. Signed-off-by: Erik Skultety Reviewed-by: Daniel P. Berrangé Erik Skultety : --- ci/helper

[libvirt PATCH v2 30/35] ci: helper: Add an action to run the container workload via lcitool

2023-09-11 Thread Erik Skultety
Just like with the other CLI sub-commands, add an action to run a GitLab spec job in a local container via lcitool. Signed-off-by: Erik Skultety Reviewed-by: Daniel P. Berrangé Erik Skultety : --- ci/helper | 4 1 file changed, 4 insertions(+) diff --git a/ci/helper b/ci/helper index

[libvirt PATCH v2 08/35] ci: build.sh: Add a wrapper function over the 'test' job

2023-09-11 Thread Erik Skultety
This helper is a shell function transcript of its original GitLab CI counterpart. Signed-off-by: Erik Skultety Erik Skultety : --- ci/build.sh | 5 + 1 file changed, 5 insertions(+) diff --git a/ci/build.sh b/ci/build.sh index ab56c5e5eb..29b6a3306d 100644 --- a/ci/build.sh +++ b/ci

[libvirt PATCH v2 21/35] .gitlab-ci.yml: Convert the codestyle job to the build.sh usage

2023-09-11 Thread Erik Skultety
Individual shell command executions are replaced by respective functions in the ci/build.sh base script. This will make sure we use the same recipes in GitLab jobs as well as in local executions. Signed-off-by: Erik Skultety Reviewed-by: Daniel P. Berrangé Erik Skultety : --- .gitlab-ci.yml

[libvirt PATCH v2 28/35] ci: helper: Add a helper to create a local repo clone Pythonic way

2023-09-11 Thread Erik Skultety
A proper Python equivalent of 'git clone --local'. Signed-off-by: Erik Skultety Reviewed-by: Daniel P. Berrangé Erik Skultety : --- ci/helper | 4 1 file changed, 4 insertions(+) diff --git a/ci/helper b/ci/helper index 6aca089db4..392702ae41 100755 --- a/ci/helper +++ b

[libvirt PATCH v2 14/35] ci: build.sh: Drop direct invocation of meson/ninja commands

2023-09-11 Thread Erik Skultety
definitions. Signed-off-by: Erik Skultety Erik Skultety : --- ci/build.sh | 5 + 1 file changed, 1 insertion(+), 4 deletions(-) diff --git a/ci/build.sh b/ci/build.sh index fd326dad8d..ac649ed9a9 100644 --- a/ci/build.sh +++ b/ci/build.sh @@ -21,10 +21,7 @@ GIT_ROOT="$(git rev-parse --

[libvirt PATCH v2 27/35] ci: helper: Add Python code hangling git clones

2023-09-11 Thread Erik Skultety
This helper will be utilized by a future patch which will add the lcitool container execution logic. The reason why the required_deps decorator isn't being used here is because this is a property. Signed-off-by: Erik Skultety Reviewed-by: Daniel P. Berrangé Erik Skultety : --- ci/helpe

[libvirt PATCH v2 25/35] ci: helper: Add --lcitool-path CLI option

2023-09-11 Thread Erik Skultety
We'll soon be relying solely on lcitool so we need to be able to run it from a user-provided location if it's not installed in a known location. Signed-off-by: Erik Skultety Reviewed-by: Daniel P. Berrangé Erik Skultety : --- ci/helper | 6 ++ 1 file changed, 6 insertions(+) di

[libvirt PATCH v2 20/35] .gitlab-ci.yml: Convert the website build job to the build.sh usage

2023-09-11 Thread Erik Skultety
Individual shell command executions are replaced by respective functions in the ci/build.sh base script. This will make sure we use the same recipes in GitLab jobs as well as in local executions. Signed-off-by: Erik Skultety Reviewed-by: Daniel P. Berrangé Erik Skultety : --- .gitlab-ci.yml

[libvirt PATCH v2 05/35] ci: build.sh: Add a wrapper function over meson's setup

2023-09-11 Thread Erik Skultety
that in a transitive manner. Signed-off-by: Erik Skultety Erik Skultety : --- ci/build.sh | 5 + 1 file changed, 5 insertions(+) diff --git a/ci/build.sh b/ci/build.sh index 5883542b45..477ccbc7d1 100644 --- a/ci/build.sh +++ b/ci/build.sh @@ -32,3 +32,8 @@ run_cmd() { printf "\e[32

[libvirt PATCH v2 18/35] .gitlab-ci.yml: Convert the native build job to the build.sh usage

2023-09-11 Thread Erik Skultety
Individual shell command executions are replaced by respective functions in the ci/build.sh base script. This will make sure we use the same recipes in GitLab jobs as well as in local executions. Signed-off-by: Erik Skultety Reviewed-by: Daniel P. Berrangé Erik Skultety : --- .gitlab-ci.yml

[libvirt PATCH v2 12/35] ci: build.sh: Add a wrapper function over the 'website' job

2023-09-11 Thread Erik Skultety
This helper is a shell function transcript of its original GitLab CI counterpart. Signed-off-by: Erik Skultety Erik Skultety : --- ci/build.sh | 7 +++ 1 file changed, 7 insertions(+) diff --git a/ci/build.sh b/ci/build.sh index c558b4c9ca..8e1619d483 100644 --- a/ci/build.sh +++ b/ci

[libvirt PATCH v2 09/35] ci: build.sh: Add a wrapper function over the 'codestyle' job

2023-09-11 Thread Erik Skultety
This helper is a shell function transcript of its original GitLab CI counterpart. Signed-off-by: Erik Skultety Erik Skultety : --- ci/build.sh | 8 1 file changed, 8 insertions(+) diff --git a/ci/build.sh b/ci/build.sh index 29b6a3306d..e6c3225691 100644 --- a/ci/build.sh +++ b/ci

[libvirt PATCH v2 13/35] ci: build.sh: Drop changing working directory to CI_CONT_DIR

2023-09-11 Thread Erik Skultety
he job ran in a GitLab environment. Signed-off-by: Erik Skultety Erik Skultety : --- ci/build.sh | 2 -- 1 file changed, 2 deletions(-) diff --git a/ci/build.sh b/ci/build.sh index 8e1619d483..fd326dad8d 100644 --- a/ci/build.sh +++ b/ci/build.sh @@ -1,7 +1,5 @@ #!/bin/sh -cd "$CI_CO

[libvirt PATCH v2 19/35] .gitlab-ci.yml: Convert the cross build job to the build.sh usage

2023-09-11 Thread Erik Skultety
Individual shell command executions are replaced by respective functions in the ci/build.sh base script. This will make sure we use the same recipes in GitLab jobs as well as in local executions. Signed-off-by: Erik Skultety Reviewed-by: Daniel P. Berrangé Erik Skultety : --- .gitlab-ci.yml

[libvirt PATCH v2 04/35] ci: build.sh: Add a wrapper function executing 'shell' commands

2023-09-11 Thread Erik Skultety
;t lose track of the *actual* shell commands being run as part of the GitLab job pipelines. An example of what the output then might look like: [RUN COMMAND]: 'meson compile -C build install-web' Signed-off-by: Erik Skultety Erik Skultety : --- ci/build.sh | 5 + 1 file changed,

[libvirt PATCH v2 11/35] ci: build.sh: Add a wrapper function over the 'rpmbuild' job

2023-09-11 Thread Erik Skultety
This helper is a shell function transcript of its original GitLab CI counterpart. Signed-off-by: Erik Skultety Erik Skultety : --- ci/build.sh | 9 + 1 file changed, 9 insertions(+) diff --git a/ci/build.sh b/ci/build.sh index d6361f3ade..c558b4c9ca 100644 --- a/ci/build.sh +++ b/ci

[libvirt PATCH v2 16/35] ci: Rename build.sh -> jobs.sh

2023-09-11 Thread Erik Skultety
o longer descriptive enough and 'jobs.sh' feels more suitable and less misleading. Signed-off-by: Erik Skultety Erik Skultety : --- ci/{build.sh => jobs.sh} | 0 1 file changed, 0 insertions(+), 0 deletions(-) rename ci/{build.sh => jobs.sh} (100%) diff --git a/ci/build.sh b/ci/

[libvirt PATCH v2 03/35] ci: build.sh: Don't mention that MESON_ARGS are available via CLI

2023-09-11 Thread Erik Skultety
Previous patches have removed the code that allowed injecting arbitrary meson arguments, same for ninja args. Signed-off-by: Erik Skultety Reviewed-by: Daniel P. Berrangé Erik Skultety : --- ci/build.sh | 8 +--- 1 file changed, 1 insertion(+), 7 deletions(-) diff --git a/ci/build.sh b/ci

[libvirt PATCH v2 01/35] ci: build.sh: Add variables from .gitlab-ci.yml

2023-09-11 Thread Erik Skultety
These are common variables we wish to use in containerized environments both in GitLab and locally. Having these defined in a single place rather than twice is highly preferable. Signed-off-by: Erik Skultety Erik Skultety : --- ci/build.sh | 12 +++- 1 file changed, 11 insertions(+), 1

[libvirt PATCH v2 00/35] ci: Unify the GitLab CI jobs with local executions && adopt lcitool container executions

2023-09-11 Thread Erik Skultety
.html [2] https://gitlab.com/libvirt/libvirt-ci/-/merge_requests/431 Erik Skultety (35): ci: build.sh: Add variables from .gitlab-ci.yml ci: build.sh: Add GIT_ROOT env helper variable ci: build.sh: Don't mention that MESON_ARGS are available via CLI ci: build.sh: Add a wrapper function

[libvirt PATCH v2 02/35] ci: build.sh: Add GIT_ROOT env helper variable

2023-09-11 Thread Erik Skultety
We'll use this one in many of the job functions future patches will introduce, it's a neat shortcut to avoid using relative paths. Signed-off-by: Erik Skultety Reviewed-by: Daniel P. Berrangé Erik Skultety : --- ci/build.sh | 2 ++ 1 file changed, 2 insertions(+) diff --git a/ci/bui

Re: [libvirt PATCH 01/33] ci: build.sh: Add variables from .gitlab-ci.yml

2023-09-01 Thread Erik Skultety
On Thu, Aug 31, 2023 at 05:45:05PM +0100, Daniel P. Berrangé wrote: > On Fri, Aug 25, 2023 at 07:55:09PM +0200, Erik Skultety wrote: > > These are common variables we wish to use in containerized environments > > both in GitLab and locally. Having these defined in a single place

Re: [libvirt PATCH 05/33] ci: build.sh: Add a wrapper function executing 'shell' commands

2023-09-01 Thread Erik Skultety
On Fri, Sep 01, 2023 at 10:46:06AM +0100, Daniel P. Berrangé wrote: > On Thu, Aug 31, 2023 at 03:30:23PM +0100, Daniel P. Berrangé wrote: > > On Fri, Aug 25, 2023 at 07:55:13PM +0200, Erik Skultety wrote: > > > This would normally be not needed at all, but the problem here is

Re: Sunset libvirt-snmp?

2023-09-01 Thread Erik Skultety
On Fri, Sep 01, 2023 at 10:41:26AM +0100, Daniel P. Berrangé wrote: > On Fri, Sep 01, 2023 at 11:39:34AM +0200, Erik Skultety wrote: > > On Fri, Sep 01, 2023 at 02:15:59AM -0700, Andrea Bolognani wrote: > > > On Thu, Aug 31, 2023 at 04:53:47PM +0100, Daniel P. Berrangé wrote

Re: Sunset libvirt-snmp?

2023-09-01 Thread Erik Skultety
On Fri, Sep 01, 2023 at 02:15:59AM -0700, Andrea Bolognani wrote: > On Thu, Aug 31, 2023 at 04:53:47PM +0100, Daniel P. Berrangé wrote: > > I'm also strongly inclined to archive the following: > > > > * libvirt-cim > > * libvirt-appdev-guide-python > > * libvirt-publican > > * libvirt-sandb

Re: [libvirt PATCH 00/33] ci: Unify the GitLab CI jobs with local executions && adopt lcitool container executions

2023-09-01 Thread Erik Skultety
On Thu, Aug 31, 2023 at 05:17:13PM +0100, Daniel P. Berrangé wrote: > On Fri, Aug 25, 2023 at 07:55:08PM +0200, Erik Skultety wrote: > > Technically a v2 of: > > https://listman.redhat.com/archives/libvir-list/2023-February/237552.html > > > > However, the approach her

Re: [libvirt PATCH 05/33] ci: build.sh: Add a wrapper function executing 'shell' commands

2023-09-01 Thread Erik Skultety
On Fri, Sep 01, 2023 at 10:10:55AM +0100, Daniel P. Berrangé wrote: > On Fri, Aug 25, 2023 at 07:55:13PM +0200, Erik Skultety wrote: > > This would normally be not needed at all, but the problem here is the > > Shell-in-YAML which GitLab interprets. It outputs every command that &

Re: [libvirt PATCH 11/33] ci: build.sh: Add a wrapper function over the 'rpmbuild' job

2023-09-01 Thread Erik Skultety
On Fri, Aug 25, 2023 at 07:55:19PM +0200, Erik Skultety wrote: > This helper is a shell function transcript of its original GitLab CI > counterpart. > > Signed-off-by: Erik Skultety > --- > ci/build.sh | 11 +++ > 1 file changed, 11 insertions(+) > > di

Re: [libvirt PATCH 00/33] ci: Unify the GitLab CI jobs with local executions && adopt lcitool container executions

2023-09-01 Thread Erik Skultety
On Thu, Aug 31, 2023 at 06:28:16PM +0100, Daniel P. Berrangé wrote: > On Fri, Aug 25, 2023 at 07:55:08PM +0200, Erik Skultety wrote: > > Technically a v2 of: > > https://listman.redhat.com/archives/libvir-list/2023-February/237552.html > > > > However, the approach her

Re: [libvirt PATCH 14/33] ci: build.sh: Drop direct invocation of meson/ninja commands

2023-09-01 Thread Erik Skultety
On Thu, Aug 31, 2023 at 05:59:26PM +0100, Daniel P. Berrangé wrote: > On Fri, Aug 25, 2023 at 07:55:22PM +0200, Erik Skultety wrote: > > We've moved all invocations to the respective helper function which > > we'll execute both from gitlab CI jobs and local environment

Re: [libvirt PATCH 11/33] ci: build.sh: Add a wrapper function over the 'rpmbuild' job

2023-09-01 Thread Erik Skultety
On Thu, Aug 31, 2023 at 05:55:54PM +0100, Daniel P. Berrangé wrote: > On Fri, Aug 25, 2023 at 07:55:19PM +0200, Erik Skultety wrote: > > This helper is a shell function transcript of its original GitLab CI > > counterpart. > > > > Signed-off-by: Erik Skultety &g

Re: [libvirt PATCH 10/33] ci: build.sh: Add a wrapper function over the 'potfile' job

2023-09-01 Thread Erik Skultety
On Thu, Aug 31, 2023 at 05:55:21PM +0100, Daniel P. Berrangé wrote: > On Fri, Aug 25, 2023 at 07:55:18PM +0200, Erik Skultety wrote: > > This helper is a shell function transcript of its original GitLab CI > > counterpart. There's one notable difference such that we pass &#

Re: [libvirt PATCH] rpm: Recommend libvirt-daemon for with_modular_daemons distros

2023-08-31 Thread Erik Skultety
On Thu, Aug 31, 2023 at 09:50:07AM +0100, Daniel P. Berrangé wrote: > On Thu, Aug 31, 2023 at 01:43:44AM -0700, Andrea Bolognani wrote: > > On Wed, Aug 30, 2023 at 07:25:23PM +0200, Erik Skultety wrote: > > > On Wed, Aug 30, 2023 at 06:22:33PM +0200, Andrea Bolognani wrote:

Re: [libvirt PATCH] rpm: Recommend libvirt-daemon for with_modular_daemons distros

2023-08-30 Thread Erik Skultety
ing '--setopt=install_weak_deps=False'. Footprint aside, I don't see a practical problem having both installed even if unused since it allows users switching between the deployment modes seamlessly without having to go and install an extra package. FWIW: Reviewed-by: Erik Skultety

Re: [libvirt PATCH 2/2] tools: fix VMSA construction with explicit CPU family/model/stepping

2023-08-29 Thread Erik Skultety
gt; to parse the firmware that has not been loaded yet. We must delay > building the VMSA in that scenario. > > Signed-off-by: Daniel P. Berrangé Reviewed-by: Erik Skultety

Re: [libvirt PATCH 1/2] tools: fix handling of CPU family/model/stepping in SEV validation

2023-08-29 Thread Erik Skultety
'host-passthrough' is used") > + > sig = capsdoc.xpath("/capabilities/host/cpu/signature") > if len(sig) != 1: > raise UnsupportedUsageException( > -- > 2.41.0 > Reviewed-by: Erik Skultety

Re: [libvirt PATCH v7 00/35] Use nbdkit for http/ftp/ssh network drives in libvirt

2023-08-28 Thread Erik Skultety
On Mon, Aug 28, 2023 at 04:44:35PM -0500, Jonathon Jongsma wrote: > This is the seventh version of this patch series. See > https://bugzilla.redhat.com/show_bug.cgi?id=2016527 for more information. > > Note that testing this requires selinux policy changes which are not fully > done, but there is

[libvirt PATCH] ci: lcitool: Add libvirt-tck+runtime deps list

2023-08-28 Thread Erik Skultety
This change was supposed to be part of commit 120a674f , but was proposed against the libvirt TCK project instead. Since we're running the TCK test suite as part of this project, this is the right place for the TCK runtime deps list config. Signed-off-by: Erik Skultety --- ci/lcitool/pro

[libvirt PATCH 07/33] ci: build.sh: Add a helper function to create the dist tarball

2023-08-25 Thread Erik Skultety
tions which rely on a shallow copy of the libvirt repo created as: $ git clone --local Even if all changes have been committed, git often complained otherwise. Updating the index in a GitLab environment is a NOP. Signed-off-by: Erik Skultety --- ci/build.sh | 12 1 file change

[libvirt PATCH 21/33] .gitlab-ci.yml: Convert the potfile job to the build.sh usage

2023-08-25 Thread Erik Skultety
Individual shell command executions are replaced by respective functions in the ci/build.sh base script. This will make sure we use the same recipes in GitLab jobs as well as in local executions. Signed-off-by: Erik Skultety --- .gitlab-ci.yml | 5 ++--- 1 file changed, 2 insertions(+), 3

[libvirt PATCH 27/33] ci: helper: Add Python code hangling git clones

2023-08-25 Thread Erik Skultety
This helper will be utilized by a future patch which will add the lcitool container execution logic. The reason why the required_deps decorator isn't being used here is because this is a property. Signed-off-by: Erik Skultety --- ci/helper | 9 + 1 file changed, 9 insertions(+)

[libvirt PATCH 30/33] ci: helper: Add an action to run the container workload via lcitool

2023-08-25 Thread Erik Skultety
Just like with the other CLI sub-commands, add an action to run a GitLab spec job in a local container via lcitool. Signed-off-by: Erik Skultety --- ci/helper | 4 1 file changed, 4 insertions(+) diff --git a/ci/helper b/ci/helper index 887e64ece1..7385d3b95c 100755 --- a/ci/helper +++ b

  1   2   3   4   5   6   7   8   9   10   >