Re: [Libguestfs] libnbd golang failure on RISC-V

2022-06-09 Thread Richard W.M. Jones
On Thu, Jun 09, 2022 at 02:14:07PM +0100, Daniel P. Berrangé wrote: > Setting GODEBUG=cgocheck=1 or GODEBUG=cgocheck=2 can sometimes > get more info. Took me a while to work out that we are actually setting that already (in ./run) which explains a couple of things: why I couldn't reproduce the

[Libguestfs] libnbd golang failure on RISC-V

2022-06-09 Thread Richard W.M. Jones
make[2]: Entering directory '/home/rjones/d/libnbd/golang' perl /home/rjones/d/libnbd/podwrapper.pl --section=3 --man libnbd-golang.3 \ --html ../html/libnbd-golang.3.html \ libnbd-golang.pod /home/rjones/d/libnbd/run go build write of Go pointer 0x3fa8028000 to non-Go memory 0x3fd2c0fb20

Re: [Libguestfs] [PATCH virt-v2v 0/3] tests: Add a phony Fedora image for testing

2022-06-09 Thread Richard W.M. Jones
On Thu, Jun 09, 2022 at 11:58:32AM +0200, Laszlo Ersek wrote: > On 06/09/22 10:46, Richard W.M. Jones wrote: > > On Thu, Jun 09, 2022 at 10:25:08AM +0200, Laszlo Ersek wrote: > >> On 06/09/22 10:11, Richard W.M. Jones wrote: > >>> On Thu, Jun 09, 2022 at 10:02:

Re: [Libguestfs] [PATCH virt-v2v 0/3] tests: Add a phony Fedora image for testing

2022-06-09 Thread Richard W.M. Jones
On Thu, Jun 09, 2022 at 10:25:08AM +0200, Laszlo Ersek wrote: > On 06/09/22 10:11, Richard W.M. Jones wrote: > > On Thu, Jun 09, 2022 at 10:02:54AM +0200, Laszlo Ersek wrote: > >> On 06/08/22 18:48, Richard W.M. Jones wrote: > >>> When we split virt-v2v from libgu

Re: [Libguestfs] [PATCH virt-v2v 3/3] tests: Add test cases for converting the phony Fedora images

2022-06-09 Thread Richard W.M. Jones
On Thu, Jun 09, 2022 at 10:20:47AM +0200, Laszlo Ersek wrote: > On 06/08/22 18:49, Richard W.M. Jones wrote: > > As well as testing a full Fedora conversion which was not really > > tested properly before, this also adds tests of conversions of Btrfs, > > RAID and LUKS guest

Re: [Libguestfs] [PATCH virt-v2v 2/3] test-data/phony-guests: Allow virt-v2v to work against phony Fedora

2022-06-09 Thread Richard W.M. Jones
On Thu, Jun 09, 2022 at 10:13:52AM +0200, Laszlo Ersek wrote: > Looks OK to me, I just suggest using a different function name rather > than "basename". While the C code is certainly OK, conceptually we > already have two standard basename() functions, a POSIX compatible one > from , and a glibc

Re: [Libguestfs] [PATCH virt-v2v 0/3] tests: Add a phony Fedora image for testing

2022-06-09 Thread Richard W.M. Jones
On Thu, Jun 09, 2022 at 10:02:54AM +0200, Laszlo Ersek wrote: > On 06/08/22 18:48, Richard W.M. Jones wrote: > > When we split virt-v2v from libguestfs many moons ago, I copied the > > test-data/ subdirectory over. I didn't modify it much, and it > > contains much test da

Re: [Libguestfs] [PATCH virt-v2v 2/3] test-data/phony-guests: Allow virt-v2v to work against phony Fedora

2022-06-09 Thread Richard W.M. Jones
On Wed, Jun 08, 2022 at 05:49:01PM +0100, Richard W.M. Jones wrote: > +# Virt-v2v also needs a kernel, initrd and modules path. > +$g->touch ("/boot/vmlinuz-$kver"); > +$g->touch ("/boot/initramfs-$kver.img"); > +$g->mkdir_p ("/lib/modules/$kver/kern

[Libguestfs] [PATCH virt-v2v 2/3] test-data/phony-guests: Allow virt-v2v to work against phony Fedora

2022-06-08 Thread Richard W.M. Jones
We didn't use the phony Fedora guest before with virt-v2v (only the phony Windows image). This commit makes miscellaneous changes so that it can be used for testing: - Add dummy rpm and dracut commands. - Add dummy kernel, initramfs and modules directory. - Add dummy grub configuration

[Libguestfs] [PATCH virt-v2v 3/3] tests: Add test cases for converting the phony Fedora images

2022-06-08 Thread Richard W.M. Jones
As well as testing a full Fedora conversion which was not really tested properly before, this also adds tests of conversions of Btrfs, RAID and LUKS guests. --- tests/Makefile.am | 8 ++ tests/test-v2v-fedora-btrfs-conversion.sh | 31 +

[Libguestfs] [PATCH virt-v2v 0/3] tests: Add a phony Fedora image for testing

2022-06-08 Thread Richard W.M. Jones
When we split virt-v2v from libguestfs many moons ago, I copied the test-data/ subdirectory over. I didn't modify it much, and it contains much test data that is irrelevant to virt-v2v. (This change does _not_ clean up any of that ...) However we did use the phony Windows image

[Libguestfs] [PATCH virt-v2v 1/3] test-data/phony-guests: Increase size of root filesystem

2022-06-08 Thread Richard W.M. Jones
Avoid this error in virt-v2v when trying to convert the phony Fedora guest image: [ 8.1] Checking for sufficient free disk space in the guest virt-v2v: error: not enough free space for conversion on filesystem ‘/’. 21.6 MB free < 100 MB needed --- test-data/phony-guests/make-fedora-img.pl | 4

Re: [Libguestfs] [v2v PATCH 4/4] convert_linux: install the QEMU guest agent with a firstboot script

2022-06-07 Thread Richard W.M. Jones
On Tue, Jun 07, 2022 at 01:59:30PM +0100, Richard W.M. Jones wrote: > On Mon, Jun 06, 2022 at 04:19:41PM +0200, Laszlo Ersek wrote: > > +(* Disable SELinux temporarily around package installation. > > Refer to > > + * <https://bugzilla.redhat.com/sh

Re: [Libguestfs] [libnbd PATCH v2 4/8] python: Reformat generated methods.c in a few places

2022-06-07 Thread Richard W.M. Jones
On Tue, Jun 07, 2022 at 08:53:23AM -0500, Eric Blake wrote: > On Tue, Jun 07, 2022 at 09:00:08AM +0100, Richard W.M. Jones wrote: > > On Mon, Jun 06, 2022 at 09:08:29PM -0500, Eric Blake wrote: > > > + pr ":nbd_%s\",\n" name; > > > &

Re: [Libguestfs] [libnbd PATCH v2 8/8] python: Make nbd.Buffer lighter-weight

2022-06-07 Thread Richard W.M. Jones
ect *ret = NULL; > >if (!PyArg_ParseTuple (args, > - "Onn:nbd_internal_py_aio_buffer_is_zero", > - , , )) > + "y*nnp:nbd_internal_py_aio_buffer_is_zero", > + ,

Re: [Libguestfs] [libnbd PATCH v2 7/8] python: Simplify python generator

2022-06-07 Thread Richard W.M. Jones
| n, Some default -> pr ", %s=%s" n default >) args); >pr "):\n"; >let longdesc = Str.global_replace py_fn_rex "C" longdesc in > @@ -842,8 +842,7 @@ let >pr "self._o"; >Li

Re: [Libguestfs] [libnbd PATCH v2 6/8] python: Don't unwrap nbd.Buffer in nbd.py

2022-06-07 Thread Richard W.M. Jones
rnal_py_get_aio_buffer (capsule); > + struct py_aio_buffer *buf = nbd_internal_py_get_aio_buffer (object); > >assert (buf); >buf->initialized = true; > diff --git a/python/utils.c b/python/utils.c > index 37f0c55..e0df181 100644 > --- a/python/utils.c > +++ b/python/utils.

Re: [Libguestfs] [libnbd PATCH v2 5/8] python: Make py_aio_buffer a private struct

2022-06-07 Thread Richard W.M. Jones
->len);\n" n n; > - pr "%s_buf->initialized = true;\n" n; > - pr " }\n" > | BytesPersistOut (n, _) -> > - pr " %s_buf->initialized = true;\n" n > + pr " if (nbd_internal_py_init_aio_buffer (%s) < 0) goto ou

Re: [Libguestfs] [libnbd PATCH v2 3/8] python: Enhance tests of nbd.Buffer

2022-06-07 Thread Richard W.M. Jones
t/510-aio-pwrite.py b/python/t/510-aio-pwrite.py > index 89599fc..d09e249 100644 > --- a/python/t/510-aio-pwrite.py > +++ b/python/t/510-aio-pwrite.py > @@ -45,6 +45,12 @@ while not h.aio_command_completed(cookie): > > assert buf == buf2.to_bytearray() > > +# Check t

Re: [Libguestfs] [libnbd PATCH v2 2/8] python: Plug uninit leak in nbd.Buffer.to_bytearray

2022-06-07 Thread Richard W.M. Jones
ot;; > "aio_buffer_size"; > - "aio_buffer_is_zero" ] @ List.map fst handle_calls); > + "aio_buffer_is_zero"] @ List.map fst handle_calls); >pr " { NULL, NULL, 0, NULL }\n"; >pr "};\n"; >pr &

Re: [Libguestfs] [libnbd PATCH v2 1/8] python: Improve doc comments for nbd.py

2022-06-07 Thread Richard W.M. Jones
> @@ -855,7 +860,7 @@ let >let longdesc = Str.global_replace py_fn_rex "C" longdesc in >let longdesc = Str.global_replace py_const_rex "C<" longdesc in >let longdesc = pod2text longdesc in > - pr " '''▶ %s\n\n%s'''\n&q

Re: [Libguestfs] [guestfs-tools PATCH] customize: rebase to the common/mlcustomize/Guest_packages interface

2022-06-07 Thread Richard W.M. Jones
This patch and the companion patch to libguestfs-common: Reviewed-by: Richard W.M. Jones Rich. -- Richard Jones, Virtualization Group, Red Hat http://people.redhat.com/~rjones Read my programming and virtualization blog: http://rwmj.wordpress.com libguestfs lets you edit virtual machines

Re: [Libguestfs] [v2v PATCH 0/4] convert_linux: install the QEMU guest agent with a firstboot script

2022-06-07 Thread Richard W.M. Jones
On Tue, Jun 07, 2022 at 01:39:53PM +0100, Richard W.M. Jones wrote: > OTOH ... my comment here: > > https://bugzilla.redhat.com/show_bug.cgi?id=2028764#c2 > > was about more social issues where we've not been able to put the > qemu-ga RPMs on the ISO, and firstboot seemed li

Re: [Libguestfs] [v2v PATCH 4/4] convert_linux: install the QEMU guest agent with a firstboot script

2022-06-07 Thread Richard W.M. Jones
On Mon, Jun 06, 2022 at 04:19:41PM +0200, Laszlo Ersek wrote: > Register a firstboot script, for installing the guest agent with the > guest's own package manager -- that is, "Guest_packages.install_command". > > For installing the package, network connectivity is required; for lack of > a

Re: [Libguestfs] [v2v PATCH 3/4] convert_linux: extract qemu-guest-agent package name

2022-06-07 Thread Richard W.M. Jones
manual.") > +| Some qga_pkg -> > +let has_qemu_guest_agent = > + List.exists ( > +fun { G.app2_name = name } -> > + name = qga_pkg > + ) inspect.i_apps in > +if not has_qemu_guest_agent then > +

Re: [Libguestfs] [v2v PATCH 2/4] windows_virtio: remove "install_linux_tools"

2022-06-07 Thread Richard W.M. Jones
I'm not a big fan of dead code/features, so we should probably just do this regardless of any other changes, so: Acked-by: Richard W.M. Jones Rich. -- Richard Jones, Virtualization Group, Red Hat http://people.redhat.com/~rjones Read my programming and virtualization blog: http

Re: [Libguestfs] [v2v PATCH 1/4] output/create_libvirt_xml: wire up the QEMU guest agent

2022-06-07 Thread Richard W.M. Jones
The patch looks OK, but qemu-ga supports vsock (-m listen-vsock), so wouldn't it be easier to use that? I thought that virtio-serial was unmaintained these days and so vsock would be preferred. Rich. -- Richard Jones, Virtualization Group, Red Hat http://people.redhat.com/~rjones Read my

Re: [Libguestfs] [v2v PATCH 0/4] convert_linux: install the QEMU guest agent with a firstboot script

2022-06-07 Thread Richard W.M. Jones
On Mon, Jun 06, 2022 at 04:19:37PM +0200, Laszlo Ersek wrote: > Bugzilla: https://bugzilla.redhat.com/show_bug.cgi?id=2028764 > > I'm going to post the pre-requisite libguestfs-common and guestfs-tools > patches (one patch for each project) in response to this cover letter, > too. > > I'm not

Re: [Libguestfs] [libnbd PATCH v2 4/8] python: Reformat generated methods.c in a few places

2022-06-07 Thread Richard W.M. Jones
uldn't need to print spaces to indent (because pr_wrap should do it for you). It all looks sensible and equivalent to the old code, and the output is cleaner too, so: Reviewed-by: Richard W.M. Jones Rich. -- Richard Jones, Virtualization Group, Red Hat http://people.redhat.com/~rjones Read my prog

Re: [Libguestfs] [libnbd PATCH 5/5] python: Accept all buffer-like objects in aio_p{read, write}

2022-06-04 Thread Richard W.M. Jones
On Fri, Jun 03, 2022 at 05:26:35PM -0500, Eric Blake wrote: > After the work in the previous patch, this one is a trivial feature > addition ;) Now you can do h.aio_pwrite(b'123', 0). > --- > python/handle.c | 5 + > 1 file changed, 5 insertions(+) > > diff --git a/python/handle.c

Re: [Libguestfs] [libnbd PATCH 5/5] python: Accept all buffer-like objects in aio_p{read, write}

2022-06-04 Thread Richard W.M. Jones
turn PyObject_GetAttrString(buffer, "_o"); > > + if (PyObject_CheckBuffer (buffer)) { > +Py_INCREF (buffer); > +return buffer; > + } > + >PyErr_SetString (PyExc_TypeError, > "aio_buffer: expecting nbd.Buffer instance"); >r

Re: [Libguestfs] [libnbd PATCH 4/5] python: Make nbd.Buffer lighter-weight

2022-06-04 Thread Richard W.M. Jones
)) > -return NULL; > - > - buf = nbd_internal_py_get_aio_buffer (obj); > - if (buf == NULL) > -return NULL; > - > - return PyByteArray_FromStringAndSize (buf->data, buf->len); > -} > - > -PyObject * > -nbd_internal_py_a

Re: [Libguestfs] [libnbd PATCH 3/5] python: Simplify python generator

2022-06-04 Thread Richard W.M. Jones
gt;List.iter ( > function > -| n, None, _ -> pr ", %s" n > -| n, Some default, _ -> pr ", %s=%s" n default > +| n, None -> pr ", %s" n > +| n, Some default -> pr ", %s

Re: [Libguestfs] [libnbd PATCH 2/5] python: Don't unwrap nbd.Buffer in nbd.py

2022-06-04 Thread Richard W.M. Jones
PyObject *capsule = PyObject_GetAttrString(buffer, "_o"); > + return PyCapsule_GetPointer (capsule, aio_buffer_name); > + } > + > + PyErr_SetString (PyExc_TypeError, > + "aio_buffer: expecting nbd.Buffer instance"); > + return NULL;

Re: [Libguestfs] [libnbd PATCH 1/5] python: Avoid memleak on (unlikely) module failure

2022-06-04 Thread Richard W.M. Jones
nbd_internal_py_Error = PyErr_NewException (\"nbd.Error\", NULL, NULL); > - if (nbd_internal_py_Error == NULL) > + if (PyModule_AddObject (mod, \"Error\", nbd_internal_py_Error) < 0) { > +Py_XDECREF (nbd_internal_py_Error); > +Py_DECREF (mod); > return NULL;

Re: [Libguestfs] [libnbd PATCH 3/2] python: Slice pread_structured buffer from original

2022-06-01 Thread Richard W.M. Jones
I agree with Nir's feedback and R-b's and don't have anything else to add. Rich. -- Richard Jones, Virtualization Group, Red Hat http://people.redhat.com/~rjones Read my programming and virtualization blog: http://rwmj.wordpress.com virt-p2v converts physical machines to virtual machines.

Re: [Libguestfs] [libnbd PATCH 3/2] python: Slice pread_structured buffer from original

2022-06-01 Thread Richard W.M. Jones
On Tue, May 31, 2022 at 07:24:03PM -0500, Eric Blake wrote: > On Wed, Jun 01, 2022 at 02:20:48AM +0300, Nir Soffer wrote: > > Does this work? > > > > PySlice_New(NULL, NULL, NULL); > > PySlice_AdjustIndices(length, start, stop, step); > > New in python 3.6.1. README says we still target

Re: [Libguestfs] [libnbd PATCH 3/2] python: Slice pread_structured buffer from original

2022-06-01 Thread Richard W.M. Jones
On Tue, May 31, 2022 at 10:52:35AM -0500, Eric Blake wrote: > And I really wish python didn't make it so hard to grab a slice of > another object using C code. Having to create 3 temporary PyObjects > instead of having a utility C function that takes normal integers was > annoying. You can add

Re: [Libguestfs] [nbdkit PATCH] linuxdisk: Reduce size of test

2022-06-01 Thread Richard W.M. Jones
y-out.test2 > - download /linuxdisk/nbdkit-linuxdisk-plugin.pod linuxdisk-copy-out.test3 > - download /linuxdisk/filesystem.c linuxdisk-copy-out.test4 > + download /Makefile linuxdisk-copy-out.test1 > + download /Makefile.am linuxdisk-copy-out.test2 > + download /nbdkit-linuxdi

Re: [Libguestfs] [libguestfs PATCH] appliance, daemon: disable lvm2 devicesfile

2022-05-30 Thread Richard W.M. Jones
nit b/appliance/init > index 7076821d2250..19aa151b73aa 100755 > --- a/appliance/init > +++ b/appliance/init > @@ -134,6 +134,17 @@ mdadm -As --auto=yes --no-degraded > # Empty LVM configuration file means "all defaults". > mkdir -p /tmp/lvm > touch /tmp/lvm/lvm

Re: [Libguestfs] libnbd: Failed to update to Fedora 36 & OpenSUSE Leap 15.3

2022-05-30 Thread Richard W.M. Jones
On Mon, May 30, 2022 at 09:12:48AM +0100, Richard W.M. Jones wrote: > > > git push -o ci.variable="LIBVIRT_CI_CONTAINERS=1" > > Let's see if this works: > > https://gitlab.com/nbdkit/libnbd/-/pipelines/550978621 That did in fact work. The OpenSUSE Leap test faile

Re: [Libguestfs] libnbd: Failed to update to Fedora 36 & OpenSUSE Leap 15.3

2022-05-30 Thread Richard W.M. Jones
> > git push -o ci.variable="LIBVIRT_CI_CONTAINERS=1" Let's see if this works: https://gitlab.com/nbdkit/libnbd/-/pipelines/550978621 Rich. -- Richard Jones, Virtualization Group, Red Hat http://people.redhat.com/~rjones Read my programming and virtualization blog: http://rwmj.wordpress.com

Re: [Libguestfs] libnbd: Failed to update to Fedora 36 & OpenSUSE Leap 15.3

2022-05-30 Thread Richard W.M. Jones
On Mon, May 30, 2022 at 09:25:11AM +0200, Martin Kletzander wrote: > On Sun, May 29, 2022 at 11:22:05AM +0100, Richard W.M. Jones wrote: > > > >I added this commit and regenerated the CI files: > > > >https://gitlab.com/nbdkit/libnbd/-/commit/b6a98aacbe22d599f000d4

[Libguestfs] libnbd: Failed to update to Fedora 36 & OpenSUSE Leap 15.3

2022-05-29 Thread Richard W.M. Jones
I added this commit and regenerated the CI files: https://gitlab.com/nbdkit/libnbd/-/commit/b6a98aacbe22d599f000d4d1c84c27081ec06957 https://gitlab.com/nbdkit/libnbd/-/commit/2439fd5c7a07b314ce47728c6fbae16b9a26dcdb However apparently gitlab CI cannot create the Fedora 36 & OpenSUSE Leap 15.3

Re: [Libguestfs] libnbd | Failed pipeline for master | 2439fd5c

2022-05-29 Thread Richard W.M. Jones
; > > Project nbdkit / libnbd > Branch● master > Commit● 2439fd5c > ci: Update generated files With the latest lib... > Commit Author ● Richard W.M. Jones > > Pipeline #550544496 triggered by ● Richard W.M. Jones &g

Re: [Libguestfs] [libnbd PATCH] api: Speed up nbd_pread_structured when reading holes

2022-05-28 Thread Richard W.M. Jones
set zeroes as they are read (and the user gets their > + * own garbage back in the case of a non-compliant server). > */ > + cmd->initialized = h->pread_initialize; > >/* Add the command to the end of the queue. Kick the state machine > * if there is no other command being p

Re: [Libguestfs] [libnbd PATCH] python: Speed up pread

2022-05-28 Thread Richard W.M. Jones
; n; > + pr " %s = NULL;\n" n; > use_ret := false > | Bool _ > | BytesIn _ > @@ -572,7 +573,7 @@ let > | BytesIn (n, _) -> > pr " if (%s.obj)\n" n; > pr "PyBuffer_Release (&%s);\n" n &g

Re: [Libguestfs] [nbdkit PATCH v2] blocksize: Avoid losing aligned writes to RMW race

2022-05-27 Thread Richard W.M. Jones
+os.unlink(witness) > + > +out = h.pread(16,0) > +print(out) > +t = end_t - start_t > +print(t) > +assert out in [b"4"*4 + b"3"*12, b"4"*16] > +assert t >= 8 > + > +# Next pass: try to kick off aligned first > +print("aligned first"

Re: [Libguestfs] [PATCH virt-v2v] convert: If listing RPM applications fails, rebuild DB and retry

2022-05-26 Thread Richard W.M. Jones
On Thu, May 26, 2022 at 10:53:59AM +0200, Laszlo Ersek wrote: > On 05/25/22 18:02, Richard W.M. Jones wrote: > > In libguestfs we didn't bother to check the return values from any > > librpm calls. In some cases where possibly the RPM database is > > faulty, this caused us to

Re: [Libguestfs] [PATCH] always 'max' for the appliance CPU model on all targes except ppc

2022-05-26 Thread Richard W.M. Jones
We always wanted "-cpu best", which means basically the CPU which always works best (NB: I used the both words "works" and "best"). Rich. -- Richard Jones, Virtualization Group, Red Hat http://people.redhat.com/~rjones Read my programming and virtualization blog: http://rwmj.wordpress.com

Re: [Libguestfs] [nbdkit PATCH] RFC: blocksize: Add test for sharding behavior

2022-05-26 Thread Richard W.M. Jones
Is there any way to do this without the literal sleeps? Gitlab CI in particular appears to be very contended (I guess it runs in parallel on huge systems with vast numbers of unrelated containers). I've seen threads being created that are so starved they never run at all even in tests running

Re: [Libguestfs] [libnbd PATCH] python: Accept buffers in nbd.Buffer.from_bytearray()

2022-05-26 Thread Richard W.M. Jones
rr); > return NULL; >} > > @@ -187,9 +197,11 @@ nbd_internal_py_aio_buffer_from_bytearray (PyObject > *self, PyObject *args) >if (buf->data == NULL) { > PyErr_NoMemory (); > free (buf); > +Py_XDECREF (arr); > return NULL; >

Re: [Libguestfs] [PATCH] always 'max' for the appliance CPU model on all targes except ppc

2022-05-25 Thread Richard W.M. Jones
On Wed, May 25, 2022 at 05:13:53PM +0100, Peter Maydell wrote: > On Wed, 25 May 2022 at 16:07, Laszlo Ersek wrote: > > > > + Drew & Peter > > > > On 05/25/22 15:30, Daniel P. Berrangé wrote: > > - The patch seems to do what it says in the commit message. > > > > - QEMU commit bab52d4bba3f

[Libguestfs] [PATCH libguestfs] daemon: rpm: Check return values from librpm calls

2022-05-25 Thread Richard W.M. Jones
We previously didn't bother to check the return values from any librpm calls. In some cases where possibly the RPM database is faulty, this caused us to return a zero-length list of installed applications (but no error indication). One way to reproduce this is given below. Note this reproducer

[Libguestfs] [PATCH virt-v2v] convert: If listing RPM applications fails, rebuild DB and retry

2022-05-25 Thread Richard W.M. Jones
In libguestfs we didn't bother to check the return values from any librpm calls. In some cases where possibly the RPM database is faulty, this caused us to return a zero-length list of installed applications (but no error indication). Libguestfs has subsequently been fixed so now it returns an

Re: [Libguestfs] [PATCH nbdkit v2 4/5] docs: Fix POD verbatim paragraphs

2022-05-25 Thread Richard W.M. Jones
I've updated the HTML man pages on the website: https://libguestfs.org/nbdkit.1.html Note the synopsis section of that first page is wrong, but I kind of knew that already. That particular section is generated by the podwrapper --verbatim option, unlike all the others. Rich. -- Richard

Re: [Libguestfs] [libguestfs-common PATCH] mlcustomize: refresh generated files

2022-05-25 Thread Richard W.M. Jones
I have tested both patches this time with the three affected tools (virt-builder, virt-customize & virt-sysprep) and the --selinux-relabel option is now present and ignored. For the series: Reviewed-by: Richard W.M. Jones Thanks for fixing this, I'll get it into C9S soon. Rich. -- Ric

Re: [Libguestfs] [PATCH nbdkit v2 4/5] docs: Fix POD verbatim paragraphs

2022-05-25 Thread Richard W.M. Jones
Thanks - the series was pushed in: b2612d2c..43b341b0 master -> master Rich. -- Richard Jones, Virtualization Group, Red Hat http://people.redhat.com/~rjones Read my programming and virtualization blog: http://rwmj.wordpress.com Fedora Windows cross-compiler. Compile Windows programs,

Re: [Libguestfs] nbdkit blocksize filter, read-modify-write, and concurrency

2022-05-24 Thread Richard W.M. Jones
On Tue, May 24, 2022 at 09:01:28AM -0500, Eric Blake wrote: > On Sat, May 21, 2022 at 01:21:11PM +0100, Nikolaus Rath wrote: > > Hi, > > > > How does the blocksize filter take into account writes that end-up > > overlapping due to read-modify-write cycles? > > > > Specifically, suppose there

[Libguestfs] [PATCH nbdkit v2 4/5] docs: Fix POD verbatim paragraphs

2022-05-24 Thread Richard W.M. Jones
POD verbatim paragraphs are introduced by a line starting with whitespace and continue to the next line containing only whitespace (or empty). In the output they appear as preformatted text (like in HTML). We use them extensively, but also as it turns out, wrongly. I previously assumed that

[Libguestfs] [PATCH nbdkit v2 5/5] docs: Enhance podwrapper to detect trailing whitespace

2022-05-24 Thread Richard W.M. Jones
Now that trailing whitespace should no longer appear in POD files, enhance podwrapper to detect this and error out. I had to modify podwrapper so it doesn't introduce trailing whitespace when it encounters a blank line in a --verbatim include. Acked-by: Laszlo Ersek Acked-by: Eric Blake ---

[Libguestfs] [PATCH nbdkit v2 3/5] docs: Remove trailing whitespace from POD file

2022-05-24 Thread Richard W.M. Jones
Fixes: commit 7d96ec5136c778e54fa27c70b2ca4b4f1456a706 --- docs/nbdkit-release-notes-1.16.pod | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/nbdkit-release-notes-1.16.pod b/docs/nbdkit-release-notes-1.16.pod index 7e8d76fa..5334e33b 100644 ---

[Libguestfs] [PATCH nbdkit v2 1/5] docs: Fix whitespace to logically group C code examples together

2022-05-24 Thread Richard W.M. Jones
Logically group the C code examples together into a single verbatim section. Note that a following commit will correct this one. Fixes: commit 4ca66f70a5865efbad67d719ba84950ddafefc01 Fixes: commit d4c58f93d0589c522d5a3422e61ba7fde1c64255 Thanks: Laszlo Ersek --- docs/nbdkit-filter.pod | 4 ++--

[Libguestfs] [PATCH nbdkit v2 0/5] docs: Fix POD verbatim paragraphs

2022-05-24 Thread Richard W.M. Jones
v1 was here: https://listman.redhat.com/archives/libguestfs/2022-May/thread.html#28934 v2: - Patches 1-3 are new. They fix verbatim grouping and whitespace in existing documentation. - Patch 4 (was patch 1): I fixed the Perl script since it didn't work if you had multiple adjacent

[Libguestfs] [PATCH nbdkit v2 2/5] rust: Logically group example code

2022-05-24 Thread Richard W.M. Jones
Fixes: commit 666ec24437932b27b393f7670ec0ecc5f11550bc Thanks: Laszlo Ersek --- plugins/rust/nbdkit-rust-plugin.pod | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/plugins/rust/nbdkit-rust-plugin.pod b/plugins/rust/nbdkit-rust-plugin.pod index 9e3ef10e..ff9d9c09 100644 ---

Re: [Libguestfs] SELinux relabeling: do it by default

2022-05-24 Thread Richard W.M. Jones
On Tue, May 24, 2022 at 03:59:24PM +0200, Laszlo Ersek wrote: > On 05/24/22 12:04, Richard W.M. Jones wrote: > > So I didn't realise that these commits break --selinux-relabel, eg: > > > > $ rpm -q guestfs-tools > > guestfs-tools-1.49.1-1.fc37.x86_64 > > $ virt-bu

Re: [Libguestfs] [PATCH nbdkit 1/2] docs: Fix POD verbatim paragraphs

2022-05-24 Thread Richard W.M. Jones
FYI I found a few other mistakes, and a mistake in the perl script, so v2 definitely incoming ... Rich. -- Richard Jones, Virtualization Group, Red Hat http://people.redhat.com/~rjones Read my programming and virtualization blog: http://rwmj.wordpress.com libguestfs lets you edit virtual

Re: [Libguestfs] [PATCH nbdkit 1/2] docs: Fix POD verbatim paragraphs

2022-05-24 Thread Richard W.M. Jones
On Tue, May 24, 2022 at 03:20:19PM +0200, Laszlo Ersek wrote: > > @@ -118,7 +118,7 @@ that the filter wants to intercept. > > .config= myfilter_config, > > /* etc */ > > }; > > - > > + > > NBDKIT_REGISTER_FILTER(filter) > > > > The C<.name> field is the name of the

Re: [Libguestfs] SELinux relabeling: do it by default

2022-05-24 Thread Richard W.M. Jones
On Tue, May 24, 2022 at 11:04:49AM +0100, Richard W.M. Jones wrote: > So I didn't realise that these commits break --selinux-relabel, eg: > > $ rpm -q guestfs-tools > guestfs-tools-1.49.1-1.fc37.x86_64 > $ virt-builder fedora-36 --selinux-relabel > virt-builder: unrecognized

Re: [Libguestfs] SELinux relabeling: do it by default

2022-05-24 Thread Richard W.M. Jones
So I didn't realise that these commits break --selinux-relabel, eg: $ rpm -q guestfs-tools guestfs-tools-1.49.1-1.fc37.x86_64 $ virt-builder fedora-36 --selinux-relabel virt-builder: unrecognized option '--selinux-relabel' Try ‘virt-builder --help’ or consult virt-builder(1) for more information.

Re: [Libguestfs] Erro libguestfs missing shared libraries: libpcre2-8.so.0

2022-05-23 Thread Richard W.M. Jones
On Mon, May 23, 2022 at 10:32:16AM +0200, Attilio Greco wrote: > mkdir: error while loading shared libraries: libpcre2-8.so.0: cannot > open shared object file: No such file or directory This error is weird. What's the output of: rpm -q coreutils pcre2 ldd /usr/bin/mkdir rpm -qf

Re: [Libguestfs] [PATCH libguestfs] build: When parsing distro from /etc/os-release, try $ID_LIKE first

2022-05-23 Thread Richard W.M. Jones
On Sun, May 22, 2022 at 06:41:14PM +0100, Richard W.M. Jones wrote: > The current code for working out the distro uses the ID entry from > /etc/os-release, and then we map those strings into a smaller set of > values (basically, what package manager to use). However it was > sugge

[Libguestfs] [PATCH libguestfs] build: When parsing distro from /etc/os-release, try $ID_LIKE first

2022-05-22 Thread Richard W.M. Jones
The current code for working out the distro uses the ID entry from /etc/os-release, and then we map those strings into a smaller set of values (basically, what package manager to use). However it was suggested that we should try ID_LIKE first so that distros which act like other distros would

Re: [Libguestfs] nbdkit blocksize filter, read-modify-write, and concurrency

2022-05-22 Thread Richard W.M. Jones
On Sat, May 21, 2022 at 05:37:10PM +0100, Nikolaus Rath wrote: > On May 21 2022, "Richard W.M. Jones" wrote: > > On Sat, May 21, 2022 at 01:21:11PM +0100, Nikolaus Rath wrote: > >> Hi, > >> > >> How does the blocksize filter take into account writes t

Re: [Libguestfs] nbdkit blocksize filter, read-modify-write, and concurrency

2022-05-21 Thread Richard W.M. Jones
On Sat, May 21, 2022 at 01:21:11PM +0100, Nikolaus Rath wrote: > Hi, > > How does the blocksize filter take into account writes that end-up > overlapping due to read-modify-write cycles? > > Specifically, suppose there are two non-overlapping writes handled > by two different threads, that, due to

[Libguestfs] [PATCH nbdkit 2/2] docs: Enhance podwrapper to detect trailing whitespace

2022-05-21 Thread Richard W.M. Jones
Now that trailing whitespace should no longer appear in POD files, enhance podwrapper to detect this and error out. I had to modify podwrapper so it doesn't introduce trailing whitespace when it encounters a blank line in a --verbatim include. I also fixed an instance of unwanted trailing

[Libguestfs] [PATCH nbdkit 1/2] docs: Fix POD verbatim paragraphs

2022-05-21 Thread Richard W.M. Jones
POD verbatim paragraphs are introduced by a line starting with whitespace and continue to the next line containing only whitespace (or empty). In the output they appear as preformatted text (like in HTML). We use them extensively, but also as it turns out, wrongly. I previously assumed that

[Libguestfs] [PATCH nbdkit 0/2] docs: Fix POD verbatim paragraphs

2022-05-21 Thread Richard W.M. Jones
Fix POD verbatim paragraphs in nbdkit, per discussion last week. If this is right, I'll roll out something similar to other projects. Rich. ___ Libguestfs mailing list Libguestfs@redhat.com https://listman.redhat.com/mailman/listinfo/libguestfs

Re: [Libguestfs] Erro libguestfs missing shared libraries: libpcre2-8.so.0

2022-05-21 Thread Richard W.M. Jones
On Sat, May 21, 2022 at 10:55:00AM +0100, Richard W.M. Jones wrote: > On Fri, May 20, 2022 at 12:45:20PM +0200, Attilio Greco wrote: > > Hi all, > > I'm hitting an error during disk resize. > > > > Pakage is installed via repo pakage info: > > libguestfs.x86_64

Re: [Libguestfs] Erro libguestfs missing shared libraries: libpcre2-8.so.0

2022-05-21 Thread Richard W.M. Jones
On Fri, May 20, 2022 at 12:45:20PM +0200, Attilio Greco wrote: > Hi all, > I'm hitting an error during disk resize. > > Pakage is installed via repo pakage info: > libguestfs.x86_64 1:1.48.1-1.fc35 > @updates > > Disrtro info: > > lsb_release -a > LSB

Re: [Libguestfs] [PATCH v2] docs: Add extra permission needed for non-admin download with VMware 7

2022-05-19 Thread Richard W.M. Jones
On Thu, May 19, 2022 at 01:27:38PM +0200, Laszlo Ersek wrote: > On 05/19/22 12:52, Richard W.M. Jones wrote: > > From: Ming Xie > > > > Fixes: https://bugzilla.redhat.com/show_bug.cgi?id=1817050 > > --- > > docs/virt-v2v-input-vmware.pod | 6 -- > &

Re: [Libguestfs] [PATCH] docs: Add extra permission needed for non-admin download with VMware 7

2022-05-19 Thread Richard W.M. Jones
On Thu, May 19, 2022 at 12:29:36PM +0200, Laszlo Ersek wrote: > On 05/19/22 10:52, Richard W.M. Jones wrote: > > From: Ming Xie > > > > Fixes: https://bugzilla.redhat.com/show_bug.cgi?id=1817050 > > --- > > docs/virt-v2v-input-vmware.pod | 1 + > > 1 fil

[Libguestfs] [PATCH v2] docs: Add extra permission needed for non-admin download with VMware 7

2022-05-19 Thread Richard W.M. Jones
From: Ming Xie Fixes: https://bugzilla.redhat.com/show_bug.cgi?id=1817050 --- docs/virt-v2v-input-vmware.pod | 6 -- 1 file changed, 4 insertions(+), 2 deletions(-) diff --git a/docs/virt-v2v-input-vmware.pod b/docs/virt-v2v-input-vmware.pod index ab2d28e41f..bccf0f7490 100644 ---

Re: [Libguestfs] ovirt VM image to BM

2022-05-19 Thread Richard W.M. Jones
On Thu, May 19, 2022 at 12:25:53PM +0200, Laszlo Ersek wrote: > On 05/18/22 15:30, Richard W.M. Jones wrote: > > But the keyboard doesn't work. This is also surprising because I > > *thought* that both virt and baremetal basically use emulated or real > > USB keyboard t

Re: [Libguestfs] [v2v PATCH 1/2] docs/*.pod: strip trailing space characters

2022-05-19 Thread Richard W.M. Jones
On Thu, May 19, 2022 at 11:57:21AM +0200, Laszlo Ersek wrote: > On 05/18/22 12:04, Richard W.M. Jones wrote: > > On Wed, May 18, 2022 at 08:49:29AM +0200, Laszlo Ersek wrote: > >> Remove any space characters that directly precede a newline character. > >> > >> B

[Libguestfs] [PATCH] docs: Add extra permission needed for non-admin download with VMware 7

2022-05-19 Thread Richard W.M. Jones
From: Ming Xie Fixes: https://bugzilla.redhat.com/show_bug.cgi?id=1817050 --- docs/virt-v2v-input-vmware.pod | 1 + 1 file changed, 1 insertion(+) diff --git a/docs/virt-v2v-input-vmware.pod b/docs/virt-v2v-input-vmware.pod index ab2d28e41f..60cff93994 100644 ---

Re: [Libguestfs] [PATCH] git: Add 'git-publish' config file

2022-05-18 Thread Richard W.M. Jones
Thanks - I pushed both patches. Now to see if I can remember how to update the website ... Rich. -- Richard Jones, Virtualization Group, Red Hat http://people.redhat.com/~rjones Read my programming and virtualization blog: http://rwmj.wordpress.com virt-p2v converts physical machines to

Re: [Libguestfs] ovirt VM image to BM

2022-05-18 Thread Richard W.M. Jones
On Wed, May 18, 2022 at 01:56:36PM +0100, Richard W.M. Jones wrote: > > On Wed, May 18, 2022 at 01:20:27PM +0200, Guilherme De Oliveira Santos wrote: > > Greetings masters, > > > > I got pointed to you guys as experts on smtg I'm struggling with. > > I'm trying

Re: [Libguestfs] ovirt VM image to BM

2022-05-18 Thread Richard W.M. Jones
On Wed, May 18, 2022 at 01:20:27PM +0200, Guilherme De Oliveira Santos wrote: > Greetings masters, > > I got pointed to you guys as experts on smtg I'm struggling with. > I'm trying to move an ovirt vm raw image to a bm machine and though [bm = baremetal] > I could do it successfully using dd

Re: [Libguestfs] [v2v PATCH 2/2] -i vmx -it ssh: document percent encoding in ssh URIs in more detail

2022-05-18 Thread Richard W.M. Jones
acters|https://en.wikipedia.org/wiki/Percent-encoding#Reserved_characters> > +that you find in the individual pathname components. For example, space > +characters must be specified as C<%20>: > + > + /vmfs/volumes/datastore1/my%20guest/my%20guest.vmx > + > +R

Re: [Libguestfs] [v2v PATCH 1/2] docs/*.pod: strip trailing space characters

2022-05-18 Thread Richard W.M. Jones
On Wed, May 18, 2022 at 08:49:29AM +0200, Laszlo Ersek wrote: > Remove any space characters that directly precede a newline character. > > Bugzilla: https://bugzilla.redhat.com/show_bug.cgi?id=1938954 > Signed-off-by: Laszlo Ersek > --- > > Notes: > I've verified in the rendered HTMLs that

Re: [Libguestfs] [libguestfs PATCH] guestfs.pod: document encrypted RBD disk limitation

2022-05-18 Thread Richard W.M. Jones
//bugzilla.redhat.com/2033247>. > + > =head3 FTP, HTTP AND TFTP Seems fine. I had to look at perlpod(1) to check that the piped L<> references were correct, but they seem to be! Acked-by: Richard W.M. Jones Rich. -- Richard Jones, Virtualization Group, Red Hat http://people.redha

Re: [Libguestfs] [PATCH v2v 2/2] convert: Remove /dev/mapper/osprober-* devices left around by grub2

2022-05-17 Thread Richard W.M. Jones
Thanks - upstream in: https://github.com/libguestfs/virt-v2v/commit/4ad661b545f476f8dfa00f3cdc28be01f6cc0510 https://github.com/libguestfs/virt-v2v/commit/e06cf5b5dcbfd3f0a798eaf75c8778502c9e3bc6 Rich. -- Richard Jones, Virtualization Group, Red Hat http://people.redhat.com/~rjones Read my

Re: [Libguestfs] [PATCH v2v 2/2] convert: Remove /dev/mapper/osprober-* devices left around by grub2

2022-05-17 Thread Richard W.M. Jones
On Tue, May 17, 2022 at 01:10:32PM +0200, Laszlo Ersek wrote: > On 05/17/22 12:59, Richard W.M. Jones wrote: > > These devices can be left around by grub2 when it runs the osprober > > tool after we run “/sbin/grub2-mkconfig -o /boot/grub2/grub.cfg”. > > They are read-onl

Re: [Libguestfs] [PATCH v2v 2/2] convert: Remove /dev/mapper/osprober-* devices left around by grub2

2022-05-17 Thread Richard W.M. Jones
On Tue, May 17, 2022 at 11:59:26AM +0100, Richard W.M. Jones wrote: > Still testing this one as well ... The version (with rm) fixes the bug for me. Rich. -- Richard Jones, Virtualization Group, Red Hat http://people.redhat.com/~rjones Read my programming and virtualization blog: h

Re: [Libguestfs] [PATCH] daemon: In list_filesystems ignore /dev/mapper/osprober-* devices

2022-05-17 Thread Richard W.M. Jones
On Tue, May 17, 2022 at 11:20:32AM +0100, Richard W.M. Jones wrote: > Still running virt-v2v to test this one ... Whether or not we still want to go with this, I have now tested this version and it works for me. Rich. -- Richard Jones, Virtualization Group, Red Hat http://people.redhat.

Re: [Libguestfs] [PATCH v2v 2/2] convert: Remove /dev/mapper/osprober-* devices left around by grub2

2022-05-17 Thread Richard W.M. Jones
On Tue, May 17, 2022 at 01:10:32PM +0200, Laszlo Ersek wrote: > On 05/17/22 12:59, Richard W.M. Jones wrote: > > These devices can be left around by grub2 when it runs the osprober > > tool after we run “/sbin/grub2-mkconfig -o /boot/grub2/grub.cfg”. > > They are read-onl

Re: [Libguestfs] [PATCH nbdkit] s3: Only run the tests if boto3 is installed

2022-05-17 Thread Richard W.M. Jones
On Tue, May 17, 2022 at 12:50:53PM +0200, Laszlo Ersek wrote: > On 05/17/22 12:11, Richard W.M. Jones wrote: > > > > OK I see what's going on. > > > > test-S3.sh uses the mocked boto3 in tests/test-S3/ to do an end-to-end > > test (nbdcopy). > > > &g

[Libguestfs] [PATCH v2v 2/2] convert: Remove /dev/mapper/osprober-* devices left around by grub2

2022-05-17 Thread Richard W.M. Jones
These devices can be left around by grub2 when it runs the osprober tool after we run “/sbin/grub2-mkconfig -o /boot/grub2/grub.cfg”. They are read-only mirrors of existing filesystems. These confuse later steps in conversion, specifically fstrim. Reported-by: Ming Xie Fixes:

[Libguestfs] [PATCH v2v 2/2] convert: Remove /dev/mapper/osprober-* devices left around by grub2

2022-05-17 Thread Richard W.M. Jones
Still testing this one as well ... Rich. ___ Libguestfs mailing list Libguestfs@redhat.com https://listman.redhat.com/mailman/listinfo/libguestfs

<    7   8   9   10   11   12   13   14   15   16   >