Its running on 0.28. I think the log collecting is still done by guestfs, only we don't freeze it before(in _extract_paths_dead). As far as I checked there is no new libguestfs/etc version change in the past week, maybe we need to change to SCP only(and fallback to guestfs).
On Sun, Dec 11, 2016 at 3:20 PM, Yaniv Kaul <[email protected]> wrote: > > > On Sun, Dec 11, 2016 at 3:13 PM, Yaniv Kaul <[email protected]> wrote: >> >> >> >> On Sun, Dec 11, 2016 at 3:10 PM, Shlomo Ben David <[email protected]> >> wrote: >>> >>> Hi, >>> >>> The [1] job fails with the following errors: >>> >>> 12:34:20 [31mError while running thread >>> 12:34:20 Traceback (most recent call last): >>> 12:34:20 File "/usr/lib/python2.7/site-packages/lago/utils.py", line >>> 55, in _ret_via_queue >>> 12:34:20 queue.put({'return': func()}) >>> 12:34:20 File "/usr/lib/python2.7/site-packages/lago/prefix.py", line >>> 1108, in _collect_artifacts >>> 12:34:20 vm.collect_artifacts(path) >>> 12:34:20 File "/usr/lib/python2.7/site-packages/lago/plugins/vm.py", >>> line 461, in collect_artifacts >>> 12:34:20 ) for guest_path in self._artifact_paths() >>> 12:34:20 File "/usr/lib/python2.7/site-packages/lago/plugins/vm.py", >>> line 307, in extract_paths >>> 12:34:20 return self.provider.extract_paths(paths, *args, **kwargs) >>> 12:34:20 File "/usr/lib/python2.7/site-packages/lago/vm.py", line 196, >>> in extract_paths >>> 12:34:20 self._extract_paths_live(paths=paths) >>> 12:34:20 File "/usr/lib/python2.7/site-packages/lago/vm.py", line 417, >>> in _extract_paths_live >>> 12:34:20 self._extract_paths_dead(paths=paths) >>> 12:34:20 File "/usr/lib/python2.7/site-packages/lago/vm.py", line 432, >>> in _extract_paths_dead >>> 12:34:20 gfs_cli.launch() >>> 12:34:20 File "/usr/lib64/python2.7/site-packages/guestfs.py", line >>> 4731, in launch >>> 12:34:20 r = libguestfsmod.launch (self._o) >>> 12:34:20 RuntimeError: guestfs_launch failed. >>> 12:34:20 This usually means the libguestfs appliance failed to start or >>> crashed. >>> 12:34:20 See >>> http://libguestfs.org/guestfs-faq.1.html#debugging-libguestfs >>> 12:34:20 or run 'libguestfs-test-tool' and post the *complete* output >>> into a >>> 12:34:20 bug report or message to the libguestfs mailing list. [0m >>> 12:34:32 [36m # [Thread-1] lago-basic-suite-3-6-storage: [32mSuccess >>> [0m (in 0:00:12) [0m >>> 12:34:32 [36m # [Thread-3] lago-basic-suite-3-6-host1: [32mSuccess [0m >>> (in 0:00:13) [0m >>> 12:34:32 [36m # [Thread-2] lago-basic-suite-3-6-engine: [32mSuccess >>> [0m (in 0:00:13) [0m >>> 12:34:32 [36m@ Collect artifacts: [31mERROR [0m (in 0:00:13) [0m >>> 12:34:32 [31mError occured, aborting >>> 12:34:32 Traceback (most recent call last): >>> 12:34:32 File "/usr/lib/python2.7/site-packages/ovirtlago/cmd.py", line >>> 264, in do_run >>> 12:34:32 self.cli_plugins[args.ovirtverb].do_run(args) >>> 12:34:32 File "/usr/lib/python2.7/site-packages/lago/plugins/cli.py", >>> line 184, in do_run >>> 12:34:32 self._do_run(**vars(args)) >>> 12:34:32 File "/usr/lib/python2.7/site-packages/lago/utils.py", line >>> 489, in wrapper >>> 12:34:32 return func(*args, **kwargs) >>> 12:34:32 File "/usr/lib/python2.7/site-packages/lago/utils.py", line >>> 500, in wrapper >>> 12:34:32 return func(*args, prefix=prefix, **kwargs) >>> 12:34:32 File "/usr/lib/python2.7/site-packages/ovirtlago/cmd.py", line >>> 230, in do_ovirt_collect >>> 12:34:32 prefix.collect_artifacts(output) >>> 12:34:32 File "/usr/lib/python2.7/site-packages/lago/log_utils.py", >>> line 621, in wrapper >>> 12:34:32 return func(*args, **kwargs) >>> 12:34:32 File "/usr/lib/python2.7/site-packages/lago/prefix.py", line >>> 1112, in collect_artifacts >>> 12:34:32 self.virt_env.get_vms().values(), >>> 12:34:32 File "/usr/lib/python2.7/site-packages/lago/utils.py", line >>> 97, in invoke_in_parallel >>> 12:34:32 vt.join_all() >>> 12:34:32 File "/usr/lib/python2.7/site-packages/lago/utils.py", line >>> 55, in _ret_via_queue >>> 12:34:32 queue.put({'return': func()}) >>> 12:34:32 File "/usr/lib/python2.7/site-packages/lago/prefix.py", line >>> 1108, in _collect_artifacts >>> 12:34:32 vm.collect_artifacts(path) >>> 12:34:32 File "/usr/lib/python2.7/site-packages/lago/plugins/vm.py", >>> line 461, in collect_artifacts >>> 12:34:32 ) for guest_path in self._artifact_paths() >>> 12:34:32 File "/usr/lib/python2.7/site-packages/lago/plugins/vm.py", >>> line 307, in extract_paths >>> 12:34:32 return self.provider.extract_paths(paths, *args, **kwargs) >>> 12:34:32 File "/usr/lib/python2.7/site-packages/lago/vm.py", line 196, >>> in extract_paths >>> 12:34:32 self._extract_paths_live(paths=paths) >>> 12:34:32 File "/usr/lib/python2.7/site-packages/lago/vm.py", line 417, >>> in _extract_paths_live >>> 12:34:32 self._extract_paths_dead(paths=paths) >>> 12:34:32 File "/usr/lib/python2.7/site-packages/lago/vm.py", line 432, >>> in _extract_paths_dead >>> 12:34:32 gfs_cli.launch() >>> 12:34:32 File "/usr/lib64/python2.7/site-packages/guestfs.py", line >>> 4731, in launch >>> 12:34:32 r = libguestfsmod.launch (self._o) >>> 12:34:32 RuntimeError: guestfs_launch failed. >>> 12:34:32 This usually means the libguestfs appliance failed to start or >>> crashed. >>> 12:34:32 See >>> http://libguestfs.org/guestfs-faq.1.html#debugging-libguestfs >>> 12:34:32 or run 'libguestfs-test-tool' and post the *complete* output >>> into a >>> 12:34:32 bug report or message to the libguestfs mailing list. [0m >>> >>> >>> [1] - >>> http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_3.6/4457/consoleFull >> >> >> libguestfs issue. I wonder if we can get more out of this without enabling >> debug. >> Y. > > > Actually looking at the logs, I'm seeing it is failing when it tries to > collect logs via guestfs - which we've deprecated in[1]. > It was released as part of Lago 0.28 - are you using an older version? > Y. > > [1] https://github.com/lago-project/lago/pull/366 > Y. > >> >>> >>> >>> Best Regards, >>> >>> Shlomi Ben-David | DevOps Engineer | Red Hat ISRAEL >>> RHCSA | RHCE >>> IRC: shlomibendavid (on #rhev-integ, #rhev-dev, #rhev-ci) >>> >>> OPEN SOURCE - 1 4 011 && 011 4 1 >>> >>> _______________________________________________ >>> Devel mailing list >>> [email protected] >>> http://lists.phx.ovirt.org/mailman/listinfo/devel >> >> > > > _______________________________________________ > Devel mailing list > [email protected] > http://lists.phx.ovirt.org/mailman/listinfo/devel _______________________________________________ Devel mailing list [email protected] http://lists.phx.ovirt.org/mailman/listinfo/devel
