On Wed, Jul 5, 2017 at 10:02 AM, Yaniv Kaul <[email protected]> wrote:
> > > On Wed, Jul 5, 2017 at 9:39 AM, Irit Goihman <[email protected]> wrote: > >> https://gerrit.ovirt.org/#/c/78536 was indeed the offending patch, the >> change was reverted and OST should pass now. >> > > - Do we know why? > - O-S-T seems to be a great tool for finding JSON-RPC/STOMP issues. I > suggest running it on every change related to these. > In addition, if we have collectd installed now, can't we add a test that will check if CPU/Memory consumption spike above the normal and fail before it reach actions like vm run/migration? > > Y. > > >> >> On Tue, Jul 4, 2017 at 5:19 PM, Eyal Edri <[email protected]> wrote: >> >>> Guys, >>> >>> I think we proved which vdsm works ( git sha1: 28558d7 ) and what was >>> the changelog since until the point it fails, so you have the list of >>> changes and steps to reproduce locally. >>> Which again, is reproducible on CI and locally, so please go over the >>> changes done or reproduce the problem locally and see the issue on a live >>> system. >>> >>> >>> >>> >>> >>> On Tue, Jul 4, 2017 at 5:07 PM, Piotr Kliczewski < >>> [email protected]> wrote: >>> >>>> Looking at the last experimental job the reason of the failure is: >>>> >>>> 2017-07-04 09:39:10,491-04 ERROR [org.ovirt.engine.api.restapi. >>>> resource.AbstractBackendResource] (default task-18) [] Operation >>>> Failed: [Cannot run VM. There is no host that satisfies current scheduling >>>> constraints. See below for details:, The host lago-basic-suite-master-host0 >>>> did not satisfy internal filter CPUOverloaded because its CPU is too >>>> loaded.] >>>> >>>> Do we think that vdsm increased its cpu consumption recently? >>>> >>>> On Tue, Jul 4, 2017 at 3:54 PM, Irit Goihman <[email protected]> >>>> wrote: >>>> >>>>> I've checked vdsm logs and couldn't find anything related to my change. >>>>> I'll run OST without my changes and see if it runs successfully. >>>>> >>>>> On Tue, Jul 4, 2017 at 4:49 PM, Eyal Edri <[email protected]> wrote: >>>>> >>>>>> >>>>>> >>>>>> On Tue, Jul 4, 2017 at 4:29 PM, Dafna Ron <[email protected]> wrote: >>>>>> >>>>>>> This issue is reproduced locally as well. >>>>>>> >>>>>>> you can run the following to reproduce locally >>>>>>> >>>>>>> ./run_suite.sh -s http://jenkins.ovirt.org/job/v >>>>>>> dsm_master_build-artifacts-el7-x86_64/2694/ basic-suite-master >>>>>>> >>>>>>> you will have the environment still running which would allow to >>>>>>> view the live environment. >>>>>>> if you have any issues please ping me and I will help any way I can. >>>>>>> >>>>>>> Thanks, >>>>>>> Dafna >>>>>>> >>>>>>> >>>>>>> >>>>>> Here is the list of changes done from the vdsm that is verified ( in >>>>>> tested now ) to HEAD: >>>>>> >>>>>> * 74b2276 - (HEAD -> master, origin/master, origin/HEAD) stomp: add >>>>>> integration tests for client reconnect (6 hours ago) Irit Goihman < >>>>>> [email protected]> >>>>>> * 2a2f6cd - stomp: set default heartbeat values and add grace period >>>>>> (6 hours ago) Irit Goihman <[email protected]> >>>>>> * 56c306a - tests: Make random uuid test repeatable (17 hours ago) >>>>>> Nir Soffer <[email protected]> >>>>>> * 864d4e3 - python3: Fix UUID packing/unpacking on python 3 (17 hours >>>>>> ago) Nir Soffer <[email protected]> >>>>>> * 4ac4221 - python3: Improve uuid packing tests (17 hours ago) Nir >>>>>> Soffer <[email protected]> >>>>>> * d264c8d - python3: Run misc_test in python 3 (17 hours ago) Nir >>>>>> Soffer <[email protected]> >>>>>> * f923b0b - storage: Added disk type change logging (18 hours ago) >>>>>> Denis Chaplygin <[email protected]> >>>>>> * f1d54a1 - net: Unneeded newline is added when updating only the mtu >>>>>> (25 hours ago) Edward Haas <[email protected]> >>>>>> * 9056d61 - virt: metadata: remove dead code (26 hours ago) Francesco >>>>>> Romani <[email protected]> >>>>>> * 08982b4 - virt: network: use core.find_device_guest_address (31 >>>>>> hours ago) Francesco Romani <[email protected]> >>>>>> * 62e2bc5 - python3: Run qcow2_test on python 3 (2 days ago) Nir >>>>>> Soffer <[email protected]> >>>>>> * 42f5efb - stomp: implement client reconnect (2 days ago) Irit >>>>>> Goihman <[email protected]> >>>>>> >>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> On 07/04/2017 01:35 PM, Barak Korren wrote: >>>>>>> >>>>>>> >>>>>>> >>>>>>> On 4 July 2017 at 14:32, Irit Goihman <[email protected]> wrote: >>>>>>> >>>>>>>> https://gerrit.ovirt.org/#/c/78536 broke network functional tests >>>>>>>> but a fix was merged today: https://gerrit.ovirt.org/#/c/78925/ >>>>>>>> >>>>>>>> I tried to run OST with my fix yesterday and still encountered the >>>>>>>> same failures. >>>>>>>> >>>>>>> >>>>>>> Here is a reproducer of the failure with the fix patch: >>>>>>> http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/1061/ >>>>>>> >>>>>>> So that was not it probably... >>>>>>> >>>>>>> >>>>>>> -- >>>>>>> Barak Korren >>>>>>> RHV DevOps team , RHCE, RHCi >>>>>>> Red Hat EMEA >>>>>>> redhat.com | TRIED. TESTED. TRUSTED. | redhat.com/trusted >>>>>>> >>>>>>> >>>>>>> _______________________________________________ >>>>>>> Devel mailing >>>>>>> [email protected]http://lists.ovirt.org/mailman/listinfo/devel >>>>>>> >>>>>>> >>>>>>> >>>>>>> _______________________________________________ >>>>>>> Devel mailing list >>>>>>> [email protected] >>>>>>> http://lists.ovirt.org/mailman/listinfo/devel >>>>>>> >>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> >>>>>> Eyal edri >>>>>> >>>>>> >>>>>> ASSOCIATE MANAGER >>>>>> >>>>>> RHV DevOps >>>>>> >>>>>> EMEA VIRTUALIZATION R&D >>>>>> >>>>>> >>>>>> Red Hat EMEA <https://www.redhat.com/> >>>>>> <https://red.ht/sig> TRIED. TESTED. TRUSTED. >>>>>> <https://redhat.com/trusted> >>>>>> phone: +972-9-7692018 <+972%209-769-2018> >>>>>> irc: eedri (on #tlv #rhev-dev #rhev-integ) >>>>>> >>>>> >>>>> >>>>> >>>>> -- >>>>> >>>>> IRIT GOIHMAN >>>>> >>>>> SOFTWARE ENGINEER >>>>> >>>>> EMEA VIRTUALIZATION R&D >>>>> >>>>> Red Hat EMEA <https://www.redhat.com/> >>>>> >>>>> <https://red.ht/sig> >>>>> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted> >>>>> @redhatnews <https://twitter.com/redhatnews> Red Hat >>>>> <https://www.linkedin.com/company/red-hat> Red Hat >>>>> <https://www.facebook.com/RedHatInc> >>>>> >>>>> _______________________________________________ >>>>> Devel mailing list >>>>> [email protected] >>>>> http://lists.ovirt.org/mailman/listinfo/devel >>>>> >>>> >>>> >>> >>> >>> -- >>> >>> Eyal edri >>> >>> >>> ASSOCIATE MANAGER >>> >>> RHV DevOps >>> >>> EMEA VIRTUALIZATION R&D >>> >>> >>> Red Hat EMEA <https://www.redhat.com/> >>> <https://red.ht/sig> TRIED. TESTED. TRUSTED. >>> <https://redhat.com/trusted> >>> phone: +972-9-7692018 <+972%209-769-2018> >>> irc: eedri (on #tlv #rhev-dev #rhev-integ) >>> >> >> >> >> -- >> >> IRIT GOIHMAN >> >> SOFTWARE ENGINEER >> >> EMEA VIRTUALIZATION R&D >> >> Red Hat EMEA <https://www.redhat.com/> >> >> <https://red.ht/sig> >> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted> >> @redhatnews <https://twitter.com/redhatnews> Red Hat >> <https://www.linkedin.com/company/red-hat> Red Hat >> <https://www.facebook.com/RedHatInc> >> >> _______________________________________________ >> Devel mailing list >> [email protected] >> http://lists.ovirt.org/mailman/listinfo/devel >> > > -- Eyal edri ASSOCIATE MANAGER RHV DevOps EMEA VIRTUALIZATION R&D Red Hat EMEA <https://www.redhat.com/> <https://red.ht/sig> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted> phone: +972-9-7692018 irc: eedri (on #tlv #rhev-dev #rhev-integ)
_______________________________________________ Devel mailing list [email protected] http://lists.ovirt.org/mailman/listinfo/devel
