Lucas, It will be 4:40 my time so I will skip this time;
Few generic comments: 1) Reservations: we are planning to add time based components so they will optionally kick in/release at appointed time, let me know what other pieces would be useful and are missing 2) > Our next challenge will be to tackle how to make the autotest server more resilient against failures, such as:... This is great; In addition to what you state, we have something concrete in that area: our team is facing immediate problem - when default cobbler profile is messed up system cannot be repaired and it will be in 'Repair failed' state forever - likely pull request coming your way 3) We would like to have ability to define proper autotest add-on that will have some db, some django code and front end, just like TCM; To do that properly there are few changes to basic framework that would make it easier. If we do that ground work we have some add ons that we can can push upstream. Julius -----Original Message----- From: [email protected] [mailto:[email protected]] On Behalf Of Lucas Meneghel Rodrigues Sent: Wednesday, May 08, 2013 2:36 PM To: [email protected]; Virt Test Development Mailing List; Cleber Rosa; Christopher Evich; Ademar Reis; Jiri Zupka; Lukas Doktor Subject: Re: [Virt-test-devel] Autotest Weekly hangout 05-08-2013 On 08/05/13 06:34 PM, Lucas Meneghel Rodrigues wrote: > Meeting time: date -d '2013-05-08 11:30 UTC' > > Google Plus event: > https://plus.google.com/u/0/events/ci24prs1ge52084pds31eno633o The URL was updated: https://plus.google.com/u/0/events/cgbari9iqep39ach54hfllskmq4 > Following our first hangout, that was mostly successful, we'll keep on > making these meetings, on a weekly basis (with some exceptions, when > we'll skip the meeting on a given week we'll let you guys know). > > Highlights > > The past few weeks have been very intense in patches from the KVM QE > team (Beijing based). The patches are part of a concentrated effort to > sync the tree used by that team with upstream. We can barely give > attention to other areas, but after this merge is done, we'll work on > ways to make an autotest based KVM test grid more robust. In fact, we > want to hear your ideas about how to make it happen. > > Commits on next - autotest > > We have now a new reservation feature for autotest, made by Julius, > from HP, that still needs to have some polish > > and an assortment of cleanups made by Ross Brattain, from intel. > > Cleber Rosa (2): > profilers: add inotify profiler > utils/test_importer.py: simple style fixes > > Julius Gawlas (10): > frontend/afe/models.py: improvements to > check_for_acl_violation_hosts() > frontend/afe/reservations.py: utilities for reserve/release > frontend/afe/rpc_interface.py: add host reserve/release functions > host reservations: add a java utility wrapper for > reserving/releasing hosts > host reservations: UI changes for static reservations > host reservations: added "Reserve Hosts" checkbox to create job page > host reservations: added field representing if user requested > reservation > host reservations: implement reservation in scheduler > host reservations: added --reserve_hosts option to create job CLI > host reservations: changed scheduler models to use explicit > field names > > Ross Brattain (12): > base_sysinfo: add dmidecode to sysinfo, use lspci -vvnn to get > both name and PCI device ID in output > logging_manager: Implement LoggingFile.isatty() for > completeness, return False > logging_manager: Implement LoggingFile.writelines() > base_utils: use platform.machine() instead of uname -m > base_utils: Use os.uname()[2] to return the release name, > instead of calling uname -r > base_utils: Remove semicolons and unecessary \. > base_utils: Remove unused param _stats. > job: Convert optional_fields to dict literal. > base_packages: host will not be defined in the else clause. > This should have been hostline > base_packages: s/insall/install > ConfigParser.write() requires a file object instead of a path > version.py: __all__ must be a sequence of strings if defined > > Commits on next - virt-tests > > Since the latest release (04/12), there's a pretty large patch queue > (a whooping 198 patches), mostly result of large volume of patches > introducing new functionality in the core virt test libraries, as well > as new tests. > > Amos Kong (1): > virttest.utils_test: Ignore Monitor exception > > Chen Cao (3): > virttest.utils_test: Add fix_atest_cmd() to utils_test > virttest.utils_test: Add get_svr_session() > virttest.qemu_vm: update command line for add_nic > > Chris Evich (5): > virt: Ignore vim swap files > virt-libvirt: Add fakeroot as recommended program > virt: Add OpenSUSE 12.3 x86_64 config. > virt: Fix legacy driver_type 'kvm' use > virt: Unattended_install bugfix > > Cleber Rosa (1): > qemu_vm.py: increase the vm creation timeout > > Feng Yang (18): > virttest.utils_net: Convert windows format ip to linux ip > format in update_mac_ip_address > utils_misc: Update vendor name used in cpu_types > virt: Add Des help class in RFBDes.py > qemu.tests: Add vnc test script > virttest.env_process: Support image backup, restore before and > after testing. > virttest.test_setup: Update iptables command in PrivateBridgeConfig. > virttest.qemu_io: qemu_io.py use correct qemu_io link in qemu_io_cmd > virttest.qemu_storage: Add error.context in create() function > virttest.qemu_storage: Support -t parameter in commit, rebase, > convert function > qemu: Add eject_media test case > virttest.qemu_monitor: Make send_args_cmd return output in list > if multi command used > virttest.qemu_monitor: Update send_args_cmd command. > virttest.utils_test: Add BackgroundTest class back. > virttest.utils_test: Log status if migration end status is not > finish or fail. > virttest.qemu_vm: quick fix to make spice work on rhel5 host > virttest.qemu_vm: Check machine type available before using it > virttest.qemu_vm: Use string in monitor.migrate_set_speed > function call > config: Add unattended_install's RHEL guest side config to > check_block_size sub case. > > Golita Yue (2): > virttest.qemu_vm: Add 'vhost' parameter instead of > 'netdev_extra_params' > virttest.qemu_vm: Fix use the duplicated index in cmd > > Jiří Župka (4): > virt: qemu adds missing virt_test_type. > virt: Repairs config syntax > virt: Adds support for multi-host migration of system without > serial console. > virt: Adds multihost migration test for floppy ejecting. > > Li Yang (3): > libvirt: Add test module for virsh {at|de}tach-disk > virt: Modify virsh function for virsh {at|de}tach-disk > virt: Add get_disk_count() for virsh {at|de}tach-disk > > Lucas Meneghel Rodrigues (10): > run: Introduce --use-malloc-perturb specific qemu flag > qemu_storage: Stop ignoring failures creating VM images > qemu_storage: Be lenient and fix a missing parent image dir > Fix a couple of indentation problems found during check script run > virttest API: Introduce version module > standalone_test/virt: Add virt test information to test logs > version: Make it compatible with autotest 0.14 > virttest.test_setup: Adding framework code to control bridge > creation > virttest.test_setup: Add more flexible way to specify comm > ports host -> guest > standalone_test: Add profdir member to Test class > > Lukáš Doktor (5): > tests.virtio_console: Add boot_nr1 test > standalone_test: Fix TAG_INDEX problem > virttest.funcatexit: Prevent weird errors while storing nasty args > virttest.funcatexit: Prevent weird errors while storing nasty > functions > virt and standalone_test: Raise TestWarn when funcatexit fails > > Mike Qiu (8): > qemu.tests.cgroup:modify the way to calculate the cpu counts > qemu.tests.time_manage:Fixed VM names error > qemu.tests.enospc: Fixed 'fuser -k' failed bug > virt.qemu.tests.nic_bonding:Fix vm.netdev_id error > virt:Make the clock_getres to support POWER guest > virttest.utils_misc:Fix return value to list for ppc64 > virt.qemu.enospc:Fix the image_name change errors > virttest.base_installer: Fix the module_list errors > > Qingtang Zhou (72): > run: Add missing argument for disk_bus > virt.qemu_vm: Add more info to ImageUnbootableError exception > tests.cfg: Limit save_restore test on Linux guest > qemu.tests.physical_resource_check: Update memory check pattern > shared.cfg.guest-os: Add config for RHEL-6.4 guest > shared.cfg: Add config for Ubuntu-13.04 guest > shared.cfg: Show guest disk/nic/cpu/image config by default > virt.qemu_monitor: Add an API for terminating monitor connection > virt.env_process: Close monitor socket after test > virt.qemu_vm: Move get_monitor_filename(s) functions to qemu_monitor > virt.qemu_monitor: Create 2 functions for creating monitor object > virt.qemu_vm: Use monitor creation function in qemu_monitor > virt.qemu_monitor: Store qemu VM object in monitor object > qemu.tests.cfg: Enable qemu_guest_agent tests on newer Fedora host > qemu.tests.cfg: Update qemu guest agent config > qemu.tests: Fix module import problem in > qemu_guest_agent_snapshot test > qemu.tests.qemu_guest_agent: Update fsfreeze/fsthaw workflow > virt.guest_agent: Remove qemu monitor operation from this module > virt.guest_agent: Remove vm related operation in this module > virt.guest_agent: Update vm name arguments in exception classes > virt.guest_agent: Define constant for guest agent serial type > virt.guest_agent: Remove VAgentNotSupportedSerialError > qemu.tests.qemu_guest_agent: Update QemuAgent initiation code > qemu.tests.qemu_guest_agent: Fix test error message > virt.qemu_storage: Add an image_extra_params option > shared.cfg: Add qcow3 support > qemu_monitor: Add system_wakeup interface > virt.util_test: Add a new class for guest suspend test > tests.guest_s4: Update this test with new GuestSuspend class > tests: Add a new test case guest_s3 > tests: Remove test linux_s3 > virt.utils_test: Refactor GuestsuSpend class > virt.tests: Update guest s3/s4 test cases with new GuestSuspend > class > virt.cfg: Update guest_s3/guest_s4 test config > virt.cfg: Ignore exit status when checking if win guest support s3 > virt.cfg: Update balloon_check test config for S3/S4 operation > tests.clock_getres: Add sub test support fot this test > virt.cfg: guest_suspend: Add sub tests for kvmclock > qemu.tests.vnc: Separate VNC class > qemu.tests.vnc: Initiate random before using it > qemu.tests.vnc: Update log message and docstring > virttest.env_process: Fix AttributeError when nics parameter is > undefined > virt.guest_agent: Fix guest agent exception initiation problem > virt.guest_agent: Update qemu guest agent __init__ function > qemu.tests.qemu_guest_agent: Add a subtest suspend for qemu > guest agent > virt.guest_agent: Fix VAgentCmdError exception > virt.guest_agent: Add a method for sync qemu guest agent > qemu: multi_disk: Disable qtree functions on RHEL5 host > virt.cfg: Update multi_disk and usb_multi_disk's sub test name > shared.cfg: Split diskpart batch scripts into multiple lines > utils_test.file_transfer: Update test steps info > virttest.utils_test: Add get_readable_cdroms function > virttest.utils_test: Ignore exception when failing to remove > file in guest > virttest.utils_test: Workaround for creating guest result dir > virttest.virt_vm: Add support for logging via serial after > remote login fail > virttest.virt_vm: Add support for restarting guest network via > serial console > qemu.tests: cdrom.py: Add sub test support > virt.cfg: Update config files for cdrom with acpi testing > qemu.tests.cdrom: Rename get_cdrom_device > qemu.tests.cdrom: Update get_cdrom_file function > qemu.tests.cdrom: Seperate check_cdrom_tray function > qemu.tests.cdrom: Rename check_cdrom_tray to is_tray_opened > qemu.tests.cdrom: Put all subtests into functions > qemu.tests.cdrom: Fix error log message > qemu.tests.cdrom: Fix coding style problem > qemu.tests.cdrom: Update docstring and context > qemu.tests.cdrom: Rename max_times to cdrom_max_test_times > virttest.qemu_vm: Validate monitor before accessing it > virttest.qemu_vm: Add freq option to usb device > virttest.qemu_vm: Update vcpu core/thread/socket calculation code > virttest.qemu_vm: Rename defaults to "use_nodefaults" > qemu: Add new test check block size > > Shuping Cui (2): > virttest.qemu_vm: add boot_order_check support > virttest.qemu_vm: add new test check_roms support > > Suqin Huang (2): > Move cpu related functions together > Update cpu_model related in utils_misc.py > > Xiaoqing Wei (3): > Implement nmi function in monitor > Update kdump case to use vm.monitor.nmi() > move check_if_vm_vcpu_match() to utils_misc > > Xu Tian (4): > qemu: Add base libraries for new block_stream tests > qemu_monitor/qemu_vm: Introduce new block mirror APIs > qemu: Refactor and update block stream tests > qemu.tests.cdrom: make cdrom test compatible with rhel6 and > rhel7 > > Yiqiao Pu (32): > virttest.standalone_test: Bring in funcatexit to standalone_test > virttest.utils_net: move net related functions to utils_net > virttest.utils_misc: small bugs fix > virttest.bootstrap.py: Correct number_variants in > get_directory_structure > qemu.tests.cfg: Add config file for vnc test > virttest: Move verify_running_as_root to utils_misc > virttest.env_process: Do private bridge setup and clean up > virttest.test_setup: private bridge improve > virttest.test_setup: Up the physical nic after private bridge setup > virttest.test_setup: Increase the overhead of qemu process > virttest.test_setup: Small bugs fix in PciAssignable > virttest.qemu_io: Add essential_option check in qemu_io > virttest.qemu_storage: Add snapshot list cmd in kvm_storage > qemu.tests.cfg: Fix image path config for multi_disk test > virttest.qemu_monitor: Add block resize function in qemu_monitor > virttest.utils_test: Add function get_driver_hardware_id to > utils_test > virttest.utils_test: Try to login with serial port if failed to > login though net > virttest.virt_vm: Update get_memory_size > virttest.virt_vm: small bug fix > qemu.tests.cdrom: Add a cdrom locked case > qemu.tests.cfg: Add cdrom locked case in cfg files > virt.qemu_vm: Support cdrom device without iso filename > qemu.tests.cdrom: Add lock check case when media is not present > virttest.virt_vm: make pci_addr in make_create_command configurable > virttest.qemu_vm: Add start_time in create() > virttest.qemu_vm: Update the nic add and delete command line > virttest.qemu_vm: Update code for migrate.exec > virttest.qemu_vm: Update add_drive in make_create_command > virttest.qemu_vm: Take bridge scripts back > virttest.qemu_vm: Update mac address in reboot > virttest.qemu_vm: small bug fix in qemu_vm > qemu: Add qemu-img cluster size check test > > Yolkfull Chow (1): > virttest.utils_test: Add a helper function dump_command_output > > Yunping Zheng (12): > qemu: Add macvtap support > virttest.utils_misc: Smbios test support in kvm autotest > virttest.remote : make remote scp support ipv6 address > virttest.qemu_vm: fix guest's network can't work if tap dev > already exists > qemu: Add virtual nic send buffer test > virt.tests : add watchdog device test support > virttest.qemu_vm: Start guest as nobody > virtttest.utils_net: add restart nic and get nic attributes of > windows guest > qemu : add mac_change support windows > qemu : Modify configure for jumbo test support windows guest > qemu: Add iperf nic multicast test > qemu.test : add test for qemu systemtap tracing > > sshang (1): > qemu: add audio test for guest > > yangdongsheng (2): > libivrt_xml_unittest: add a unittest for ipxml in network_xml. > network_xml: fix some bugs of ip accessors in network_xml. > > yunzheng (1): > virttest.qemu_vm: modify get_vcpu_pids() to fit for different > monitor > > > Pull requests still in review > > autotest > > Unreviewed > > https://github.com/autotest/autotest/pull/626 - Component isolation. > Still needs review, will get back to it ASAP > > https://github.com/autotest/autotest/pull/643 - Simple fixes to > systemtap profiler files > > https://github.com/autotest/autotest/pull/641 - Changes in AsyncJob > > https://github.com/autotest/autotest/pull/642 - Unittests for AsyncJob > > Needs another round of review > > https://github.com/autotest/autotest/pull/629 - Beaker/Autotest > integration > > https://github.com/autotest/autotest/pull/631 - Distro detection API, > generated a bit of a controversy. I'm aiming for inclusion next week. > > virt-test > > QEMU related > > https://github.com/autotest/virt-test/pull/367 Add memory > balloon related case > https://github.com/autotest/virt-test/pull/365 virttest.qemu_qtree: > Fix a bug in check_guests_proc_scsi() > https://github.com/autotest/virt-test/pull/335 virt: New > version Cartesian config. > https://github.com/autotest/virt-test/pull/301 Distro check > test > https://github.com/autotest/virt-test/pull/274 [RFC] > Libguestfs: Add module and a simple test for guestfish. > https://github.com/autotest/virt-test/pull/269 net: add > multiqueue support (just send it out, will do more test in the weekend) > https://github.com/autotest/virt-test/pull/188 RFC: Object > representation of Qemu devices - new version out, need to review > > Libvirt related > > https://github.com/autotest/virt-test/pull/366 virttest-virsh: > Set auto_close before raise Error in init of VirshSession. > https://github.com/autotest/virt-test/pull/363 Add test for > virsh cpu-baseline > https://github.com/autotest/virt-test/pull/325 libvirt > snapshot-create-as test > https://github.com/autotest/virt-test/pull/318 Add test for > virsh domblkinfo v4 > https://github.com/autotest/virt-test/pull/316 libvirt: Add > test module for virsh update-device v4 > https://github.com/autotest/virt-test/pull/313 To test virsh > pool commands > https://github.com/autotest/virt-test/pull/311 Libvirt virsh > domif-{set,get}link test > https://github.com/autotest/virt-test/pull/298 Libvirt: Add > test for virsh net-autostart. > https://github.com/autotest/virt-test/pull/297 Add test for > virsh net-destroy v3 > https://github.com/autotest/virt-test/pull/296 Add test for > virsh net-dumpxml v4 > https://github.com/autotest/virt-test/pull/295 Add test > virsh net-uuid v3 > https://github.com/autotest/virt-test/pull/292 Libvirt xml > devices > https://github.com/autotest/virt-test/pull/290 Virsh connect > pull-request repeat. > https://github.com/autotest/virt-test/pull/287 Libvirt: > Virsh console > https://github.com/autotest/virt-test/pull/280 Libvirt: > Virsh net define undefine > https://github.com/autotest/virt-test/pull/279 Add test for > virsh blockcopy > https://github.com/autotest/virt-test/pull/264 Virsh attach > detach interface > > Making an autotest grid more robust - discussion > > Our next challenge will be to tackle how to make the autotest server > more resilient against failures, such as: > > * Cobbler server unavailable > * Git repos unavailable > * Brew/Koji unreachable > * Virtio-win driver bugs > * Build failures > * Test setup errors > * QEMU core dumps filling the server's disk > > As I see the problem, we'll have to isolate preparation steps from > actual testing on just about anything that might happen on a test job. > If any of you had experience on different test automation systems > (virtlab for example), please share it with us :) > > Libvirt updates > * Giving virt-test + libvirt engineering presentation @ EOM. > * Will record both sessions. > * Will try to get "okay" to post online. > * Basic introduction to writing tests + libvirt tests. > * Red Hat China QE team ramping up, many more tests will be coming in. > * Pull requests pouring in, keep it up!! > * Some "growing pains", but nothing horrible. > * Maintainership not required to comment & review (hint hint). > * libvirt_xml.devices package pull-request soon!. > * Serial & Address devices ready-to-go. > * Need help adding device-modules. > > > Questions Corner > > > TODO > > lmr: > virt-test - Work on Beijing tree - upstream merge autotest - Resume > reviews on Beaker patchset > _______________________________________________ Virt-test-devel mailing list [email protected] https://www.redhat.com/mailman/listinfo/virt-test-devel _______________________________________________ Virt-test-devel mailing list [email protected] https://www.redhat.com/mailman/listinfo/virt-test-devel
