Hi, For the stress test demo, we have added more details. Youtube link is provided below. https://youtu.be/TPd4NZr__HI Slides deck is uploaded in the WIKI page: https://wiki.opnfv.org/display/bottlenecks/Sress+Testing+over+OPNFV+Platform
The demo contents and results are briefly summarized below. • Testing Contents • Executing Stress Test and Provide comparison results for different installers (Installer A and Installer B) • Up to 100 stacks for Installer A (Completes the test) • Up to 40 stacks for Installer B (System fails to complete the test) • Testing Steps • Enter the Bottlenecks Repo: cd /home/opnfv/bottlenecks • Prepare virtual environment: . pre_virt_env.sh • Executing ping test case: bottlenecks testcase run posca_factor_ping • Clean the virtual environment: . rm_virt_env.sh • Testing Results • Testing for Installer A • Up to 100 stacks in configuration file for Installer B • 1 stack SSH error when number of stack raised to 50 • When stack number up to 100, most of the errors are heat response time out • 100 stacks are established successfully in the end • Testing for Installer B • Up to 40 stacks in configuration file for Installer B • When stack number up to 30, the system fails to create all the stacks • 21 stacks are either created failure or keeping in creation • To verify the system performance, we choose to do clean-up and run the test again • When stack number up to 20, same situation happens as in the last test • The system performance degrades • Different to the test for Installer A, we do the verification step because the system clearly malfunctions. • Which not shown in the demo is that after 3 rounds of the stress test, the system fail even to create 5 stacks Best, Gabriel From: [email protected] [mailto:[email protected]] On Behalf Of [email protected] Sent: Tuesday, May 02, 2017 3:47 PM To: Cooper, Trevor; [email protected]; [email protected] Subject: Re: [test-wg] [opnfv-tech-discuss] Notes from OPNFV Plugfest meeting - "Testing group Euphrates collaborative work" Thnaks Trevor I added some points that reflect the notes for the next test weekly meeting planned on the 4th of May: https://wiki.opnfv.org/display/meetings/TestPerf feel free to add additional points I will not be able to join this time, could you chair the meeting? /Morgan Le 28/04/2017 à 16:36, Cooper, Trevor a écrit : Status of Danube and what improved 1. landing page - http://testresults.opnfv.org/reporting2/reporting/index.html - http://testresults.opnfv.org/reporting2/reporting/index.html#!/landingpage/table § Meaning of info displayed? Test ran, test passed … agree for consistency … TBD 2. catalogue - diagram with roll-over - http://testresults.opnfv.org/reporting2/reporting/index.html#!/select/visual - All PTLs to review if test cases are valid and if not remove - Add short description that is human readable (add API field) ○ Define test domain categories - start by using labels on test ecosystem diagram 3. Stress tests - video of presentation is available - simultaneous vPING which increases until system fails 4. Documentation ○ Ecosystem diagram ○ Testing guide ○ Add agenda item to TWG in June (2 sessions on how to improve) ○ New test projects … add to common docs ○ Developer guide - move to docs 5. Reporting status / dashboard ○ Bottlenecks TBD? 6. Bitergia ○ Morgan meeting 10th May ○ https://wiki.opnfv.org/display/testing/Result+alignment+for+ELK+post-processing ○ Add to TWG agenda next week to revisit Wish list for Infra group - One POD dedicated to long duration tests (with reservation mechanism) - Per installer ○ Stable of previous release ○ Master - OPNFV POD on demand for tester (before merging) ○ Per installer if possible ○ Infra group working on it ○ Today can fill a ticket to ask if there is a free resource Micro services - Deploy VNF ○ Retrieve image ○ Deploy ○ Prebuild image with tools - standardise on a framework ○ Take image and copy over tools - Ansible (infra doing this with Open Stack Ansible) ○ Catalog of roles for Ansible? § Ansible Galaxy is a tool for deploying and managing roles □ e.g. Install TREX TG □ Turn on live migration in Nova - Test generator? - Collect / display results ○ Test API and DB ○ Reuse collectd lib for VNF KPIs - Analytics of results - What APIs to expose to other test projects? ○ Functest § Deploy orchestrator VNF § Use Traffic gen and generate load /Trevor _______________________________________________ opnfv-tech-discuss mailing list [email protected]<mailto:[email protected]> https://lists.opnfv.org/mailman/listinfo/opnfv-tech-discuss -- Morgan Richomme Orange/ IMT/ OLN/ CNC/ NCA/ SINA Network architect for innovative services Future of the Network community member Open source Orange community manager tel. +33 (0) 296 072 106 mob. +33 (0) 637 753 326 [email protected]<mailto:[email protected]> _________________________________________________________________________________________________________________________ Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration, Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci. This message and its attachments may contain confidential or privileged information that may be protected by law; they should not be distributed, used or copied without authorisation. If you have received this email in error, please notify the sender and delete this message and its attachments. As emails may be altered, Orange is not liable for messages that have been modified, changed or falsified. Thank you.
_______________________________________________ opnfv-tech-discuss mailing list [email protected] https://lists.opnfv.org/mailman/listinfo/opnfv-tech-discuss
