Hi Helen, Those details have not been defined. The thought was for many of the criteria that the individual projects are in the best position to identify criteria appropriate to their project.
So, for performance, as an example, maybe SO would identify and measure a criteria around request handling time, whereas AAI might use a metric around events received per second. (These are just examples). For stability, each project should identify & create the appropriate test transactions that would exercise 80% of their code. Then those tests would be run over a 72 hour period & monitored for any component failures. My hope is that the Benchmark team will be able to assist the project teams with the performance and stability testing. For resiliency, the level 2 criteria just says that there has to be automated failure detection and rerouting with no other qualifications on how "gracefully" that occurs. For that level, the teams should just gather how many requests are lost when failure happens under load (for stateless components), and gather what sort of data loss occurs when failure happens under load (for stateful components). Regards, Jason Hunt Executive Software Architect, IBM Phone: 314-749-7422 Email: [email protected] Twitter: @DJHunt From: Yunxia Chen <[email protected]> To: Jason Hunt <[email protected]> Cc: "[email protected]" <[email protected]>, onap-discuss <[email protected]>, "[email protected]" <[email protected]> Date: 01/02/2018 04:45 PM Subject: Re: [onap-discuss] [integration] ONAP S3P definition and matrix Hi, Jason, Thanks for the fast turnaround. I am looking for something more concrete and specific, for example, Performance: What exactly the criteria identified? · Speed of service provisioning? · How many particular operations can be processed in a second? · How many concurrent operations can be run in parallel without degradation? Stability: · Longevity tests? 72 hours? … What does 72 hour platform level soak w/random transactions mean here? · Resilience tests: verify graceful crash recovery?? If those are not defined yet, I suggest that we could have a small group of people to follow up and discuss them. Regards, Helen Chen From: Jason Hunt <[email protected]> Date: Tuesday, January 2, 2018 at 2:26 PM To: Helen Chen 00725961 <[email protected]> Cc: "[email protected]" <[email protected]>, onap-discuss <[email protected]>, "[email protected]" <[email protected]>, "[email protected]" <[email protected]> Subject: Re: [onap-discuss] [integration] ONAP S3P definition and matrix Hi Helen, Is this what you are looking for? - Approved levels for Platform Maturity Requirements for Beijing: https://wiki.onap.org/pages/viewpage.action?pageId=15998867&preview=/16002054/20874800/Platform%20Maturity%20Level%20proposal%2013Dec2017v2.pdf - Full requirements definition: https://wiki.onap.org/pages/viewpage.action?pageId=15998867 Regards, Jason Hunt Executive Software Architect, IBM Phone: 314-749-7422 Email: [email protected] Twitter: @DJHunt From: Yunxia Chen <[email protected]> To: "[email protected]" <[email protected]>, "[email protected]" <[email protected]>, onap-discuss <[email protected]> Date: 01/02/2018 04:22 PM Subject: [onap-discuss] [integration] ONAP S3P definition and matrix Sent by: [email protected] Hi, Chris & Alla, Happy new year! I am not sure whether I missed it over the holiday. Is there anywhere I could find the definition and matrix for ONAP S3P for Beijing release? Regards, Helen Chen_______________________________________________ onap-discuss mailing list [email protected] https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.onap.org_mailman_listinfo_onap-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=oMOO2HmZ8JJWvUc1M7SklmdX3xn2mSb9tP9VrdTjcqg&m=1lEiYS-Miv5xr30-NyU6Q_DBYEM0h-7opXwGJjqVI1s&s=2p86n4_mfJwx3oP_BAJLiWBXBtWi9Q9Gsns7lcoDdzk&e=
_______________________________________________ onap-discuss mailing list [email protected] https://lists.onap.org/mailman/listinfo/onap-discuss
