# My apology if this kind of discussion is not appropriate in this ML. On Tue, Apr 09, 2019 at 04:20:48PM +0100, Yang Zhang wrote: > On Tue, 9 Apr 2019 at 16:18, Udit Kumar <[email protected]> wrote: > > > Thanks for information AKASHI > > > > IMO for EBBR, we need to define subset of test-cases, which are required > > in EBBR specs. > > > > +1
Since I have been away from SCT long time, I almost forgot details of how SCT runs but at the first glance, it would be quite simple and straightforward as SCT already has a feature to run only a specific list of test cases (through TestCase.ini file). * create a list of test cases (TestCase.ini is automatically generated by SCT if we want to run all.) * check/mark only interested cases (There are always two types of tests: conformance and function.) * run SCT with this list The issue would be who maintain this list and where :) and I don't know that the 'granularity' of each test case would fit well for our subset. > > > I expect some fail in u-boot. > > Also need to find a better way to build uefi-sct > > > > +1 I used pre-built binary of SCT. -Takahiro Akashi > > > > Regards > > Udit > > > > > -----Original Message----- > > > From: AKASHI Takahiro <[email protected]> > > > Sent: Tuesday, April 9, 2019 10:53 AM > > > To: Grant Likely <[email protected]> > > > Cc: Udit Kumar <[email protected]>; Dong Wei <[email protected]>; Eric > > > FINCO <[email protected]>; Robert Oshana <[email protected]>; Tony > > > Wu <[email protected]>; [email protected]; arm.ebbr- > > > discuss <[email protected]>; LEDGE SC <[email protected]>; > > Varis, > > > Pekka <[email protected]>; nd <[email protected]> > > > Subject: [EXT] Re: EBBR SC meeting on-site at Connect > > > > > > WARNING: This email was created outside of NXP. DO NOT CLICK links or > > > attachments unless you recognize the sender and know the content is safe. > > > > > > > > > > > > On Sat, Apr 06, 2019 at 07:42:46PM +0000, Grant Likely wrote: > > > > Hi Udit, > > > > > > > > We talked about testing. We generally agreed that UEFI-SCT is > > > > important, even though it is limited. LuvOS (which includes UEFI-SCT) > > > > is a good candidate to do more complete testing, and we also talked > > > > about getting UEFI test cases into the U-Boot CI testing. > > > > > > Just FYI, it was last July that I ran UEFI SCT with U-Boot on qemu. > > > Here is a summary of the result: > > > > > https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.goo > > > gle.com%2Fspreadsheets%2Fd%2F17e45yojM2nLdRovx0gcgHIAmvv9b_yc9iIUjZ > > > 2LY22c%2Fedit%3Fusp%3Dsharing&data=02%7C01%7Cudit.kumar%40nxp. > > > com%7Cc5b24ae4bd26466e1a7008d6bcab1c5c%7C686ea1d3bc2b4c6fa92cd99 > > > c5c301635%7C0%7C0%7C636903840436702643&sdata=00NOqcpsKPi8DkJ > > > u8y%2F7mLqSI8qQGFSGqzBhbpo3bbE%3D&reserved=0 > > > (Please note that this is not for public review, but just informative.) > > > > > > In my experience, I saw lots of failure cases (some or most of them are > > trivial > > > and can be duplicated ones though), and running through all the test > > cases took > > > a whole week. This is partly because SCT crashes occasionally and I > > needed to > > > restart it next morning :) > > > > > > So I'm not sure that U-Boot UEFI is ready for automated testing with SCT. > > > (We made lots of improvements recently, but I have had no time to re-run > > SCT > > > these days. Give me a fast machine :) > > > > > > -Takahiro Akashi > > > > > > > Linaro LEDGE is looking at adding U-Boot testing to their backlog, but > > > > they don't have any engineering resources who can be assigned to the > > > > work right now. I'm also going to try and resource this from Arm. > > > > > > > > g. > > > > > > > > On 04/04/2019 16:08, Udit Kumar wrote: > > > > > Hi Grant > > > > > > > > > >>>- other business > > > > > > > > > > See, if you can add compliance test suits for EBBR, or subset of > > > > > UEFI-SCT is enough ? > > > > > > > > > > Regards > > > > > > > > > > Udit > > > > > > > > > > *From:* [email protected] > > > > > <[email protected]> *On Behalf Of *Grant Likely > > > > > *Sent:* Wednesday, April 3, 2019 12:49 PM > > > > > *To:* Dong Wei <[email protected]>; Eric FINCO <[email protected]>; > > > > > Robert Oshana <[email protected]>; Tony Wu > > > <[email protected]>; > > > > > [email protected]; arm.ebbr-discuss > > > > > <[email protected]>; LEDGE SC <[email protected]>; Varis, > > > > > Pekka <[email protected]> > > > > > *Subject:* Re: [Arm.ebbr-discuss] EBBR SC meeting on-site at Connect > > > > > > > > > > Agenda for today: > > > > > > > > > > - EBBR v1.0 released (yay!) > > > > > > > > > > - goals for v1.1 or v2.0 > > > > > > > > > > - other issues > > > > > > > > > > - secure world interfaces > > > > > > > > > > - non-block storage > > > > > > > > > > - identification of protected blocks > > > > > > > > > > - other business > > > > > > > > > > --- > > > > > > > > > > Grant Likely > > > > > > > > > > Sr. Technical Director SW Engineering > > > > > > > > > > -------------------------------------------------------------------- > > > > > ---- > > > > > > > > > > *From:*Grant Likely > > > > > *Sent:* Wednesday, April 3, 2019 1:49:23 PM > > > > > *To:* Dong Wei; Eric FINCO; [email protected]; Tony Wu; > > > > > [email protected]; arm.ebbr-discuss; LEDGE SC; > > > > > Varis, Pekka > > > > > *Subject:* Re: EBBR SC meeting on-site at Connect > > > > > > > > > > details for those who had trouble with the calendar invite: > > > > > > > > > > Room: Lotus 5-6 > > > > > > > > > > Time: 5:00pm > > > > > > > > > > Sorry for those of you who aren’t here. I’m not going to have a dial > > > > > in, but I’ll take good notes. > > > > > > > > > > g. > > > > > > > > > > > > > _______________________________________________ > > > > boot-architecture mailing list > > > > [email protected] > > > > https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flist > > > > s.linaro.org%2Fmailman%2Flistinfo%2Fboot- > > > architecture&data=02%7C01 > > > > > > > %7Cudit.kumar%40nxp.com%7Cc5b24ae4bd26466e1a7008d6bcab1c5c%7C686 > > > ea1d3b > > > > > > > c2b4c6fa92cd99c5c301635%7C0%7C0%7C636903840436702643&sdata=F > > > Rd8%2B > > > > nzRF827ZMG1fYeDwEr90V%2BZHvIHbFiIPAhBFiQ%3D&reserved=0 > > > > _______________________________________________ > > Arm.ebbr-discuss mailing list > > [email protected] _______________________________________________ boot-architecture mailing list [email protected] https://lists.linaro.org/mailman/listinfo/boot-architecture
