On Mon, 2022-07-04 at 00:51 -0700, Sundeep KOKKONDA wrote: > The regression test for Binutils and Glibc is performed. > > 1) Binutils test shows no regression after update. > > 2) Glibc test result: > Test summary before glibc update on Kirkstone: > 204 FAIL > 4320 PASS > 43 UNSUPPORTED > 12 XFAIL > 6 XPASS > > Test summary after glibc update on Kirkstone: > 204 FAIL > 4339 PASS > 41 UNSUPPORTED > 12 XFAIL > 6 XPASS > > Test results analysis: > Total 4585 test cases before Glibc update & Total 4602 test cases > after Glibc update. > 17 new test cases added (out of those 16 PASS & 1 FAIL) > 12 new FAIL test cases after glibc update > 14 new PASS test cases after glibc update
Do we know why some of the failing test cass now pass and why some of the passing test cases now fail? Is this some issue with the way we're testing things? I'm wondering if this is "normal" noise between test runs and if there is some underlying instability or glibc changes do cause changes in pass/fails of tests like this in general? Cheers, Richard
-=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#167599): https://lists.openembedded.org/g/openembedded-core/message/167599 Mute This Topic: https://lists.openembedded.org/mt/92160650/21656 Group Owner: [email protected] Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [[email protected]] -=-=-=-=-=-=-=-=-=-=-=-
