It has been observed that useful information in regression report can be drowned in huge regression lists which are often false-positives (for example, a whole set of tests has been temporarily disabled).
This series brings a default limit to how many changes are displayed per base/target comparison. This default can still be overriden on commandline, for example to have a better look at the whole regression list when trying to debug an issue (i.e. by disabling the limit) First commit implement the limit, its default value and the corresponding commandline option in resulttool. Second commit allow yocto_testresults_query.py to drive this value. As a result, one can for example do the following: - yocto_testresults_query 4.3_M1 4.3_M2 -> will display at most 50 regressions per test - yocto_testresults_query -l 10 4.3_M1 4.3_M2 -> override the display limit and reduce it to 10 regressions per pair. - yocto_testresults_query -l 0 4.3_M1 4.3_M2 -> disable the display limit, print all regressions An example of regression report with display limit can be found here: https://pastebin.com/6QbfGstR Alexis Lothoré (2): scripts/resulttool: limit the number of changes displayed per test scripts/yocto_testresults_query: add option to change display limit scripts/lib/resulttool/regression.py | 23 +++++++++++++++++++---- scripts/yocto_testresults_query.py | 13 ++++++++++--- 2 files changed, 29 insertions(+), 7 deletions(-) -- 2.42.0
-=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#189440): https://lists.openembedded.org/g/openembedded-core/message/189440 Mute This Topic: https://lists.openembedded.org/mt/102057050/21656 Group Owner: [email protected] Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [[email protected]] -=-=-=-=-=-=-=-=-=-=-=-
