On Mon Sep 28, 2026 at 12:26 PM EDT, João Marcos Costa wrote: > Timeouts have been observed (very frequently in the past weeks) > in the autobuilder, and a bug [1] was filed at Bugzilla. > > After some investigation [2] was performed by Trevor Gamblin, we now have a > list of the most time consuming test cases: > > - mini-record-2 (187880ms) > - record-retvals (145390ms) > - rng-op-key (63820ms) > - rng-op-random (63330ms) > - rng-op-nonce (63260ms) > - dtls-rehandshake-cert (61360ms) > - dtls-rehandshake-cert-2 (61230ms) > - dtls-rehandshake-anon (61030ms) > - mini-loss-time (60130ms) > - mini-dtls-hello-verify-48 (30050ms) > - tls12-ffdhe (27790ms) > - x509sign-verify-rsa (18460ms) > - x509sign-verify-ecdsa (16050ms) > > Disable them to avoid so many timeouts in qemuriscv64-ptest runs.
Thanks for submitting this. I'm sorry if I wasn't clear before, but I think we should only disable mini-record-2 and record-retvals to start, since they are significantly longer than all of the others. If gnutls remains a problem afterward then the others should be considered, but for now we want to try retaining the others to maximize test coverage. Trevor > > [1] https://bugzilla.yoctoproject.org/show_bug.cgi?id=16162 > [2] https://bugzilla.yoctoproject.org/show_bug.cgi?id=16162#c19 > > Signed-off-by: João Marcos Costa <[email protected]> > --- > ...m-disable-slow-test-cases-in-RISCV64.patch | 109 ++++++++++++++++++ > meta/recipes-support/gnutls/gnutls_3.8.13.bb | 4 + > 2 files changed, 113 insertions(+) > create mode 100644 > meta/recipes-support/gnutls/gnutls/0001-tests-Makefile.am-disable-slow-test-cases-in-RISCV64.patch > > diff --git > a/meta/recipes-support/gnutls/gnutls/0001-tests-Makefile.am-disable-slow-test-cases-in-RISCV64.patch > > b/meta/recipes-support/gnutls/gnutls/0001-tests-Makefile.am-disable-slow-test-cases-in-RISCV64.patch > new file mode 100644 > index 0000000000..6dbd165658 > --- /dev/null > +++ > b/meta/recipes-support/gnutls/gnutls/0001-tests-Makefile.am-disable-slow-test-cases-in-RISCV64.patch > @@ -0,0 +1,109 @@ > +From a27faed63722263f5ae8e2b7fac564de3a65fda1 Mon Sep 17 00:00:00 2001 > +From: =?UTF-8?q?Jo=C3=A3o=20Marcos=20Costa?= <[email protected]> > +Date: Mon, 28 Sep 2026 15:56:37 +0000 > +Subject: [PATCH] tests/Makefile.am: disable slow test cases in RISCV64 > +MIME-Version: 1.0 > +Content-Type: text/plain; charset=UTF-8 > +Content-Transfer-Encoding: 8bit > + > +Timeouts have been observed (very frequently in the past weeks) > +in the autobuilder, and a bug [1] was filed at Bugzilla. > + > +After some investigation [2] was performed by Trevor Gamblin, we now have a > +list of the most time consuming test cases: > + > +- mini-record-2 (187880ms) > +- record-retvals (145390ms) > +- rng-op-key (63820ms) > +- rng-op-random (63330ms) > +- rng-op-nonce (63260ms) > +- dtls-rehandshake-cert (61360ms) > +- dtls-rehandshake-cert-2 (61230ms) > +- dtls-rehandshake-anon (61030ms) > +- mini-loss-time (60130ms) > +- mini-dtls-hello-verify-48 (30050ms) > +- tls12-ffdhe (27790ms) > +- x509sign-verify-rsa (18460ms) > +- x509sign-verify-ecdsa (16050ms) > + > +Disable them to avoid so many timeouts in qemuriscv64-ptest runs. > + > +Upstream-Status: Inappropriate [oe-core specific] > + > +[1] https://bugzilla.yoctoproject.org/show_bug.cgi?id=16162 > +[2] https://bugzilla.yoctoproject.org/show_bug.cgi?id=16162#c19 > + > +Signed-off-by: João Marcos Costa <[email protected]> > +--- > + tests/Makefile.am | 20 ++++++++++---------- > + 1 file changed, 10 insertions(+), 10 deletions(-) > + > +diff --git a/tests/Makefile.am b/tests/Makefile.am > +index f84b2f1..b03e570 100644 > +--- a/tests/Makefile.am > ++++ b/tests/Makefile.am > +@@ -161,7 +161,7 @@ ctests += tls13-early-start > + > + ctests += tls13/no-auto-send-ticket > + > +-ctests += mini-record-2 simple gnutls_hmac_fast set_pkcs12_cred cert > certuniqueid tls-neg-ext-key \ > ++ctests += simple gnutls_hmac_fast set_pkcs12_cred cert certuniqueid > tls-neg-ext-key \ > + mpi certificate_set_x509_crl dn parse_ca x509-dn x509-dn-decode > record-sizes \ > + hostname-check cve-2008-4989 pkcs12_s2k chainverify missingissuer > missingissuer_aia record-sizes-range \ > + crq_key_id x509sign-verify sign-verify cve-2009-1415 cve-2009-1416 > \ > +@@ -172,13 +172,13 @@ ctests += mini-record-2 simple gnutls_hmac_fast > set_pkcs12_cred cert certuniquei > + rng-fork mini-eagain-dtls resume-dtls empty_retrieve_function \ > + tls13-rehandshake-cert gnutls_ext_raw_parse handshake-large-cert \ > + x509cert x509cert-tl x509cert-ct infoaccess mini-dtls-hello-verify > sign-verify-ed25519-rfc8080 \ > +- trustdb-tofu dtls-rehandshake-anon mini-alpn mini-dtls-large \ > ++ trustdb-tofu mini-alpn mini-dtls-large \ > + mini-termination mini-x509-cas mini-x509-2 pkcs12_simple \ > +- mini-emsgsize-dtls chainverify-unsorted mini-overhead tls12-ffdhe \ > ++ mini-emsgsize-dtls chainverify-unsorted mini-overhead \ > + mini-dtls-heartbeat mini-x509-callbacks key-openssl priorities > priorities-groups \ > + gnutls_x509_privkey_import gnutls_x509_crt_list_import time > x509-server-verify \ > + sign-verify-ext4 tls-neg-ext4-key resume-lifetime \ > +- mini-dtls-srtp rsa-encrypt-decrypt mini-loss-time gnutls-strcodes \ > ++ mini-dtls-srtp rsa-encrypt-decrypt gnutls-strcodes \ > + mini-record mini-dtls-record handshake-timeout mini-record-range \ > + cert-status rsa-psk global-init sec-params sign-verify-data \ > + fips-test fips-override-test mini-global-load name-constraints > x509-extensions \ > +@@ -192,16 +192,16 @@ ctests += mini-record-2 simple gnutls_hmac_fast > set_pkcs12_cred cert certuniquei > + rsa-rsa-oaep rsa-rsa-pss \ > + mini-dtls-fork mini-key-material x509cert-invalid \ > + tls-ext-register tls-supplemental mini-dtls0-9 duplicate-extensions \ > +- record-retvals mini-server-name tls-etm tls-force-etm > x509-cert-callback alerts \ > ++ mini-server-name tls-etm tls-force-etm x509-cert-callback alerts \ > + client-sign-md5-rep tls12-invalid-key-exchanges session-rdn-read \ > + tls13-cert-key-exchange x509-cert-callback-ocsp > gnutls_ocsp_resp_list_import2 \ > + server-sign-md5-rep privkey-keygen mini-tls-nonblock no-signal > pkcs7-gen dtls-etm \ > +- x509sign-verify-rsa x509sign-verify-ecdsa x509sign-verify-gost \ > ++ x509sign-verify-gost \ > + cipher-alignment oids atfork prf psk-file priority-init2 > post-client-hello-change-prio \ > + status-request status-request-ok rfc7633-missing sign-verify-ext \ > +- fallback-scsv pkcs8-key-decode urls dtls-rehandshake-cert rfc7633-ok \ > ++ fallback-scsv pkcs8-key-decode urls rfc7633-ok \ > + key-usage-rsa key-usage-ecdhe-rsa mini-session-verify-function > auto-verify \ > +- record-timeouts mini-dtls-hello-verify-48 set-default-prio \ > ++ record-timeouts set-default-prio \ > + tls12-anon-upgrade tlsext-decoding rsa-psk-cb gnutls-ids \ > + rehandshake-switch-cert rehandshake-switch-cert-allow > rehandshake-switch-cert-client \ > + rehandshake-switch-cert-client-allow handshake-versions > dtls-handshake-versions \ > +@@ -214,7 +214,7 @@ ctests += mini-record-2 simple gnutls_hmac_fast > set_pkcs12_cred cert certuniquei > + set_x509_key_file_der set_x509_pkcs12_key crt_apis > tls12-cert-key-exchange \ > + tls11-cert-key-exchange tls10-cert-key-exchange > ssl30-cert-key-exchange \ > + dtls12-cert-key-exchange dtls10-cert-key-exchange > x509-cert-callback-legacy \ > +- keylog-env ssl2-hello tlsfeature-ext dtls-rehandshake-cert-2 > dtls-session-ticket-lost \ > ++ keylog-env ssl2-hello tlsfeature-ext dtls-session-ticket-lost \ > + tlsfeature-crt dtls-rehandshake-cert-3 resume-with-false-start \ > + set_x509_key_file_ocsp client-fastopen rng-sigint srp \ > + safe-renegotiation/srn0 safe-renegotiation/srn1 > safe-renegotiation/srn2 \ > +@@ -230,7 +230,7 @@ ctests += mini-record-2 simple gnutls_hmac_fast > set_pkcs12_cred cert certuniquei > + rng-no-onload dtls1-2-mtu-check crl_apis cert_verify_inv_utf8 > no-extensions \ > + no-status-request hostname-check-utf8 pkcs8-key-decode-encrypted > priority-mix pkcs7 \ > + send-data-before-handshake recv-data-before-handshake crt_inv_write \ > +- x509sign-verify-error rng-op-nonce rng-op-random rng-op-key > x509-dn-decode-compat \ > ++ x509sign-verify-error x509-dn-decode-compat \ > + ip-check mini-x509-ipaddr trust-store base64-raw random-art > dhex509self \ > + dss-sig-val sign-pk-api tls-session-ext-override record-pad \ > + tls13-server-kx-neg gnutls_ext_raw_parse_dtls key-export-pkcs8 \ > diff --git a/meta/recipes-support/gnutls/gnutls_3.8.13.bb > b/meta/recipes-support/gnutls/gnutls_3.8.13.bb > index 9c8c994bdc..ff1c3e661e 100644 > --- a/meta/recipes-support/gnutls/gnutls_3.8.13.bb > +++ b/meta/recipes-support/gnutls/gnutls_3.8.13.bb > @@ -27,6 +27,10 @@ SRC_URI = > "https://www.gnupg.org/ftp/gcrypt/gnutls/v${SHRT_VER}/gnutls-${PV}.tar > file://0001-tests-mini-dtls-framents-link-to-gnulib.patch \ > " > > +SRC_URI:append:riscv64 = "\ > + file://0001-tests-Makefile.am-disable-slow-test-cases-in-RISCV64.patch \ > +" > + > SRC_URI[sha256sum] = > "ffed8ec1bf09c2426d4f14aae377de4753b53e537d685e604e99a8b16ca9c97e" > > inherit autotools texinfo pkgconfig gettext lib_package gtk-doc ptest
-=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#246786): https://lists.openembedded.org/g/openembedded-core/message/246786 Mute This Topic: https://lists.openembedded.org/mt/121475025/21656 Group Owner: [email protected] Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [[email protected]] -=-=-=-=-=-=-=-=-=-=-=-
