Hi,
These tests are incorrect.
The failures are caused by test cases that require exact floating-point results 
for vectorized reductions.
The observed differences are small rounding variations that depend on vector 
length and execution environment.

Please ignore the mail. We'll update the test.
We apologize for the false detection.

Best regards,
Yasuyuki Ohno

Software Development Div.,
Advanced Technology Development Unit,
Fujitsu Research, Fujitsu Limited, JAPAN.
________________________________
差出人: [email protected] <[email protected]>
送信日時: 2026年7月24日 17:04
宛先: [email protected] 
<[email protected]>
CC: [email protected] <[email protected]>; 
[email protected] <[email protected]>
件名: [Linaro-TCWG-CI] llvmorg-23-init-22857-g308393ede14c: 4 regressions 1 fix 
on aarch64

Dear contributor,

Our automatic CI has detected problems related to your patch(es). Please find 
some details below.

In tcwg_flang_test/main-aarch64-Ofast-sve_vls-lto-lld, after:
  | commit llvmorg-23-init-22857-g308393ede14c
  | Author: Benjamin Maxwell <[email protected]>
  | Date:   Mon Jul 13 13:30:37 2026 +0100
  |
  |     [LV] Allow scalable epilogue VFs matching the MainLoop VF (#208686)
  |
  |     This effectively limited scalable epilogue VFs to the MainLoopVF/2, as
  |     all VFs are powers-of-two. This restriction does not exist for fixed
  |     vector VFs. This could result in worse VF selections for scalable
  | ... 3 lines of the commit log omitted.

Produces 4 regressions 1 fix:
  |
  | regressions.sum:
  | Running test-suite:Fujitsu/Fortran/0366 ...
  | FAIL: test-suite :: Fujitsu/Fortran/0366/Fujitsu-Fortran-0366_0002.test
  | FAIL: test-suite :: Fujitsu/Fortran/0366/Fujitsu-Fortran-0366_0007.test
  | FAIL: test-suite :: Fujitsu/Fortran/0366/Fujitsu-Fortran-0366_0011.test
  | FAIL: test-suite :: Fujitsu/Fortran/0366/Fujitsu-Fortran-0366_0098.test
  | # "FAIL" means : the execution of the compiled binary failed / output of 
the binary differs from the expected one
  |
  | fixes.sum:
  | Running test-suite:Fujitsu/Fortran/0682 ...
  | FAIL: test-suite :: Fujitsu/Fortran/0682/Fujitsu-Fortran-0682_0041.test
  | # "FAIL" means : the execution of the compiled binary failed / output of 
the binary differs from the expected one

Used configuration :
  * Toolchain : cmake -G Ninja  ../llvm/llvm 
"-DLLVM_ENABLE_PROJECTS=clang;lld;flang;clang-tools-extra"           
"-DLLVM_ENABLE_RUNTIMES=openmp"          -DCMAKE_BUILD_TYPE=Release 
-DLLVM_ENABLE_ASSERTIONS=True          -DCMAKE_INSTALL_PREFIX=../llvm-install   
 "-DLLVM_TARGETS_TO_BUILD=AArch64" -DCLANG_DEFAULT_LINKER=lld
  * Testsuite : export 
LD_LIBRARY_PATH=$\WORKSPACE/llvm-install/lib/aarch64-unknown-linux-gnu$\{LD_LIBRARY_PATH:+:$\LD_LIBRARY_PATH}
 cmake -GNinja    -DCMAKE_C_COMPILER="$\WORKSPACE/llvm-install/bin2/clang"      
   -DCMAKE_CXX_COMPILER="$\WORKSPACE/llvm-install/bin2/clang++"     
-DCMAKE_Fortran_COMPILER="$\WORKSPACE/llvm-install/bin2/flang-new"       
-DCMAKE_BUILD_TYPE=Release       -DCMAKE_C_FLAGS= -DCMAKE_CXX_FLAGS= 
-DCMAKE_Fortran_FLAGS=       -DCMAKE_C_FLAGS_RELEASE="-O3 -ffast-math 
-march=armv8.4-a+sve -msve-vector-bits=256 -flto -fuse-ld=lld -DNDEBUG"         
-DCMAKE_CXX_FLAGS_RELEASE="-O3 -ffast-math -march=armv8.4-a+sve 
-msve-vector-bits=256 -flto -fuse-ld=lld -DNDEBUG"       
-DCMAKE_Fortran_FLAGS_RELEASE="-O3 -ffast-math -march=armv8.4-a+sve 
-msve-vector-bits=256 -flto -fuse-ld=lld -DNDEBUG"         
-DTEST_SUITE_FORTRAN=ON -DTEST_SUITE_SUBDIRS=Fujitsu 
-DTEST_SUITE_FUJITSU_WITH_FAST_MATH=ON       "$\WORKSPACE/test/test-suite"

We track this bug report under https://linaro.atlassian.net/browse/LLVM-2254. 
(Require Linaro login) Please let us know if you have a fix.

If you have any questions regarding this report, please ask on 
[email protected] mailing list.

-----------------8<--------------------------8<--------------------------8<--------------------------

The information below contains the details of the failures, and the ways to 
reproduce a debug environment:

You can find the failure logs in *.log.1.xz files in
 * 
http://54.172.246.49:9090/jobs/tcwg_flang_test--main-aarch64-Ofast-sve_vls-lto-lld-build/builds/10483/archive/artifacts/00-sumfiles/
The full lists of regressions and improvements as well as configure and make 
commands are in
 * 
http://54.172.246.49:9090/jobs/tcwg_flang_test--main-aarch64-Ofast-sve_vls-lto-lld-build/builds/10483/archive/artifacts/notify/
The list of [ignored] baseline and flaky failures are in
 * 
http://54.172.246.49:9090/jobs/tcwg_flang_test--main-aarch64-Ofast-sve_vls-lto-lld-build/builds/10483/archive/artifacts/sumfiles/xfails.xfail

Fujitsu testsuite : https://github.com/fujitsu/compiler-test-suite/

Current build   : 
http://54.172.246.49:9090/jobs/tcwg_flang_test--main-aarch64-Ofast-sve_vls-lto-lld-build/builds/10483/archive/artifacts/
Reference build : 
http://54.172.246.49:9090/jobs/tcwg_flang_test--main-aarch64-Ofast-sve_vls-lto-lld-build/builds/10482/archive/artifacts/

Instruction to reproduce the build : 
https://gitlab.com/LinaroLtd/tcwg/ci/interesting-commits/-/raw/master/llvm/sha1/308393ede14cc8533d1be122b5df88bf9ba4173b/tcwg_flang_test/main-aarch64-Ofast-sve_vls-lto-lld/reproduction_instructions.txt

Full commit : 
https://github.com/llvm/llvm-project/commit/308393ede14cc8533d1be122b5df88bf9ba4173b
_______________________________________________
linaro-toolchain mailing list -- [email protected]
To unsubscribe send an email to [email protected]

Reply via email to