[Bug tree-optimization/122872] [UBSAN] tree-vect-loop.cc:4518:10: runtime error: signed integer overflow: 1703712 * 65528 cannot be represented in type 'int'

[dcb314 at hotmail dot com via Gcc-bugs]

https://gcc.gnu.org/bugzilla/show_bug.cgi?id=122872

--- Comment #3 from David Binderman <dcb314 at hotmail dot com> ---

Stack backtrace is

../../trunk/gcc/tree-vect-loop.cc:4518:10: runtime error: signed integer
overflow: 1572752 * 65532 cannot be represented in type 'int'
    #0 0x0000046f862e in vect_estimate_min_profitable_iters
../../trunk/gcc/tree-vect-loop.cc:4518
    #1 0x0000047274f1 in vect_analyze_loop_costing
../../trunk/gcc/tree-vect-loop.cc:1818
    #2 0x00000472aba8 in vect_analyze_loop_2
../../trunk/gcc/tree-vect-loop.cc:2499
    #3 0x0000047332a9 in vect_analyze_loop_1
../../trunk/gcc/tree-vect-loop.cc:2822
    #4 0x000004734a19 in vect_analyze_loop(loop*, gimple*, vec_info_shared*)
../../trunk/g
cc/tree-vect-loop.cc:2960
    #5 0x00000491076a in try_vectorize_loop_1
../../trunk/gcc/tree-vectorizer.cc:1097
    #6 0x000004911d7b in execute ../../trunk/gcc/tree-vectorizer.cc:1333
    #7 0x000003108545 in execute_one_pass(opt_pass*)
../../trunk/gcc/passes.cc:2648
    #8 0x00000310b350 in execute_pass_list_1 ../../trunk/gcc/passes.cc:2757
    #9 0x00000310b393 in execute_pass_list_1 ../../trunk/gcc/passes.cc:2758
    #10 0x00000310b393 in execute_pass_list_1 ../../trunk/gcc/passes.cc:2758

Line tree-vect-loop.cc:4518 is

      min_profitable_iters = ((vec_outside_cost - scalar_outside_cost)
                  * assumed_vf
                  - vec_inside_cost * peel_iters_prologue
                  - vec_inside_cost * peel_iters_epilogue);