Can't change fingering direction in multi-voice

[Daisy Fatemi]

Hi all,

I'm trying to get the first three fingerings of the top voice lower so they
don't overlap with the stems, but \set fingeringOrientations = #'(down)
isn't working. Is there a way around this?

Thank you,
*Daisy Fatemi*
(she/her)

\version "2.22.2"

\relative {
  <<
    {
      \override Fingering.staff-padding = #'()
      \override Fingering.add-stem-support = ##f
      \set fingeringOrientations = #'(down)
      \tuplet 3/2 { <g''>16(-5 <a>-5 <g>-4 } e8^)-2 
    }
      \\
    {
      \tuplet 3/2 { g,16-1 a8~-1 } a8
    }
  >>
}