Hi All, Gentle bump on FLIP-563 review to support *yarn.provided.lib.archives* to point to pre-uploaded HDFS archives.
Thanks, Archit Goyal On Mon, Feb 2, 2026 at 9:38 AM archit goyal <[email protected]> wrote: > Hi all, > > Gentle ping on FLIP-563 - would appreciate reviews/feedback from the > community. > > On Wed, Jan 21, 2026 at 3:29 PM archit goyal <[email protected]> > wrote: > > > > Hi All, > > > > I am opening this thread to discuss FLIP-563: Support for provided lib > archives in YARN Application Mode. > > > > Today yarn.provided.lib.dirs assumes pre-uploaded directories of jars. > In practice, many deployments package shared libs as .tgz/.tar.gz and/or > hit classpath “argument too long” issues when many jars are enumerated. > > > > Proposal: introduce yarn.provided.lib.archives to point to pre-uploaded > HDFS archives. Flink would localize them as public archive resources and > add a single wildcard classpath entry per archive (e.g., <archiveDir>/*). > Backward compatible and no change unless configured. > > > > Please feel free to reply to this email thread and share your opinions. > > > > Thanks, > > Archit Goyal > > > > -- > Yours Sincerely > Archit Goyal > Email: [email protected] > Mobile: +1-347-471-9251 > -- Yours Sincerely Archit Goyal Email: [email protected]
