Hi All, Gentle bump on the thread for FLIP-563 review to support *yarn.provided.lib.archives* to point to pre-uploaded HDFS archives.
On Tue, Aug 4, 2026 at 9:28 PM archit goyal <[email protected]> wrote: > Hi All, > > Gentle bump on FLIP-563 review to support *yarn.provided.lib.archives* to > point to pre-uploaded HDFS archives. > > Thanks, > Archit Goyal > > On Mon, Feb 2, 2026 at 9:38 AM archit goyal <[email protected]> > wrote: > >> Hi all, >> >> Gentle ping on FLIP-563 - would appreciate reviews/feedback from the >> community. >> >> On Wed, Jan 21, 2026 at 3:29 PM archit goyal <[email protected]> >> wrote: >> > >> > Hi All, >> > >> > I am opening this thread to discuss FLIP-563: Support for provided lib >> archives in YARN Application Mode. >> > >> > Today yarn.provided.lib.dirs assumes pre-uploaded directories of jars. >> In practice, many deployments package shared libs as .tgz/.tar.gz and/or >> hit classpath “argument too long” issues when many jars are enumerated. >> > >> > Proposal: introduce yarn.provided.lib.archives to point to pre-uploaded >> HDFS archives. Flink would localize them as public archive resources and >> add a single wildcard classpath entry per archive (e.g., <archiveDir>/*). >> Backward compatible and no change unless configured. >> > >> > Please feel free to reply to this email thread and share your opinions. >> > >> > Thanks, >> > Archit Goyal >> >> >> >> -- >> Yours Sincerely >> Archit Goyal >> Email: [email protected] >> Mobile: +1-347-471-9251 >> > > > -- > Yours Sincerely > Archit Goyal > Email: [email protected] > -- Yours Sincerely Archit Goyal Email: [email protected]
