[
https://issues.apache.org/jira/browse/FLINK-38958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Archit Goyal updated FLINK-38958:
---------------------------------
Description: Add support for *provided lib archives* in Flink *YARN
Application Mode* via a new config {{{}yarn.provided.lib.archives{}}}, enabling
reuse of pre-uploaded, world-readable *.tgz/.tar.gz* artifacts and avoiding
classpath “argument too long” failures. (was: Currently with
{*}yarn.provided.lib.dirs{*}, Flink libs can be copied to HDFS location in each
cluster and when set Flink tries to reuse the same jars avoiding uploading it
every time and YARN also caches it in the nodes.
This works fine with jars but if we try to add the xml file parent directory to
path, Flink job submission fails. If I add the parent directory of the xml to
the
{noformat}
yarn.ship-files{noformat}
Flink job is submitted successfully.)
> Support provided lib archives for YARN application mode
> -------------------------------------------------------
>
> Key: FLINK-38958
> URL: https://issues.apache.org/jira/browse/FLINK-38958
> Project: Flink
> Issue Type: New Feature
> Components: Deployment / YARN
> Reporter: Archit Goyal
> Assignee: Archit Goyal
> Priority: Minor
> Labels: pull-request-available
> Fix For: 1.19.0
>
>
> Add support for *provided lib archives* in Flink *YARN Application Mode* via
> a new config {{{}yarn.provided.lib.archives{}}}, enabling reuse of
> pre-uploaded, world-readable *.tgz/.tar.gz* artifacts and avoiding classpath
> “argument too long” failures.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
