GitHub user StoneForests added a comment to the discussion: flink 
yarn-application模式下,是否可以自定义每个flink任务的yarn.provided.lib.dirs

> "/streampark/jars" stores the user's yarn-app mode public jar

Thank you for your reply! I am developing a specific task app.jar, and its 
dependency jar files are all placed in the hdfs://myjar/ directory. When 
launching app.jar in yarn-application mode, I need to specify that the 
dependencies are read from the hdfs://myjar/ directory (i.e., setting 
yarn.provided.lib.dirs=hdfs://myjar/ instead of the default 
hdfs:///streampark/flink/flink-1.14.4/lib;hdfs:///streampark/jars;hdfs:///streampark/plugins;hdfs:///streampark/workspace/<appid>/lib;hdfs://zq-dev-cluster/streampark/shims/flink-1.14).
 However, it seems that in StreamPark, yarn.provided.lib.dirs cannot be 
customized in yarn-application mode. Is there any solution for this?

GitHub link: 
https://github.com/apache/incubator-streampark/discussions/3743#discussioncomment-10248895

----
This is an automatically sent email for dev@streampark.apache.org.
To unsubscribe, please send an email to: dev-unsubscr...@streampark.apache.org

Reply via email to