[
https://issues.apache.org/jira/browse/FLINK-21143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272524#comment-17272524
]
zhisheng commented on FLINK-21143:
----------------------------------
[~fly_in_gis] The job can be submitted successfully, and after submitting, I
went to see that the file handle of the corresponding TaskManager process is
indeed a file connected to HDFS, eg:
/data/HDATA/yarn/local/filecache/40/flink-sql-connector-hbase
-2.2_2.11-1.12.0.jar
But it actually seems that the business logic of the job has not read the
latest jar. Once I keep the jar under lib/ consistent with the jar of HDFS,
then the problem is gone, so I suspect it is still reading the local jar
> 【runtime】flink job use the lib jars instead of the `yarn.provided.lib.dirs`
> config jars
> ---------------------------------------------------------------------------------------
>
> Key: FLINK-21143
> URL: https://issues.apache.org/jira/browse/FLINK-21143
> Project: Flink
> Issue Type: Bug
> Components: Deployment / YARN, Runtime / Configuration
> Affects Versions: 1.12.0
> Reporter: zhisheng
> Priority: Major
> Attachments: flink-deploy-sql-client-.log, flink-deploy-sql-client.log
>
>
> Flink 1.12.0, I had use `yarn.provided.lib.dirs` config to speed up the job
> start，so I upload all jars in HDFS，but I update the jars in HDFS（not
> flink-1.12.0/lib/），it will still use the lib/ jars instead of use the new
> HDFS jars when I submit new job.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
