[
https://issues.apache.org/jira/browse/FLINK-36073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17881352#comment-17881352
]
Ferenc Csaky commented on FLINK-36073:
--------------------------------------
Hey [~rmetzger],
Finally had some time to play with this. Since back in the day I did not test
the original DFS artifact fetch with the operator at all, and I was also not
familiar what the {{ENABLE_BUILT_IN_PLUGINS}} part actually does. Originally my
guess was there might be some extra logic to handle this on the operator side.
Now I checked that it's simply a handy shortcut that is part of the starter
script of the official Flink docker image [1]. So it is totally orthogonal to
the operator. I now compiled and deployed the k8s operator {{main}} branch and
deployed a basic job which is basically the same you had in your original
example [2] and it works without any problems.
Do you have any downstream changes? Can you try this again in your env?
[1]
https://github.com/apache/flink-docker/blob/9d335b16e579d3207b769118990a602b8584b63d/1.19/scala_2.12-java11-ubuntu/docker-entrypoint.sh#L41
[2] https://gist.github.com/ferenc-csaky/9499d3e6f4cbc657970927ae4844707e
> ApplicationMode with the K8s operator does not support downloading jars via
> filesystem plugins
> ----------------------------------------------------------------------------------------------
>
> Key: FLINK-36073
> URL: https://issues.apache.org/jira/browse/FLINK-36073
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Coordination
> Affects Versions: 2.0.0, 1.19.2, 1.20.1
> Reporter: Robert Metzger
> Assignee: Ferenc Csaky
> Priority: Major
>
> As discussed in this ticket https://issues.apache.org/jira/browse/FLINK-28915
> we can not define a FlinkDeployment spec with
> {code}
> spec:
> job:
> jarURI: s3://myDevBucket/myjob.jar
> {code}
> It fails with:
> {code}
> org.apache.flink.container.entrypoint.StandaloneApplicationClusterEntryPoint.main(StandaloneApplicationClusterEntryPoint.java:89)
> [flink-dist-1.19-x.jar:1.19-x]
> Caused by: java.net.MalformedURLException: unknown protocol: s3
> at java.net.URL.<init>(URL.java:652) ~[?:?]
> at java.net.URL.<init>(URL.java:541) ~[?:?]
> at java.net.URL.<init>(URL.java:488) ~[?:?]
> at
> org.apache.flink.configuration.ConfigUtils.decodeListFromConfig(ConfigUtils.java:133)
> ~[flink-dist-1.19-x.jar:1.19-x]
> at
> org.apache.flink.client.program.DefaultPackagedProgramRetriever.getClasspathsFromConfiguration(DefaultPackagedProgramRetriever.java:273)
> ~[flink-dist-1.19-x.jar:1.19-x]
> at
> org.apache.flink.client.program.DefaultPackagedProgramRetriever.create(DefaultPackagedProgramRetriever.java:121)
> ~[flink-dist-1.19-x.jar:1.19-x]
> ... 4 more
> {code}
> even though I have defined:
> {code}
> podTemplate:
> spec:
> containers:
> - name: flink-main-container
> env:
> - name: ENABLE_BUILT_IN_PLUGINS
> value: "flink-s3-fs-presto-1.19.0.jar"
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
