[
https://issues.apache.org/jira/browse/FLINK-17745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111214#comment-17111214
]
Kostas Kloudas commented on FLINK-17745:
----------------------------------------
[~Echo Lee] if I understand correctly the structure of the jar, you have, for
example, your UDF classes at the "top-level" of your fat jar's dir structure,
and then, in a nested {{lib/}} folder, you have the dependencies.
In this case, if you include only the {{lib/}}, where will the TMs find your
UDFs? What should be done is extract the libs, ship them independently and then
send only your "thin" fat jar, without the libs anymore. Again, this is if I
understand the structure of your jar correctly.
> PackagedProgram' extractedTempLibraries and jarfiles may be duplicate
> ---------------------------------------------------------------------
>
> Key: FLINK-17745
> URL: https://issues.apache.org/jira/browse/FLINK-17745
> Project: Flink
> Issue Type: Improvement
> Components: Client / Job Submission
> Reporter: Echo Lee
> Assignee: Kostas Kloudas
> Priority: Major
> Labels: pull-request-available
>
> When i submit a flink app with a fat jar, PackagedProgram will extracted temp
> libraries by the fat jar, and add to pipeline.jars, and the pipeline.jars
> contains fat jar and temp libraries. I don't think we should add fat jar to
> the pipeline.jars if extractedTempLibraries is not empty.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
