[ https://issues.apache.org/jira/browse/BEAM-5495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16998160#comment-16998160 ]
Lukasz Gajowy commented on BEAM-5495: ------------------------------------- I did not consider xbean nor knew about it. Since classgraph looked the most promising from what I saw, does the job well and can be easily replaced with other libraries if needed (thanks to the way the whole PR was implemented) I decided to use it. > PipelineResources algorithm is not working in most environments > --------------------------------------------------------------- > > Key: BEAM-5495 > URL: https://issues.apache.org/jira/browse/BEAM-5495 > Project: Beam > Issue Type: Bug > Components: runner-flink, runner-spark, sdk-java-core > Reporter: Romain Manni-Bucau > Assignee: Lukasz Gajowy > Priority: Major > Fix For: 2.19.0 > > Time Spent: 14.5h > Remaining Estimate: 0h > > Issue are: > 1. it assumes the classloader is an URLClassLoader (not always true and java > >= 9 breaks that as well for the app loader) > 2. it uses loader.getURLs() which leads to including the JRE itself in the > staged file > Looks like this detect resource algorithm can't work and should be replaced > by a SPI rather than a built-in and not extensible algorithm. Another valid > alternative is to just drop that "guess" logic and force the user to set > staged files. -- This message was sent by Atlassian Jira (v8.3.4#803005)