Luke Cwik created BEAM-9578:
-------------------------------
Summary: Enumerating artifacts is too expensive in Java
Key: BEAM-9578
URL: https://issues.apache.org/jira/browse/BEAM-9578
Project: Beam
Issue Type: Bug
Components: sdk-java-core
Reporter: Luke Cwik
Assignee: Heejong Lee
Fix For: 2.21.0
There are a lot of places (e.g. **ParDoTranslation#getParDoPayload**) which
effectively call **Environments#createOrGetDefaultEnvironment** which causes
[artifacts to be
computed|https://github.com/apache/beam/blob/fc6cef9972780ca6b7525d4aadd65a8344221f1b/runners/core-construction-java/src/main/java/org/apache/beam/runners/core/construction/Environments.java#L114].
This leads to zipping directories for non-jar dependencies.
Similar problems may exist for Python/Go.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
