Kyle Weaver created BEAM-12439:
----------------------------------
Summary: Reuse job servers when possible in
(spark|flink)_runner.py.
Key: BEAM-12439
URL: https://issues.apache.org/jira/browse/BEAM-12439
Project: Beam
Issue Type: Improvement
Components: runner-flink, runner-spark, sdk-py-core
Reporter: Kyle Weaver
Assignee: Kyle Weaver
If multiple Beam pipelines are run on Spark or Flink from the same Python
script, currently a new Java job server will be created for each pipeline. This
can waste lots of resources (i.e. memory), since job servers are often
functionally equivalent and therefore reusable.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
