Thomas Groh created BEAM-3536:
---------------------------------
Summary: JobService#prepareJob should be one-to-many with
JobService#run
Key: BEAM-3536
URL: https://issues.apache.org/jira/browse/BEAM-3536
Project: Beam
Issue Type: Bug
Components: runner-core
Reporter: Thomas Groh
More specifically, prepare should not require a job; instead, it should return
endpoints for any pre-job work that the client must perform (e.g. staging
artifacts). Once the client has completed any pre-job work, those endpoints
should return tokens by which the results of the pre-job work can be
referenced. #run should then consume those tokens and use them to ensure that
those results are available during execution.
The simple example is that #prepare should return an artifact staging endpoint,
and #run should take tokens returned by that endpoint that it can understand
when executing the job. This permits multiple pipelines to be run with the same
artifacts, among other benefits, and reduces the statefulness of the
prepare-run call sequence.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
