Sam Rohde created BEAM-6442:
-------------------------------
Summary: Incomplete JobService API Semantics
Key: BEAM-6442
URL: https://issues.apache.org/jira/browse/BEAM-6442
Project: Beam
Issue Type: Test
Components: beam-model
Affects Versions: 2.9.0
Reporter: Sam Rohde
Assignee: Sam Rohde
The JobService API (beam_job_api.proto) allows for the possibility of never
seeing messages or states with Get(State|Message)Stream. This is because the
Get(State|Message)Stream calls need to have the job id which can only be
obtained from the RunJobResponse. But in order to see all messages/states the
streams need to be opened before the job starts.
This is fine in Dataflow as the preparation_id == job_id, but this is not true
in Flink.
Fix is to modify the API to only keep a single id to be used between the
preparation/run APIs.
Consumers of the API will have to be modified to meet the new semantics.
Dev list thread
(https://lists.apache.org/thread.html/3ace7585278c0545185fa4bb8d6975283d5c48c097e1bb2c2e18b9a2@%3Cdev.beam.apache.org%3E)
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
