Hello all, While going through the codebase I noticed a problem with the Beam JobService. In particular, the API allows for the possibility of never seeing some messages or states with Get(State|Message)Stream. This is because the Get(State|Message)Stream calls need to have the job id which can only be obtained from the RunJobResponse. But in order to see all messages/states the streams need to be opened before the job starts.
This is fine in Dataflow as the preparation_id == job_id, but this is not true in Flink. What do you all think of this? Am I misunderstanding something? Thanks, Sam
