Maximilian Michels created BEAM-5859: ----------------------------------------
Summary: Improve Traceability of Pipeline translation Key: BEAM-5859 URL: https://issues.apache.org/jira/browse/BEAM-5859 Project: Beam Issue Type: Improvement Components: runner-flink Reporter: Maximilian Michels Users often ask how they can reason about the pipeline translation. The Flink UI display a confusingly large graph without any trace of the original Beam pipeline: WordCount: !image-2018-10-25-19-33-48-626.png! TFX: !image-2018-10-25-19-23-04-301.png! Some aspects which make understanding these graphs hard: * Users don't know how the Runner maps Beam to Flink concepts * The UI is awfully slow / hangs when the pipeline is reasonable complex * The operator names seem to use {{transform.getUniqueName()}} which doesn't generate readable name * So called Chaining combines operators into a single operator which makes understanding which Beam concept belongs to which Flink concept even harder -- This message was sent by Atlassian JIRA (v7.6.3#76005)