Maximilian Michels created BEAM-5859:
----------------------------------------
Summary: Improve Traceability of Pipeline translation
Key: BEAM-5859
URL: https://issues.apache.org/jira/browse/BEAM-5859
Project: Beam
Issue Type: Improvement
Components: runner-flink
Reporter: Maximilian Michels
Users often ask how they can reason about the pipeline translation. The Flink
UI display a confusingly large graph without any trace of the original Beam
pipeline:
WordCount:
!image-2018-10-25-19-33-48-626.png!
TFX:
!image-2018-10-25-19-23-04-301.png!
Some aspects which make understanding these graphs hard:
* Users don't know how the Runner maps Beam to Flink concepts
* The UI is awfully slow / hangs when the pipeline is reasonable complex
* The operator names seem to use {{transform.getUniqueName()}} which doesn't
generate readable name
* So called Chaining combines operators into a single operator which makes
understanding which Beam concept belongs to which Flink concept even harder
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
