[
https://issues.apache.org/jira/browse/FLINK-12953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16875639#comment-16875639
]
Chad Dombrova commented on FLINK-12953:
---------------------------------------
Here's a gif demonstrating the log viewer in Google Dataflow:
!dataflow-log-ux.gif!
Without a transform selected, it display the general output for the job runner.
With a transform selected, it displays the logged messages output specifically
by that transform, if there are any. The log view updates in close to real time.
It uses the Stackdriver service – which is like Elasticsearch – for log
capture and query.
The requirements from my end are:
- view the log for a job from the job view
- see updates to the log in close to real time
- delete logs for the job when the job is deleted
- filter job log based on selected transform (ideal, but optional)
This issue might be considered a duplicate of FLINK-11202, I'll let you decide.
> View logs from Job view in Web Dashboard
> ----------------------------------------
>
> Key: FLINK-12953
> URL: https://issues.apache.org/jira/browse/FLINK-12953
> Project: Flink
> Issue Type: Improvement
> Components: Runtime / Web Frontend
> Reporter: Chad Dombrova
> Priority: Major
> Attachments: dataflow-log-ux.gif
>
>
> As a (beam) developer I want to be able to print/log information from my
> custom transforms, and then monitor that output within the job view of the
> Web Dashboard, so that I don't have to go hunting through the combined log in
> the Task Manager view. The Task Manager log has way too much in it,
> spanning all jobs, including output logged by both flink and user code.
> A good example of how this UX should work can be found in Google Dataflow:
> - click on a job, and see the logged output for that job
> - click on a transform, and see the logged output for just that transform
> thanks!
> Edited: changed Job Manager to Task Manager
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)