[ 
https://issues.apache.org/jira/browse/FLINK-12953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16875639#comment-16875639
 ] 

Chad Dombrova commented on FLINK-12953:
---------------------------------------

Here's a gif demonstrating the log viewer in Google Dataflow:

!dataflow-log-ux.gif!

Without a transform selected, it display the general output for the job runner. 
With a transform selected, it displays the logged messages output specifically 
by that transform, if there are any. The log view updates in close to real time.

It uses the Stackdriver service –  which is like Elasticsearch – for log 
capture and query.

The requirements from my end are:
 - view the log for a job from the job view
 - see updates to the log in close to real time
 - delete logs for the job when the job is deleted
 - filter job log based on selected transform (ideal, but optional)

This issue might be considered a duplicate of FLINK-11202, I'll let you decide.

> View logs from Job view in Web Dashboard
> ----------------------------------------
>
>                 Key: FLINK-12953
>                 URL: https://issues.apache.org/jira/browse/FLINK-12953
>             Project: Flink
>          Issue Type: Improvement
>          Components: Runtime / Web Frontend
>            Reporter: Chad Dombrova
>            Priority: Major
>         Attachments: dataflow-log-ux.gif
>
>
> As a (beam) developer I want to be able to print/log information from my 
> custom transforms, and then monitor that output within the job view of the 
> Web Dashboard, so that I don't have to go hunting through the combined log in 
> the Task Manager view.   The Task Manager log has way too much in it, 
> spanning all jobs, including output logged by both flink and user code.
> A good example of how this UX should work can be found in Google Dataflow:  
> - click on a job, and see the logged output for that job
> - click on a transform, and see the logged output for just that transform
> thanks!
> Edited:  changed Job Manager to Task Manager



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to