[
https://issues.apache.org/jira/browse/FLINK-11782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
vinoyang updated FLINK-11782:
-----------------------------
Description:
Currently, there are some features to be enhanced when Flink web UI displays
TaskManager logs:
1) Flink web UI can only display the log of task manager and stdout;
2) Flink web UI can only display the latest one log file;
In the log folder of a Task Manager, we usually have more files, including GC
log files, multiple files generated based on the rolling rules of the logging
framework (time or log file size), user's business log files (We internally
implemented the separation of Flink from the user log). For these files, the
current Flink web UI cannot be displayed.
I personally suggest that we can refer to the way YARN displays the container's
log (see attachment 1), first list all the log files (see attachment 2), and
then click to display the files of these logs.
This feature can be independent or part of the log separation (see FLINK-11202).
It has now been added to the design documentation for Log separation:
https://docs.google.com/document/d/1TTYAtFoTWaGCveKDZH394FYdRyNyQFnVoW5AYFvnr5I/edit?usp=sharing
was:
Currently, there are some features to be enhanced when Flink web UI displays
TaskManager logs:
1) Flink web UI can only display the log of task manager and stdout;
2) Flink web UI can only display the latest one log file;
In the log folder of a Task Manager, we usually have more files, including GC
log files, multiple files generated based on the rolling rules of the logging
framework (time or log file size), user's business log files (We internally
implemented the separation of Flink from the user log). For these files, the
current Flink web UI cannot be displayed.
I personally suggest that we can refer to the way YARN displays the container's
log (see attachment 1), first list all the log files (see attachment 2), and
then click to display the files of these logs.
This feature can be independent or part of the log separation (see FLINK-11202).
> Enhance TaskManager log visualization by listing all log files for Flink web
> UI
> -------------------------------------------------------------------------------
>
> Key: FLINK-11782
> URL: https://issues.apache.org/jira/browse/FLINK-11782
> Project: Flink
> Issue Type: Improvement
> Components: Runtime / Web Frontend
> Reporter: vinoyang
> Assignee: vinoyang
> Priority: Major
> Attachments: flink-web-ui-taskmanager-log-files.png,
> yarn-container-log-files.png
>
>
> Currently, there are some features to be enhanced when Flink web UI displays
> TaskManager logs:
> 1) Flink web UI can only display the log of task manager and stdout;
> 2) Flink web UI can only display the latest one log file;
> In the log folder of a Task Manager, we usually have more files, including GC
> log files, multiple files generated based on the rolling rules of the logging
> framework (time or log file size), user's business log files (We internally
> implemented the separation of Flink from the user log). For these files, the
> current Flink web UI cannot be displayed.
> I personally suggest that we can refer to the way YARN displays the
> container's log (see attachment 1), first list all the log files (see
> attachment 2), and then click to display the files of these logs.
>
> This feature can be independent or part of the log separation (see
> FLINK-11202).
> It has now been added to the design documentation for Log separation:
> https://docs.google.com/document/d/1TTYAtFoTWaGCveKDZH394FYdRyNyQFnVoW5AYFvnr5I/edit?usp=sharing
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
