[
https://issues.apache.org/jira/browse/FLINK-3160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15143547#comment-15143547
]
ASF GitHub Bot commented on FLINK-3160:
---------------------------------------
Github user greghogan commented on the pull request:
https://github.com/apache/flink/pull/1564#issuecomment-183066952
@uce I rebased, made the noted changes, and updated the pull request.
> Aggregate operator statistics by TaskManager
> --------------------------------------------
>
> Key: FLINK-3160
> URL: https://issues.apache.org/jira/browse/FLINK-3160
> Project: Flink
> Issue Type: Improvement
> Components: Webfrontend
> Affects Versions: 1.0.0
> Reporter: Greg Hogan
> Assignee: Greg Hogan
>
> The web client job info page presents a table of the following per task
> statistics: start time, end time, duration, bytes received, records received,
> bytes sent, records sent, attempt, host, status.
> Flink supports clusters with thousands of slots and a job setting a high
> parallelism renders this job info page unwieldy and difficult to analyze in
> real-time.
> It would be helpful to optionally or automatically aggregate statistics by
> TaskManager. These rows could then be expanded to reveal the current per task
> statistics.
> Start time, end time, duration, and attempt are not applicable to a
> TaskManager since new tasks for repeated attempts may be started. Bytes
> received, records received, bytes sent, and records sent are summed. Any
> throughput metrics can be averaged over the total task time or time window.
> Status could reference the number of running tasks on the TaskManager or an
> idle state.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
