[
https://issues.apache.org/jira/browse/TEZ-3611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15868392#comment-15868392
]
Siddharth Seth commented on TEZ-3611:
-------------------------------------
Removing the counters is probably the biggest gain. Though we should not do it
earlier because they are used on the main listing page. Polled some people
about the usefulness of the counters on the main listing page - noone had used
them. Given we can't list a lot of dags on the main listing page, I suspect the
counters are not very useful. Given this feedback, we should remove the
counters also.
cc [~jeagles], [~rohini] - do you use counters on the main dag listing page?
We'd like to get rid of these so that the listing page load time improves. If
they're used, I think we should create a separate page which gets this
information.
> Create lightweight summary events for ATS.
> ------------------------------------------
>
> Key: TEZ-3611
> URL: https://issues.apache.org/jira/browse/TEZ-3611
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Harish Jaiprakash
> Assignee: Harish Jaiprakash
> Attachments: TEZ-3611.01.patch, TEZ-3611.02.patch
>
>
> All DAG*Event are summary logs. DAGSubmittedEvent has dagPlan in it and
> DAGFinishedEvent has counters in it. And hence these events very large, which
> makes the dag landing page on the tez-ui very expensive.
> Split these events into two parts:
> * One which contains only data used by the tez-ui "All Dags" page which will
> go into summary log.
> * Another which will contain the current object, which will be part of the
> appropriate TimelineEntityGroupId.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
