[
https://issues.apache.org/jira/browse/TEZ-3251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15279518#comment-15279518
]
Prasanth Jayachandran commented on TEZ-3251:
--------------------------------------------
The primary use case is to provide thread level counters for hive llap. Since
tez task runs in a thread some counters like cpu time, gc time and file system
statistics are disabled ([~sseth] Can tell where exactly is this disabled). I
am working on a task to provide file system statistics per query fragment that
is executed in llap.
For this to work, 2 things are required
a) Collect stats before and after the task execution in thread (delta
difference) - I am using a custom executor service that records the file system
stats in beforeExecute() and afterExecute() hooks of the executor service. This
custom executor service will be provided to the TaskRunner2Callable and the
stats will be captured in the above hooks.
b) Update the captured statistics to the tez task counters.
To achieve a) TEZ-3250 is required and to achieve b) I need someway to put the
captured counters to the task. Since task is private inside
TaskRunner2Callable, I added addAndGetCounters() API so that I can file system
counters to the task from llap.
> Allow ability to add custom counters to TaskRunner2Callable
> -----------------------------------------------------------
>
> Key: TEZ-3251
> URL: https://issues.apache.org/jira/browse/TEZ-3251
> Project: Apache Tez
> Issue Type: Bug
> Affects Versions: 0.8.3, 0.9.0
> Reporter: Prasanth Jayachandran
> Assignee: Prasanth Jayachandran
> Attachments: TEZ-3151.1.patch
>
>
> TaskRunner2Callable contains RuntimeTask internally. It should provide an API
> to add counters to the runtime task. This is required for hive on llap to add
> thread specific counters.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
