[
https://issues.apache.org/jira/browse/OOZIE-103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13101838#comment-13101838
]
Hadoop QA commented on OOZIE-103:
---------------------------------
anew remarked:
In general, I believe that the Hadoop itself should protect itself from
overload. At the same time, Oozie should minimize the load it puts on Hadoop,
regardless of whether Hadoop is under stress. Mainly this means Oozie shoud
minimize the amount of polling. Reliable notification from job tracker would
help with that. Active notification for new data (from HDFS or from a meta data
system such as Howl) would help, too.
When Oozie is idle, then it does not matter whether it has no knowledge of
Hadoop load. Because when Oozie is idle, then there is nothing to throttle. So
for the short term, I would prefer approach 2.
> GH-68: Better reporting/handling of problems in Hadoop
> ------------------------------------------------------
>
> Key: OOZIE-103
> URL: https://issues.apache.org/jira/browse/OOZIE-103
> Project: Oozie
> Issue Type: Bug
> Reporter: Hadoop QA
>
> Add instrumentation to track performance stats of NN and JT (how long to get
> directory listing on hdfs; how long to submit a job or query JT queue)
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
