[
https://issues.apache.org/jira/browse/OOZIE-3647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Junfan Zhang updated OOZIE-3647:
--------------------------------
Description:
-Now in {{ActionCheckerService}} and {{{}CoordMaterializeTriggerService{}}},
the callables will be queued using the
{{{}CallableQueueService.queueSerial{}}}. In the internal implementation of
{{{}queueSerial{}}}, all callables will be composited as single
{{{}CompositeCallable{}}}, which means it will be executed in single thread
serially.-
-To speed to the execution time, we should set the default number of callables
in a batch in {{ActionCheckerService}} and
{{{}CoordMaterializeTriggerService{}}}, like the-
[-RecoveryService-|https://github.com/apache/oozie/blob/e010fbda91bd78cccb227fc872b3ddd317a5ce6a/core/src/main/java/org/apache/oozie/service/RecoveryService.java#L453]
Oozie should use the {{ConfigurationService.getInt}} instead of
{{Services.get().getConf().getInt}}, and the default value should be added in
oozie-default.xml.
was:
Now in {{ActionCheckerService}} and {{CoordMaterializeTriggerService}}, the
callables will be queued using the {{CallableQueueService.queueSerial}}. In the
internal implementation of {{queueSerial}}, all callables will be composited as
single {{CompositeCallable}}, which means it will be executed in single thread
serially.
To speed to the execution time, we should set the default number of callables
in a batch in {{ActionCheckerService}} and {{CoordMaterializeTriggerService}},
like the
[RecoveryService|https://github.com/apache/oozie/blob/e010fbda91bd78cccb227fc872b3ddd317a5ce6a/core/src/main/java/org/apache/oozie/service/RecoveryService.java#L453]
> Set the default number of callables to be queued in a batch to speed up
> -----------------------------------------------------------------------
>
> Key: OOZIE-3647
> URL: https://issues.apache.org/jira/browse/OOZIE-3647
> Project: Oozie
> Issue Type: Improvement
> Reporter: Junfan Zhang
> Priority: Major
>
> -Now in {{ActionCheckerService}} and {{{}CoordMaterializeTriggerService{}}},
> the callables will be queued using the
> {{{}CallableQueueService.queueSerial{}}}. In the internal implementation of
> {{{}queueSerial{}}}, all callables will be composited as single
> {{{}CompositeCallable{}}}, which means it will be executed in single thread
> serially.-
> -To speed to the execution time, we should set the default number of
> callables in a batch in {{ActionCheckerService}} and
> {{{}CoordMaterializeTriggerService{}}}, like the-
> [-RecoveryService-|https://github.com/apache/oozie/blob/e010fbda91bd78cccb227fc872b3ddd317a5ce6a/core/src/main/java/org/apache/oozie/service/RecoveryService.java#L453]
>
> Oozie should use the {{ConfigurationService.getInt}} instead of
> {{Services.get().getConf().getInt}}, and the default value should be added in
> oozie-default.xml.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
