[
https://issues.apache.org/jira/browse/OOZIE-2345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rohini Palaniswamy updated OOZIE-2345:
--------------------------------------
Description:
We have few customers whose SLA is 8 min. They have around 30 actions. There
are 25 actions in fork.
Though forked action jobs runs parallely in the cluster, forked action job
submission is sequential.
Whenever NN is slow, job submission takes more time. Even if job submission is
delay for 30 sec. Total WF delay will be ~12 min.
was:
We have few customers whose SLA is 8 min. They have around 30 actions. There
are 25 actions in fork.
Though forked action jobs runs concurrently. forked action job submission is
sequential.
Whenever NN is slow, job submission takes more time. Even if job submission is
delay for 30 sec. Total WF delay will be ~12 min.
Summary: Parallel job submission for forked actions (was: Concurrent
job submission for forked action)
oozie.workflow.parallel.fork.action.start - Can we make this true by default in
oozie-default.xml ?
Change description {{If true, oozie will submit concurrent jobs for all
actions in fork}} to {{Determines how Oozie processes starting of forked
actions. If true, forked actions and their job submissions are done in parallel
which is best for performance. If false, they are submitted sequentially which
is the older approach}}
> Parallel job submission for forked actions
> ------------------------------------------
>
> Key: OOZIE-2345
> URL: https://issues.apache.org/jira/browse/OOZIE-2345
> Project: Oozie
> Issue Type: Bug
> Reporter: Purshotam Shah
> Assignee: Purshotam Shah
> Attachments: OOZIE-2345-V3.patch
>
>
> We have few customers whose SLA is 8 min. They have around 30 actions. There
> are 25 actions in fork.
> Though forked action jobs runs parallely in the cluster, forked action job
> submission is sequential.
> Whenever NN is slow, job submission takes more time. Even if job submission
> is delay for 30 sec. Total WF delay will be ~12 min.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
