[
https://issues.apache.org/jira/browse/OOZIE-1455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13710225#comment-13710225
]
Sergey commented on OOZIE-1455:
-------------------------------
No, I've tried to CROSS (like in apache Pig) concurrency and throttle values.
Here is the result:
A coordinaor defenition head:
{code}
<coordinator-app name="xvlrCellTimeSpentCoord" frequency="60"
start="${xvlrCellTimeSpentCoordStart}"
end="${xvlrCellTimeSpentCoordEnd}" timezone="GMT+04:00"
xmlns="uri:oozie:coordinator:0.4"><!-- 2113-01-01T00:05Z -->
<controls>
<timeout>7200</timeout>
<concurrency>1</concurrency>
<throttle>1</throttle>
</controls>
<!-- more tags go here... -->
{code}
An action materialization calendar:
{code}
6 Wed, 12 Jun 2013 14:10:00 WAITING
hdfs://nameservice1/derivative/stream/last_xvlr_24h/2013/06/12/13 Wed, 17
Jul 2013 00:48:56 Wed, 17 Jul 2013 00:50:57
0001444-130705182854792-oozie-oozi-C@6 -
5 Wed, 12 Jun 2013 13:10:00 RUNNING Wed, 17 Jul 2013
00:43:55 Wed, 17 Jul 2013 00:50:52 0... 0...
4 Wed, 12 Jun 2013 12:10:00 SUCCEEDED Wed, 17 Jul 2013
00:33:53 Wed, 17 Jul 2013 00:50:49 0... 0...
3 Wed, 12 Jun 2013 11:10:00 SUCCEEDED Wed, 17 Jul 2013
00:28:52 Wed, 17 Jul 2013 00:43:07 0... 0...
2 Wed, 12 Jun 2013 10:10:00 SUCCEEDED Wed, 17 Jul 2013
00:23:51 Wed, 17 Jul 2013 00:35:05 0... 0...
{code}
A log records:
{code}
2013-07-17 00:43:54,713 INFO
org.apache.oozie.command.coord.CoordMaterializeTransitionXCommand: USER[oozie]
GROUP[-] TOKEN[] APP[xvlrCellTimeSpentCoord]
JOB[0001444-130705182854792-oozie-oozi-C] ACTION[-] materialize actions for
tz=GMT+04:00,
start=Wed Jun 12 13:10:00 MSK 2013, end=Wed Jun 12 14:10:00 MSK 2013,
timeUnit 12,
frequency :60:MINUTE,
lastActionNumber 4
2013-07-17 00:43:55,333 INFO
org.apache.oozie.command.coord.CoordActionNotificationXCommand: USER[-]
GROUP[-] TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@5] STARTED Coordinator Notification
actionId=0001444-130705182854792-oozie-oozi-C@5 : WAITING
2013-07-17 00:43:55,334 INFO
org.apache.oozie.command.coord.CoordActionNotificationXCommand: USER[-]
GROUP[-] TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@5] No Notification URL is defined.
Therefore nothing to notify for job 0001444-130705182854792-oozie-oozi-C action
ID 0001444-130705182854792-oozie-oozi-C@5
2013-07-17 00:43:55,335 INFO
org.apache.oozie.command.coord.CoordActionNotificationXCommand: USER[-]
GROUP[-] TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@5] ENDED Coordinator Notification
actionId=0001444-130705182854792-oozie-oozi-C@5
2013-07-17 00:43:55,337 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@5]
[0001444-130705182854792-oozie-oozi-C@5]::ActionInputCheck:: Action is in
WAITING state.
2013-07-17 00:43:55,338 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@5]
[0001444-130705182854792-oozie-oozi-C@5]::CoordActionInputCheck:: Missing
deps:hdfs://nameservice1/masterdata/source/xvlr/archive/2013/06/12/12/_SUCCESS
2013-07-17 00:43:55,339 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@5]
[0001444-130705182854792-oozie-oozi-C@5]::ActionInputCheck:: In
checkResolvedUris...
2013-07-17 00:43:55,340 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@5]
[0001444-130705182854792-oozie-oozi-C@5]::ActionInputCheck:: In
checkListOfPaths:
hdfs://nameservice1/masterdata/source/xvlr/archive/2013/06/12/12/_SUCCESS is
Missing.
2013-07-17 00:43:55,391 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@5]
[0001444-130705182854792-oozie-oozi-C@5]::ActionInputCheck::
File:hdfs://nameservice1/masterdata/source/xvlr/archive/2013/06/12/12/_SUCCESS,
Exists? :true
2013-07-17 00:43:55,425 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@5]
[0001444-130705182854792-oozie-oozi-C@5]::ActionInputCheck::
File:hdfs://nameservice1/derivative/dict/tiled_gsmcell/archive/2013/06/12,
Exists? :true
2013-07-17 00:43:55,458 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@5]
[0001444-130705182854792-oozie-oozi-C@5]::ActionInputCheck::
File:hdfs://nameservice1/derivative/stream/last_xvlr_24h/2013/06/12/12, Exists?
:false
2013-07-17 00:44:56,423 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@5]
[0001444-130705182854792-oozie-oozi-C@5]::ActionInputCheck:: Action is in
WAITING state.
2013-07-17 00:44:56,426 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@5]
[0001444-130705182854792-oozie-oozi-C@5]::CoordActionInputCheck:: Missing
deps:hdfs://nameservice1/derivative/stream/last_xvlr_24h/2013/06/12/12
2013-07-17 00:44:56,427 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@5]
[0001444-130705182854792-oozie-oozi-C@5]::ActionInputCheck:: In
checkResolvedUris...
2013-07-17 00:44:56,427 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@5]
[0001444-130705182854792-oozie-oozi-C@5]::ActionInputCheck:: In
checkListOfPaths:
hdfs://nameservice1/derivative/stream/last_xvlr_24h/2013/06/12/12 is Missing.
2013-07-17 00:44:56,462 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@5]
[0001444-130705182854792-oozie-oozi-C@5]::ActionInputCheck::
File:hdfs://nameservice1/derivative/stream/last_xvlr_24h/2013/06/12/12, Exists?
:false
2013-07-17 00:45:57,043 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@5]
[0001444-130705182854792-oozie-oozi-C@5]::ActionInputCheck:: Action is in
WAITING state.
2013-07-17 00:45:57,045 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@5]
[0001444-130705182854792-oozie-oozi-C@5]::CoordActionInputCheck:: Missing
deps:hdfs://nameservice1/derivative/stream/last_xvlr_24h/2013/06/12/12
2013-07-17 00:45:57,047 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@5]
[0001444-130705182854792-oozie-oozi-C@5]::ActionInputCheck:: In
checkResolvedUris...
2013-07-17 00:45:57,047 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@5]
[0001444-130705182854792-oozie-oozi-C@5]::ActionInputCheck:: In
checkListOfPaths:
hdfs://nameservice1/derivative/stream/last_xvlr_24h/2013/06/12/12 is Missing.
2013-07-17 00:45:57,089 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@5]
[0001444-130705182854792-oozie-oozi-C@5]::ActionInputCheck::
File:hdfs://nameservice1/derivative/stream/last_xvlr_24h/2013/06/12/12, Exists?
:false
2013-07-17 00:46:57,609 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@5]
[0001444-130705182854792-oozie-oozi-C@5]::ActionInputCheck:: Action is in
WAITING state.
2013-07-17 00:46:57,612 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@5]
[0001444-130705182854792-oozie-oozi-C@5]::CoordActionInputCheck:: Missing
deps:hdfs://nameservice1/derivative/stream/last_xvlr_24h/2013/06/12/12
2013-07-17 00:46:57,614 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@5]
[0001444-130705182854792-oozie-oozi-C@5]::ActionInputCheck:: In
checkResolvedUris...
2013-07-17 00:46:57,614 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@5]
[0001444-130705182854792-oozie-oozi-C@5]::ActionInputCheck:: In
checkListOfPaths:
hdfs://nameservice1/derivative/stream/last_xvlr_24h/2013/06/12/12 is Missing.
2013-07-17 00:46:57,645 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@5]
[0001444-130705182854792-oozie-oozi-C@5]::ActionInputCheck::
File:hdfs://nameservice1/derivative/stream/last_xvlr_24h/2013/06/12/12, Exists?
:false
2013-07-17 00:47:58,184 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@5]
[0001444-130705182854792-oozie-oozi-C@5]::ActionInputCheck:: Action is in
WAITING state.
2013-07-17 00:47:58,187 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@5]
[0001444-130705182854792-oozie-oozi-C@5]::CoordActionInputCheck:: Missing
deps:hdfs://nameservice1/derivative/stream/last_xvlr_24h/2013/06/12/12
2013-07-17 00:47:58,188 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@5]
[0001444-130705182854792-oozie-oozi-C@5]::ActionInputCheck:: In
checkResolvedUris...
2013-07-17 00:47:58,188 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@5]
[0001444-130705182854792-oozie-oozi-C@5]::ActionInputCheck:: In
checkListOfPaths:
hdfs://nameservice1/derivative/stream/last_xvlr_24h/2013/06/12/12 is Missing.
2013-07-17 00:47:58,238 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@5]
[0001444-130705182854792-oozie-oozi-C@5]::ActionInputCheck::
File:hdfs://nameservice1/derivative/stream/last_xvlr_24h/2013/06/12/12, Exists?
:true
2013-07-17 00:47:59,155 WARN
org.apache.oozie.command.coord.CoordActionReadyXCommand: USER[oozie] GROUP[-]
TOKEN[] APP[xvlrCellTimeSpentCoord] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[-] No actions to start! for jobId=0001444-130705182854792-oozie-oozi-C
2013-07-17 00:48:55,794 INFO
org.apache.oozie.command.coord.CoordMaterializeTransitionXCommand: USER[oozie]
GROUP[-] TOKEN[] APP[xvlrCellTimeSpentCoord]
JOB[0001444-130705182854792-oozie-oozi-C] ACTION[-] materialize actions for
tz=GMT+04:00,
start=Wed Jun 12 14:10:00 MSK 2013, end=Wed Jun 12 15:10:00 MSK 2013,
timeUnit 12,
frequency :60:MINUTE,
lastActionNumber 5
2013-07-17 00:48:56,289 INFO
org.apache.oozie.command.coord.CoordActionNotificationXCommand: USER[-]
GROUP[-] TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@6] STARTED Coordinator Notification
actionId=0001444-130705182854792-oozie-oozi-C@6 : WAITING
2013-07-17 00:48:56,291 INFO
org.apache.oozie.command.coord.CoordActionNotificationXCommand: USER[-]
GROUP[-] TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@6] No Notification URL is defined.
Therefore nothing to notify for job 0001444-130705182854792-oozie-oozi-C action
ID 0001444-130705182854792-oozie-oozi-C@6
2013-07-17 00:48:56,291 INFO
org.apache.oozie.command.coord.CoordActionNotificationXCommand: USER[-]
GROUP[-] TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@6] ENDED Coordinator Notification
actionId=0001444-130705182854792-oozie-oozi-C@6
2013-07-17 00:48:56,294 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@6]
[0001444-130705182854792-oozie-oozi-C@6]::ActionInputCheck:: Action is in
WAITING state.
2013-07-17 00:48:56,299 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@6]
[0001444-130705182854792-oozie-oozi-C@6]::CoordActionInputCheck:: Missing
deps:hdfs://nameservice1/masterdata/source/xvlr/archive/2013/06/12/13/_SUCCESS
2013-07-17 00:48:56,300 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@6]
[0001444-130705182854792-oozie-oozi-C@6]::ActionInputCheck:: In
checkResolvedUris...
2013-07-17 00:48:56,300 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@6]
[0001444-130705182854792-oozie-oozi-C@6]::ActionInputCheck:: In
checkListOfPaths:
hdfs://nameservice1/masterdata/source/xvlr/archive/2013/06/12/13/_SUCCESS is
Missing.
2013-07-17 00:48:56,330 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@6]
[0001444-130705182854792-oozie-oozi-C@6]::ActionInputCheck::
File:hdfs://nameservice1/masterdata/source/xvlr/archive/2013/06/12/13/_SUCCESS,
Exists? :true
2013-07-17 00:48:56,353 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@6]
[0001444-130705182854792-oozie-oozi-C@6]::ActionInputCheck::
File:hdfs://nameservice1/derivative/dict/tiled_gsmcell/archive/2013/06/12,
Exists? :true
2013-07-17 00:48:56,372 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@6]
[0001444-130705182854792-oozie-oozi-C@6]::ActionInputCheck::
File:hdfs://nameservice1/derivative/stream/last_xvlr_24h/2013/06/12/13, Exists?
:false
2013-07-17 00:49:57,068 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@6]
[0001444-130705182854792-oozie-oozi-C@6]::ActionInputCheck:: Action is in
WAITING state.
2013-07-17 00:49:57,071 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@6]
[0001444-130705182854792-oozie-oozi-C@6]::CoordActionInputCheck:: Missing
deps:hdfs://nameservice1/derivative/stream/last_xvlr_24h/2013/06/12/13
2013-07-17 00:49:57,082 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@6]
[0001444-130705182854792-oozie-oozi-C@6]::ActionInputCheck:: In
checkResolvedUris...
2013-07-17 00:49:57,082 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@6]
[0001444-130705182854792-oozie-oozi-C@6]::ActionInputCheck:: In
checkListOfPaths:
hdfs://nameservice1/derivative/stream/last_xvlr_24h/2013/06/12/13 is Missing.
2013-07-17 00:49:57,128 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@6]
[0001444-130705182854792-oozie-oozi-C@6]::ActionInputCheck::
File:hdfs://nameservice1/derivative/stream/last_xvlr_24h/2013/06/12/13, Exists?
:false
2013-07-17 00:50:52,024 WARN org.apache.oozie.util.ParameterVerifier: USER[-]
GROUP[-] TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@5] The application does not define
formal parameters in its XML definition
2013-07-17 00:50:57,644 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@6]
[0001444-130705182854792-oozie-oozi-C@6]::ActionInputCheck:: Action is in
WAITING state.
2013-07-17 00:50:57,646 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@6]
[0001444-130705182854792-oozie-oozi-C@6]::CoordActionInputCheck:: Missing
deps:hdfs://nameservice1/derivative/stream/last_xvlr_24h/2013/06/12/13
2013-07-17 00:50:57,648 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@6]
[0001444-130705182854792-oozie-oozi-C@6]::ActionInputCheck:: In
checkResolvedUris...
2013-07-17 00:50:57,648 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@6]
[0001444-130705182854792-oozie-oozi-C@6]::ActionInputCheck:: In
checkListOfPaths:
hdfs://nameservice1/derivative/stream/last_xvlr_24h/2013/06/12/13 is Missing.
2013-07-17 00:50:57,683 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@6]
[0001444-130705182854792-oozie-oozi-C@6]::ActionInputCheck::
File:hdfs://nameservice1/derivative/stream/last_xvlr_24h/2013/06/12/13, Exists?
:false
2013-07-17 00:51:58,174 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@6]
[0001444-130705182854792-oozie-oozi-C@6]::ActionInputCheck:: Action is in
WAITING state.
2013-07-17 00:51:58,176 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@6]
[0001444-130705182854792-oozie-oozi-C@6]::CoordActionInputCheck:: Missing
deps:hdfs://nameservice1/derivative/stream/last_xvlr_24h/2013/06/12/13
2013-07-17 00:51:58,178 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@6]
[0001444-130705182854792-oozie-oozi-C@6]::ActionInputCheck:: In
checkResolvedUris...
2013-07-17 00:51:58,178 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@6]
[0001444-130705182854792-oozie-oozi-C@6]::ActionInputCheck:: In
checkListOfPaths:
hdfs://nameservice1/derivative/stream/last_xvlr_24h/2013/06/12/13 is Missing.
2013-07-17 00:51:58,223 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@6]
[0001444-130705182854792-oozie-oozi-C@6]::ActionInputCheck::
File:hdfs://nameservice1/derivative/stream/last_xvlr_24h/2013/06/12/13, Exists?
:false
2013-07-17 00:52:58,763 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@6]
[0001444-130705182854792-oozie-oozi-C@6]::ActionInputCheck:: Action is in
WAITING state.
2013-07-17 00:52:58,766 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@6]
[0001444-130705182854792-oozie-oozi-C@6]::CoordActionInputCheck:: Missing
deps:hdfs://nameservice1/derivative/stream/last_xvlr_24h/2013/06/12/13
2013-07-17 00:52:58,772 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@6]
[0001444-130705182854792-oozie-oozi-C@6]::ActionInputCheck:: In
checkResolvedUris...
2013-07-17 00:52:58,772 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@6]
[0001444-130705182854792-oozie-oozi-C@6]::ActionInputCheck:: In
checkListOfPaths:
hdfs://nameservice1/derivative/stream/last_xvlr_24h/2013/06/12/13 is Missing.
2013-07-17 00:52:58,819 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@6]
[0001444-130705182854792-oozie-oozi-C@6]::ActionInputCheck::
File:hdfs://nameservice1/derivative/stream/last_xvlr_24h/2013/06/12/13, Exists?
:false
2013-07-17 00:53:59,653 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@6]
[0001444-130705182854792-oozie-oozi-C@6]::ActionInputCheck:: Action is in
WAITING state.
2013-07-17 00:53:59,655 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@6]
[0001444-130705182854792-oozie-oozi-C@6]::CoordActionInputCheck:: Missing
deps:hdfs://nameservice1/derivative/stream/last_xvlr_24h/2013/06/12/13
2013-07-17 00:53:59,657 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@6]
[0001444-130705182854792-oozie-oozi-C@6]::ActionInputCheck:: In
checkResolvedUris...
2013-07-17 00:53:59,657 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@6]
[0001444-130705182854792-oozie-oozi-C@6]::ActionInputCheck:: In
checkListOfPaths:
hdfs://nameservice1/derivative/stream/last_xvlr_24h/2013/06/12/13 is Missing.
2013-07-17 00:53:59,684 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@6]
[0001444-130705182854792-oozie-oozi-C@6]::ActionInputCheck::
File:hdfs://nameservice1/derivative/stream/last_xvlr_24h/2013/06/12/13, Exists?
:false
2013-07-17 00:55:00,173 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@6]
[0001444-130705182854792-oozie-oozi-C@6]::ActionInputCheck:: Action is in
WAITING state.
2013-07-17 00:55:00,179 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@6]
[0001444-130705182854792-oozie-oozi-C@6]::CoordActionInputCheck:: Missing
deps:hdfs://nameservice1/derivative/stream/last_xvlr_24h/2013/06/12/13
2013-07-17 00:55:00,181 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@6]
[0001444-130705182854792-oozie-oozi-C@6]::ActionInputCheck:: In
checkResolvedUris...
2013-07-17 00:55:00,181 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@6]
[0001444-130705182854792-oozie-oozi-C@6]::ActionInputCheck:: In
checkListOfPaths:
hdfs://nameservice1/derivative/stream/last_xvlr_24h/2013/06/12/13 is Missing.
2013-07-17 00:55:00,249 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@6]
[0001444-130705182854792-oozie-oozi-C@6]::ActionInputCheck::
File:hdfs://nameservice1/derivative/stream/last_xvlr_24h/2013/06/12/13, Exists?
:false
2013-07-17 00:56:01,277 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@6]
[0001444-130705182854792-oozie-oozi-C@6]::ActionInputCheck:: Action is in
WAITING state.
2013-07-17 00:56:01,287 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@6]
[0001444-130705182854792-oozie-oozi-C@6]::CoordActionInputCheck:: Missing
deps:hdfs://nameservice1/derivative/stream/last_xvlr_24h/2013/06/12/13
2013-07-17 00:56:01,289 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@6]
[0001444-130705182854792-oozie-oozi-C@6]::ActionInputCheck:: In
checkResolvedUris...
2013-07-17 00:56:01,289 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@6]
[0001444-130705182854792-oozie-oozi-C@6]::ActionInputCheck:: In
checkListOfPaths:
hdfs://nameservice1/derivative/stream/last_xvlr_24h/2013/06/12/13 is Missing.
2013-07-17 00:56:01,375 INFO
org.apache.oozie.command.coord.CoordActionInputCheckXCommand: USER[-] GROUP[-]
TOKEN[-] APP[-] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[0001444-130705182854792-oozie-oozi-C@6]
[0001444-130705182854792-oozie-oozi-C@6]::ActionInputCheck::
File:hdfs://nameservice1/derivative/stream/last_xvlr_24h/2013/06/12/13, Exists?
:true
2013-07-17 00:56:02,625 WARN
org.apache.oozie.command.coord.CoordActionReadyXCommand: USER[oozie] GROUP[-]
TOKEN[] APP[xvlrCellTimeSpentCoord] JOB[0001444-130705182854792-oozie-oozi-C]
ACTION[-] No actions to start! for jobId=0001444-130705182854792-oozie-oozi-C
{code}
> Can't stop oozie to create actions in WAITING state
> ---------------------------------------------------
>
> Key: OOZIE-1455
> URL: https://issues.apache.org/jira/browse/OOZIE-1455
> Project: Oozie
> Issue Type: Bug
> Components: coordinator
> Affects Versions: 3.3.2
> Environment: CDH 4.3
> Reporter: Sergey
> Priority: Critical
>
> I've created coordinator with controls settings:
> {code}
> <controls>
> <timeout>15</timeout>
> <concurrency>1</concurrency>
> <throttle>-1</throttle>
> </controls>
> {code}
> I have data partitioned by hour and this data should be processed
> sequentially. When first partition is processed, some derivative is generated
> used in processing for the next hour.
> Oozie starts actions (trasition to RUNNING state) one by one. It's good.
> The bad thing is that oozie create "future" actions in READY/WAITING state.
> READY - when prev action did prepare derivate dataset,
> WAITING - when prev action didn't prepare derivate.
> Sometimes WAITING is changed to TIMEOUT and the whole process is broken.
> Is there any possiblity to forbid oozie to create actions "in future" while
> we have running action?
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
