Gopi Krishnan Nambiar created OOZIE-2762:
--------------------------------------------
Summary: Oozie workflow stuck in RUNNING state and does not
progress to next action due to unique contraint violation exception for
"wf_actions_pkey"
Key: OOZIE-2762
URL: https://issues.apache.org/jira/browse/OOZIE-2762
Project: Oozie
Issue Type: Bug
Affects Versions: 4.0.1
Reporter: Gopi Krishnan Nambiar
-bash-4.1$ oozie job -oozie http://localhost:11000/oozie --info
0000141-161216105202698-oozie-oozi-C
Job ID : 0000141-161216105202698-oozie-oozi-C
------------------------------------------------------------------------------------------------------------------------------------
Job Name : coord
App Path : hdfs://URL/user/oozie/examples/apps/applog/coordinator.xml
Status : RUNNING
Start Time : 2016-10-05 00:00 GMT
End Time : 2016-10-05 23:59 GMT
Pause Time : -
Concurrency : 2
------------------------------------------------------------------------------------------------------------------------------------
ID Status Ext ID
Err Code Created Nominal Time
0000141-161216105202698-oozie-oozi-C@1 RUNNING
0000142-161216105202698-oozie-oozi-W - 2016-12-21 18:08 GMT 2016-10-05
00:00 GMT
------------------------------------------------------------------------------------------------------------------------------------
-bash-4.1$ oozie job -oozie http://localhost:11000/oozie --info
0000142-161216105202698-oozie-oozi-W
Job ID : 0000142-161216105202698-oozie-oozi-W
------------------------------------------------------------------------------------------------------------------------------------
Workflow Name : conversion-wf
App Path : hdfs://URL/user/oozie/examples/apps/applog
Status : RUNNING
Run : 0
User : sfdc
Group : -
Created : 2016-12-21 18:08 GMT
Started : 2016-12-21 18:08 GMT
Last Modified : 2016-12-21 18:39 GMT
Ended : -
CoordAction ID: 0000141-161216105202698-oozie-oozi-C@1
Actions
------------------------------------------------------------------------------------------------------------------------------------
ID
Status Ext ID Ext Status Err Code
------------------------------------------------------------------------------------------------------------------------------------
0000142-161216105202698-oozie-oozi-W@:start:
OK - OK -
------------------------------------------------------------------------------------------------------------------------------------
0000142-161216105202698-oozie-oozi-W@decisionNode
OK - conversionJob-
------------------------------------------------------------------------------------------------------------------------------------
0000142-161216105202698-oozie-oozi-W@conversionJob
OK job_1481654882437_6310 SUCCEEDED -
------------------------------------------------------------------------------------------------------------------------------------
0000142-161216105202698-oozie-oozi-W@findHivePartitions OK
job_1481654882437_6325 SUCCEEDED -
------------------------------------------------------------------------------------------------------------------------------------
Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: ERROR: duplicate
key value violates unique constraint "wf_actions_pkey"
Detail: Key
(id)=(0000142-161216105202698-oozie-oozi-W@findHiveInstancePartitions) already
exists. {prepstmnt 67637986 INSERT INTO WF_ACTIONS (id, conf, console_url,
cred, data, error_code, error_message, external_child_ids, external_id,
external_status, name, retries, stats, tracker_uri, transition, type,
user_retry_count, user_retry_interval, user_retry_max, bean_type, end_time,
execution_path, last_check_time, log_token, pending, pending_age, signal_value,
sla_xml, start_time, status, wf_id) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?,
?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)} [code=0, state=23505]
at
org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:219)
at
org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:195)
at
org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:59)
at
org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1134)
at
org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:275)
at
org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:275)
at
org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1792)
at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:268)
at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:119)
... 28 more
2016-12-21 18:53:18,548 ERROR SignalXCommand:536 - USER[sfdc] GROUP[-] TOKEN[]
APP[parquetconversion-wf] JOB[0000142-161216105202698-oozie-oozi-W]
ACTION[0000142-161216105202698-oozie-oozi-W@conversionJob] XException,
org.apache.oozie.command.CommandException: E0603: SQL error in operation,
<openjpa-2.2.2-r422266:1468616 fatal store error>
org.apache.openjpa.persistence.RollbackException: The transaction has been
rolled back. See the nested exceptions for details on the errors that occurred.
FailedObject: org.apache.oozie.WorkflowActionBean@53b0cdd4
at
org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:336)
at
org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:64)
at org.apache.oozie.command.XCommand.call(XCommand.java:280)
at
org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:326)
at
org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:255)
at
org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:175)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.oozie.executor.jpa.JPAExecutorException: E0603: SQL error
in operation, <openjpa-2.2.2-r422266:1468616 fatal store error>
org.apache.openjpa.persistence.RollbackException: The transaction has been
rolled back. See the nested exceptions for details on the errors that occurred.
FailedObject: org.apache.oozie.WorkflowActionBean@53b0cdd4
at org.apache.oozie.service.JPAService.execute(JPAService.java:228)
at
org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:330)
... 8 more
Caused by: <openjpa-2.2.2-r422266:1468616 fatal store error>
org.apache.openjpa.persistence.RollbackException: The transaction has been
rolled back. See the nested exceptions for details on the errors that occurred.
FailedObject: org.apache.oozie.WorkflowActionBean@53b0cdd4
at
org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)
at org.apache.oozie.service.JPAService.execute(JPAService.java:223)
... 9 more
Caused by: <openjpa-2.2.2-r422266:1468616 fatal general error>
org.apache.openjpa.persistence.PersistenceException: The transaction has been
rolled back. See the nested exceptions for details on the errors that occurred.
FailedObject: org.apache.oozie.WorkflowActionBean@53b0cdd4
at
org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2347)
at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2184)
at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2082)
at
org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:2000)
at
org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)
at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1524)
at
org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)
at
org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)
... 10 more
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
