Sure Sathwik, let me try on a dedicated database, Thanks a lot for your help.
Regards, Gangadhar. On Thu, Jul 13, 2017 at 5:40 PM, Sathwik B P <[email protected]> wrote: > I have taken a specific job's execution time from your logs. > > Example: > Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11 14:01:07 EDT refer [1] > It could not acquire the instance lock and hence was scheduled for 25sec > later, refer [2]. This is the second retry iteration. The first iteration > would have been with a 5sec delay, one should have seen this in the logs, > may be you have truncated that part of the logs. > When the job got into execution the time should have been sometime > approximately around 14:01:07 + 25sec = 14:01:32, but its time: 2017-07-11 > 14:02:13 EDT refer [3], shows a huge additional delay about 40sec more. > Due to slow running transactions, the Scheduler will throttle the jobs. > > To improve the execution times, > * Put off event generation (http://ode.apache.org/ode- > execution-events.html > ). > * Have a dedicated database server with good hardware. > > [1] > 424519845 [ODEServer-513] ERROR > org.apache.ode.scheduler.simple.SimpleScheduler - Error while processing > a > persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11 14:01:07 EDT > transacted: true persisted: true details: JobDetails( instanceId: 48210 > mexId: 50968 processId: null type: INVOKE_RESPONSE channel: 423 > correlatorId: null correlationKeySet: null retryCount: 1 inMem: false > detailsExt: {}) > > [2] > 424519862 [ODEServer-513] ERROR > org.apache.ode.scheduler.simple.SimpleScheduler - Error while processing > job, retrying in 25s > > [3] > 424573863 [ODEServer-517] ERROR > org.apache.ode.scheduler.simple.SimpleScheduler - Error while processing > a > persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11 14:02:13 EDT > transacted: true persisted: true details: JobDetails( instanceId: 48210 > mexId: 50968 processId: null type: INVOKE_RESPONSE channel: 423 > correlatorId: null correlationKeySet: null retryCount: 2 inMem: false > detailsExt: {}) > > regards, > sathwik > > On Thu, Jul 13, 2017 at 3:03 PM, Sathwik B P <[email protected]> wrote: > > > What is the setting for the below config parameter in your > > ode.axis2.properties file > > ode-axis2.tx.factory.class= > > > > Have you configured a Transaction Manager in your tomcat? > > > > On Thu, Jul 13, 2017 at 2:23 PM, Gangadhar ireddy < > > [email protected]> wrote: > > > >> Hi Sathwik, > >> > >> Please find the details below:- > >> > >> ODE version :- 1.3.5 > >> Server :- Apache tomcat > >> Database :- Oracle > >> OpenJPA or Hibernate:- Hibernate > >> > >> Regards, > >> Gangadhar. > >> > >> On Thu, Jul 13, 2017 at 12:43 PM, Sathwik B P <[email protected]> > >> wrote: > >> > >> > Can you provide these info please > >> > ODE version? > >> > Server? > >> > Database? > >> > OpenJPA or Hibernate? > >> > > >> > On Thu, Jul 13, 2017 at 5:45 AM, Gangadhar ireddy < > >> > [email protected]> wrote: > >> > > >> > > 424519400 [ODEServer-505] INFO org.apache.ode.axis2. > ExternalService > >> - > >> > > Response: > >> > > <?xml version="1.0" encoding="UTF-8"?> > >> > > <message><SubProcess24Task137Output><SubProcess24Task137Output > >> xmlns=" > >> > > http://www.altair.com/EPM/Schema/SubProcess24Task137"; > >> xmlns:SOAP-ENV=" > >> > > http://schemas.xmlsoap.org/soap/envelope/"; xmlns:tns=" > >> > > http://www.altair.com/EPM/Schema/SubProcess24Task137";>< > >> > > humanTaskInvokeResponse > >> > > xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"; > >> > > xmlns:htds=" > >> > > http://www.altair.com/WF/Framework/HumanTaskDataSchema > >> > > ">true</humanTaskInvokeResponse></SubProcess24Task137Output></ > >> > > SubProcess24Task137Output></message> > >> > > 424519845 [ODEServer-513] ERROR > >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while > >> > processing > >> > > a > >> > > persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11 14:01:07 > >> EDT > >> > > transacted: true persisted: true details: JobDetails( instanceId: > >> 48210 > >> > > mexId: 50968 processId: null type: INVOKE_RESPONSE channel: 423 > >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem: > false > >> > > detailsExt: {}) > >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException > >> > > at > >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock( > >> > > BpelEngineImpl.java:394) > >> > > at > >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob( > >> > > BpelEngineImpl.java:403) > >> > > at > >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob( > >> > > BpelServerImpl.java:450) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ > >> > > 1.call(SimpleScheduler.java:518) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ > >> > > 1.call(SimpleScheduler.java:512) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( > >> > > SimpleScheduler.java:284) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( > >> > > SimpleScheduler.java:239) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. > >> > > call(SimpleScheduler.java:512) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. > >> > > call(SimpleScheduler.java:496) > >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > >> > > at > >> > > java.util.concurrent.ThreadPoolExecutor.runWorker( > >> > > ThreadPoolExecutor.java:1142) > >> > > at > >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run( > >> > > ThreadPoolExecutor.java:617) > >> > > at java.lang.Thread.run(Thread.java:745) > >> > > 424519851 [ODEServer-518] ERROR > >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while > >> > processing > >> > > a > >> > > persisted job: Job hqejbhcnphrcfcpvi9xhem time: 2017-07-11 14:01:05 > >> EDT > >> > > transacted: true persisted: true details: JobDetails( instanceId: > >> 48210 > >> > > mexId: 50955 processId: null type: INVOKE_RESPONSE channel: 269 > >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem: > false > >> > > detailsExt: {}) > >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException > >> > > at > >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock( > >> > > BpelEngineImpl.java:394) > >> > > at > >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob( > >> > > BpelEngineImpl.java:403) > >> > > at > >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob( > >> > > BpelServerImpl.java:450) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ > >> > > 1.call(SimpleScheduler.java:518) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ > >> > > 1.call(SimpleScheduler.java:512) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( > >> > > SimpleScheduler.java:284) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( > >> > > SimpleScheduler.java:239) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. > >> > > call(SimpleScheduler.java:512) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. > >> > > call(SimpleScheduler.java:496) > >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > >> > > at > >> > > java.util.concurrent.ThreadPoolExecutor.runWorker( > >> > > ThreadPoolExecutor.java:1142) > >> > > at > >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run( > >> > > ThreadPoolExecutor.java:617) > >> > > at java.lang.Thread.run(Thread.java:745) > >> > > 424519854 [ODEServer-508] ERROR > >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while > >> > processing > >> > > a > >> > > persisted job: Job hqejbhcnphrcfcpvi9xheq time: 2017-07-11 14:01:05 > >> EDT > >> > > transacted: true persisted: true details: JobDetails( instanceId: > >> 48210 > >> > > mexId: 50964 processId: null type: INVOKE_RESPONSE channel: 378 > >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem: > false > >> > > detailsExt: {}) > >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException > >> > > at > >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock( > >> > > BpelEngineImpl.java:394) > >> > > at > >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob( > >> > > BpelEngineImpl.java:403) > >> > > at > >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob( > >> > > BpelServerImpl.java:450) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ > >> > > 1.call(SimpleScheduler.java:518) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ > >> > > 1.call(SimpleScheduler.java:512) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( > >> > > SimpleScheduler.java:284) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( > >> > > SimpleScheduler.java:239) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. > >> > > call(SimpleScheduler.java:512) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. > >> > > call(SimpleScheduler.java:496) > >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > >> > > at > >> > > java.util.concurrent.ThreadPoolExecutor.runWorker( > >> > > ThreadPoolExecutor.java:1142) > >> > > at > >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run( > >> > > ThreadPoolExecutor.java:617) > >> > > at java.lang.Thread.run(Thread.java:745) > >> > > 424519853 [ODEServer-502] ERROR > >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while > >> > processing > >> > > a > >> > > persisted job: Job hqejbhcnphrcfcpvi9xhen time: 2017-07-11 14:01:05 > >> EDT > >> > > transacted: true persisted: true details: JobDetails( instanceId: > >> 48210 > >> > > mexId: 50959 processId: null type: INVOKE_RESPONSE channel: 316 > >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem: > false > >> > > detailsExt: {}) > >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException > >> > > at > >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock( > >> > > BpelEngineImpl.java:394) > >> > > at > >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob( > >> > > BpelEngineImpl.java:403) > >> > > at > >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob( > >> > > BpelServerImpl.java:450) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ > >> > > 1.call(SimpleScheduler.java:518) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ > >> > > 1.call(SimpleScheduler.java:512) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( > >> > > SimpleScheduler.java:284) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( > >> > > SimpleScheduler.java:239) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. > >> > > call(SimpleScheduler.java:512) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. > >> > > call(SimpleScheduler.java:496) > >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > >> > > at > >> > > java.util.concurrent.ThreadPoolExecutor.runWorker( > >> > > ThreadPoolExecutor.java:1142) > >> > > at > >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run( > >> > > ThreadPoolExecutor.java:617) > >> > > at java.lang.Thread.run(Thread.java:745) > >> > > 424519849 [ODEServer-506] ERROR > >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while > >> > processing > >> > > a > >> > > persisted job: Job hqejbhcnphrcfcpvi9xhes time: 2017-07-11 14:01:05 > >> EDT > >> > > transacted: true persisted: true details: JobDetails( instanceId: > >> 48210 > >> > > mexId: 50956 processId: null type: INVOKE_RESPONSE channel: 282 > >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem: > false > >> > > detailsExt: {}) > >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException > >> > > at > >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock( > >> > > BpelEngineImpl.java:394) > >> > > at > >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob( > >> > > BpelEngineImpl.java:403) > >> > > at > >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob( > >> > > BpelServerImpl.java:450) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ > >> > > 1.call(SimpleScheduler.java:518) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ > >> > > 1.call(SimpleScheduler.java:512) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( > >> > > SimpleScheduler.java:284) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( > >> > > SimpleScheduler.java:239) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. > >> > > call(SimpleScheduler.java:512) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. > >> > > call(SimpleScheduler.java:496) > >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > >> > > at > >> > > java.util.concurrent.ThreadPoolExecutor.runWorker( > >> > > ThreadPoolExecutor.java:1142) > >> > > at > >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run( > >> > > ThreadPoolExecutor.java:617) > >> > > at java.lang.Thread.run(Thread.java:745) > >> > > 424519852 [ODEServer-504] ERROR > >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while > >> > processing > >> > > a > >> > > persisted job: Job hqejbhcnphrcfcpvi9xheu time: 2017-07-11 14:01:05 > >> EDT > >> > > transacted: true persisted: true details: JobDetails( instanceId: > >> 48210 > >> > > mexId: 50966 processId: null type: INVOKE_RESPONSE channel: 401 > >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem: > false > >> > > detailsExt: {}) > >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException > >> > > at > >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock( > >> > > BpelEngineImpl.java:394) > >> > > at > >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob( > >> > > BpelEngineImpl.java:403) > >> > > at > >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob( > >> > > BpelServerImpl.java:450) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ > >> > > 1.call(SimpleScheduler.java:518) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ > >> > > 1.call(SimpleScheduler.java:512) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( > >> > > SimpleScheduler.java:284) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( > >> > > SimpleScheduler.java:239) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. > >> > > call(SimpleScheduler.java:512) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. > >> > > call(SimpleScheduler.java:496) > >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > >> > > at > >> > > java.util.concurrent.ThreadPoolExecutor.runWorker( > >> > > ThreadPoolExecutor.java:1142) > >> > > at > >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run( > >> > > ThreadPoolExecutor.java:617) > >> > > at java.lang.Thread.run(Thread.java:745) > >> > > 424519865 [ODEServer-506] ERROR > >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while > >> > processing > >> > > job, retrying in 25s > >> > > 424519865 [ODEServer-502] ERROR > >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while > >> > processing > >> > > job, retrying in 25s > >> > > 424519866 [ODEServer-508] ERROR > >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while > >> > processing > >> > > job, retrying in 25s > >> > > 424519863 [ODEServer-511] ERROR > >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while > >> > processing > >> > > a > >> > > persisted job: Job hqejbhcnphrcfcpvi9xhev time: 2017-07-11 14:01:05 > >> EDT > >> > > transacted: true persisted: true details: JobDetails( instanceId: > >> 48210 > >> > > mexId: 50965 processId: null type: INVOKE_RESPONSE channel: 383 > >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem: > false > >> > > detailsExt: {}) > >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException > >> > > at > >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock( > >> > > BpelEngineImpl.java:394) > >> > > at > >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob( > >> > > BpelEngineImpl.java:403) > >> > > at > >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob( > >> > > BpelServerImpl.java:450) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ > >> > > 1.call(SimpleScheduler.java:518) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ > >> > > 1.call(SimpleScheduler.java:512) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( > >> > > SimpleScheduler.java:284) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( > >> > > SimpleScheduler.java:239) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. > >> > > call(SimpleScheduler.java:512) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. > >> > > call(SimpleScheduler.java:496) > >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > >> > > at > >> > > java.util.concurrent.ThreadPoolExecutor.runWorker( > >> > > ThreadPoolExecutor.java:1142) > >> > > at > >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run( > >> > > ThreadPoolExecutor.java:617) > >> > > at java.lang.Thread.run(Thread.java:745) > >> > > 424519863 [ODEServer-507] ERROR > >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while > >> > processing > >> > > a > >> > > persisted job: Job hqejbhcnphrcfcpvi9xhep time: 2017-07-11 14:01:05 > >> EDT > >> > > transacted: true persisted: true details: JobDetails( instanceId: > >> 48210 > >> > > mexId: 50953 processId: null type: INVOKE_RESPONSE channel: 226 > >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem: > false > >> > > detailsExt: {}) > >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException > >> > > at > >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock( > >> > > BpelEngineImpl.java:394) > >> > > at > >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob( > >> > > BpelEngineImpl.java:403) > >> > > at > >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob( > >> > > BpelServerImpl.java:450) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ > >> > > 1.call(SimpleScheduler.java:518) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ > >> > > 1.call(SimpleScheduler.java:512) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( > >> > > SimpleScheduler.java:284) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( > >> > > SimpleScheduler.java:239) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. > >> > > call(SimpleScheduler.java:512) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. > >> > > call(SimpleScheduler.java:496) > >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > >> > > at > >> > > java.util.concurrent.ThreadPoolExecutor.runWorker( > >> > > ThreadPoolExecutor.java:1142) > >> > > at > >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run( > >> > > ThreadPoolExecutor.java:617) > >> > > at java.lang.Thread.run(Thread.java:745) > >> > > 424519862 [ODEServer-519] ERROR > >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while > >> > processing > >> > > a > >> > > persisted job: Job hqejbhcnphrcfcpvi9xhel time: 2017-07-11 14:01:05 > >> EDT > >> > > transacted: true persisted: true details: JobDetails( instanceId: > >> 48210 > >> > > mexId: 50963 processId: null type: INVOKE_RESPONSE channel: 365 > >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem: > false > >> > > detailsExt: {}) > >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException > >> > > at > >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock( > >> > > BpelEngineImpl.java:394) > >> > > at > >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob( > >> > > BpelEngineImpl.java:403) > >> > > at > >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob( > >> > > BpelServerImpl.java:450) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ > >> > > 1.call(SimpleScheduler.java:518) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ > >> > > 1.call(SimpleScheduler.java:512) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( > >> > > SimpleScheduler.java:284) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( > >> > > SimpleScheduler.java:239) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. > >> > > call(SimpleScheduler.java:512) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. > >> > > call(SimpleScheduler.java:496) > >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > >> > > at > >> > > java.util.concurrent.ThreadPoolExecutor.runWorker( > >> > > ThreadPoolExecutor.java:1142) > >> > > at > >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run( > >> > > ThreadPoolExecutor.java:617) > >> > > at java.lang.Thread.run(Thread.java:745) > >> > > 424519868 [ODEServer-511] ERROR > >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while > >> > processing > >> > > job, retrying in 25s > >> > > 424519862 [ODEServer-513] ERROR > >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while > >> > processing > >> > > job, retrying in 25s > >> > > 424519868 [ODEServer-507] ERROR > >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while > >> > processing > >> > > job, retrying in 25s > >> > > 424519868 [ODEServer-519] ERROR > >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while > >> > processing > >> > > job, retrying in 25s > >> > > 424519867 [ODEServer-518] ERROR > >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while > >> > processing > >> > > job, retrying in 25s > >> > > 424519866 [ODEServer-504] ERROR > >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while > >> > processing > >> > > job, retrying in 25s > >> > > 424519866 [ODEServer-510] ERROR > >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while > >> > processing > >> > > a > >> > > persisted job: Job hqejbhcnphrcfcpvi9xher time: 2017-07-11 14:01:05 > >> EDT > >> > > transacted: true persisted: true details: JobDetails( instanceId: > >> 48210 > >> > > mexId: 50957 processId: null type: INVOKE_RESPONSE channel: 295 > >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem: > false > >> > > detailsExt: {}) > >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException > >> > > at > >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock( > >> > > BpelEngineImpl.java:394) > >> > > at > >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob( > >> > > BpelEngineImpl.java:403) > >> > > at > >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob( > >> > > BpelServerImpl.java:450) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ > >> > > 1.call(SimpleScheduler.java:518) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ > >> > > 1.call(SimpleScheduler.java:512) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( > >> > > SimpleScheduler.java:284) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( > >> > > SimpleScheduler.java:239) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. > >> > > call(SimpleScheduler.java:512) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. > >> > > call(SimpleScheduler.java:496) > >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > >> > > at > >> > > java.util.concurrent.ThreadPoolExecutor.runWorker( > >> > > ThreadPoolExecutor.java:1142) > >> > > at > >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run( > >> > > ThreadPoolExecutor.java:617) > >> > > at java.lang.Thread.run(Thread.java:745) > >> > > 424519870 [ODEServer-510] ERROR > >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while > >> > processing > >> > > job, retrying in 25s > >> > > 424522517 [ODEServer-510] INFO org.apache.ode.axis2. > ExternalService > >> - > >> > > Response: > >> > > <?xml version="1.0" encoding="UTF-8"?> > >> > > <message><SubProcess24Task131Output><SubProcess24Task131Output > >> xmlns=" > >> > > http://www.altair.com/EPM/Schema/SubProcess24Task131"; > >> xmlns:SOAP-ENV=" > >> > > http://schemas.xmlsoap.org/soap/envelope/"; xmlns:tns=" > >> > > http://www.altair.com/EPM/Schema/SubProcess24Task131";>< > >> > > humanTaskInvokeResponse > >> > > xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"; > >> > > xmlns:htds=" > >> > > http://www.altair.com/WF/Framework/HumanTaskDataSchema > >> > > ">true</humanTaskInvokeResponse></SubProcess24Task131Output></ > >> > > SubProcess24Task131Output></message> > >> > > 424573639 [ODEServer-510] INFO org.apache.ode.axis2. > ExternalService > >> - > >> > > Response: > >> > > <?xml version="1.0" encoding="UTF-8"?> > >> > > <message><SubProcess24Task132Output><SubProcess24Task132Output > >> xmlns=" > >> > > http://www.altair.com/EPM/Schema/SubProcess24Task132"; > >> xmlns:SOAP-ENV=" > >> > > http://schemas.xmlsoap.org/soap/envelope/"; xmlns:tns=" > >> > > http://www.altair.com/EPM/Schema/SubProcess24Task132";>< > >> > > humanTaskInvokeResponse > >> > > xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"; > >> > > xmlns:htds=" > >> > > http://www.altair.com/WF/Framework/HumanTaskDataSchema > >> > > ">true</humanTaskInvokeResponse></SubProcess24Task132Output></ > >> > > SubProcess24Task132Output></message> > >> > > 424573852 [ODEServer-513] ERROR > >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while > >> > processing > >> > > a > >> > > persisted job: Job hqejbhcnphrcfcpvi9xhev time: 2017-07-11 14:02:13 > >> EDT > >> > > transacted: true persisted: true details: JobDetails( instanceId: > >> 48210 > >> > > mexId: 50965 processId: null type: INVOKE_RESPONSE channel: 383 > >> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem: > false > >> > > detailsExt: {}) > >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException > >> > > at > >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock( > >> > > BpelEngineImpl.java:394) > >> > > at > >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob( > >> > > BpelEngineImpl.java:403) > >> > > at > >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob( > >> > > BpelServerImpl.java:450) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ > >> > > 1.call(SimpleScheduler.java:518) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ > >> > > 1.call(SimpleScheduler.java:512) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( > >> > > SimpleScheduler.java:284) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( > >> > > SimpleScheduler.java:239) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. > >> > > call(SimpleScheduler.java:512) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. > >> > > call(SimpleScheduler.java:496) > >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > >> > > at > >> > > java.util.concurrent.ThreadPoolExecutor.runWorker( > >> > > ThreadPoolExecutor.java:1142) > >> > > at > >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run( > >> > > ThreadPoolExecutor.java:617) > >> > > at java.lang.Thread.run(Thread.java:745) > >> > > 424573856 [ODEServer-511] ERROR > >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while > >> > processing > >> > > a > >> > > persisted job: Job hqejbhcnphrcfcpvi9xhel time: 2017-07-11 14:02:13 > >> EDT > >> > > transacted: true persisted: true details: JobDetails( instanceId: > >> 48210 > >> > > mexId: 50963 processId: null type: INVOKE_RESPONSE channel: 365 > >> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem: > false > >> > > detailsExt: {}) > >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException > >> > > at > >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock( > >> > > BpelEngineImpl.java:394) > >> > > at > >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob( > >> > > BpelEngineImpl.java:403) > >> > > at > >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob( > >> > > BpelServerImpl.java:450) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ > >> > > 1.call(SimpleScheduler.java:518) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ > >> > > 1.call(SimpleScheduler.java:512) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( > >> > > SimpleScheduler.java:284) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( > >> > > SimpleScheduler.java:239) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. > >> > > call(SimpleScheduler.java:512) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. > >> > > call(SimpleScheduler.java:496) > >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > >> > > at > >> > > java.util.concurrent.ThreadPoolExecutor.runWorker( > >> > > ThreadPoolExecutor.java:1142) > >> > > at > >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run( > >> > > ThreadPoolExecutor.java:617) > >> > > at java.lang.Thread.run(Thread.java:745) > >> > > 424573863 [ODEServer-504] ERROR > >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while > >> > processing > >> > > a > >> > > persisted job: Job hqejbhcnphrcfcpvi9xhes time: 2017-07-11 14:02:13 > >> EDT > >> > > transacted: true persisted: true details: JobDetails( instanceId: > >> 48210 > >> > > mexId: 50956 processId: null type: INVOKE_RESPONSE channel: 282 > >> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem: > false > >> > > detailsExt: {}) > >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException > >> > > at > >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock( > >> > > BpelEngineImpl.java:394) > >> > > at > >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob( > >> > > BpelEngineImpl.java:403) > >> > > at > >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob( > >> > > BpelServerImpl.java:450) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ > >> > > 1.call(SimpleScheduler.java:518) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ > >> > > 1.call(SimpleScheduler.java:512) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( > >> > > SimpleScheduler.java:284) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( > >> > > SimpleScheduler.java:239) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. > >> > > call(SimpleScheduler.java:512) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. > >> > > call(SimpleScheduler.java:496) > >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > >> > > at > >> > > java.util.concurrent.ThreadPoolExecutor.runWorker( > >> > > ThreadPoolExecutor.java:1142) > >> > > at > >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run( > >> > > ThreadPoolExecutor.java:617) > >> > > at java.lang.Thread.run(Thread.java:745) > >> > > 424573865 [ODEServer-513] ERROR > >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while > >> > processing > >> > > job, retrying in 125s > >> > > 424573863 [ODEServer-517] ERROR > >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while > >> > processing > >> > > a > >> > > persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11 14:02:13 > >> EDT > >> > > transacted: true persisted: true details: JobDetails( instanceId: > >> 48210 > >> > > mexId: 50968 processId: null type: INVOKE_RESPONSE channel: 423 > >> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem: > false > >> > > detailsExt: {}) > >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException > >> > > at > >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock( > >> > > BpelEngineImpl.java:394) > >> > > at > >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob( > >> > > BpelEngineImpl.java:403) > >> > > at > >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob( > >> > > BpelServerImpl.java:450) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ > >> > > 1.call(SimpleScheduler.java:518) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ > >> > > 1.call(SimpleScheduler.java:512) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( > >> > > SimpleScheduler.java:284) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( > >> > > SimpleScheduler.java:239) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. > >> > > call(SimpleScheduler.java:512) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. > >> > > call(SimpleScheduler.java:496) > >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > >> > > at > >> > > java.util.concurrent.ThreadPoolExecutor.runWorker( > >> > > ThreadPoolExecutor.java:1142) > >> > > at > >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run( > >> > > ThreadPoolExecutor.java:617) > >> > > at java.lang.Thread.run(Thread.java:745) > >> > > 424573863 [ODEServer-514] ERROR > >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while > >> > processing > >> > > a > >> > > persisted job: Job hqejbhcnphrcfcpvi9xhem time: 2017-07-11 14:02:13 > >> EDT > >> > > transacted: true persisted: true details: JobDetails( instanceId: > >> 48210 > >> > > mexId: 50955 processId: null type: INVOKE_RESPONSE channel: 269 > >> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem: > false > >> > > detailsExt: {}) > >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException > >> > > at > >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock( > >> > > BpelEngineImpl.java:394) > >> > > at > >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob( > >> > > BpelEngineImpl.java:403) > >> > > at > >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob( > >> > > BpelServerImpl.java:450) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ > >> > > 1.call(SimpleScheduler.java:518) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ > >> > > 1.call(SimpleScheduler.java:512) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( > >> > > SimpleScheduler.java:284) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( > >> > > SimpleScheduler.java:239) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. > >> > > call(SimpleScheduler.java:512) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. > >> > > call(SimpleScheduler.java:496) > >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > >> > > at > >> > > java.util.concurrent.ThreadPoolExecutor.runWorker( > >> > > ThreadPoolExecutor.java:1142) > >> > > at > >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run( > >> > > ThreadPoolExecutor.java:617) > >> > > at java.lang.Thread.run(Thread.java:745) > >> > > 424573868 [ODEServer-508] ERROR > >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while > >> > processing > >> > > a > >> > > persisted job: Job hqejbhcnphrcfcpvi9xhep time: 2017-07-11 14:02:13 > >> EDT > >> > > transacted: true persisted: true details: JobDetails( instanceId: > >> 48210 > >> > > mexId: 50953 processId: null type: INVOKE_RESPONSE channel: 226 > >> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem: > false > >> > > detailsExt: {}) > >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException > >> > > at > >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock( > >> > > BpelEngineImpl.java:394) > >> > > at > >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob( > >> > > BpelEngineImpl.java:403) > >> > > at > >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob( > >> > > BpelServerImpl.java:450) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ > >> > > 1.call(SimpleScheduler.java:518) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ > >> > > 1.call(SimpleScheduler.java:512) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( > >> > > SimpleScheduler.java:284) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( > >> > > SimpleScheduler.java:239) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. > >> > > call(SimpleScheduler.java:512) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. > >> > > call(SimpleScheduler.java:496) > >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > >> > > at > >> > > java.util.concurrent.ThreadPoolExecutor.runWorker( > >> > > ThreadPoolExecutor.java:1142) > >> > > at > >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run( > >> > > ThreadPoolExecutor.java:617) > >> > > at java.lang.Thread.run(Thread.java:745) > >> > > 424573868 [ODEServer-507] ERROR > >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while > >> > processing > >> > > a > >> > > persisted job: Job hqejbhcnphrcfcpvi9xheu time: 2017-07-11 14:02:13 > >> EDT > >> > > transacted: true persisted: true details: JobDetails( instanceId: > >> 48210 > >> > > mexId: 50966 processId: null type: INVOKE_RESPONSE channel: 401 > >> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem: > false > >> > > detailsExt: {}) > >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException > >> > > at > >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock( > >> > > BpelEngineImpl.java:394) > >> > > at > >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob( > >> > > BpelEngineImpl.java:403) > >> > > at > >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob( > >> > > BpelServerImpl.java:450) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ > >> > > 1.call(SimpleScheduler.java:518) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ > >> > > 1.call(SimpleScheduler.java:512) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( > >> > > SimpleScheduler.java:284) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( > >> > > SimpleScheduler.java:239) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. > >> > > call(SimpleScheduler.java:512) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. > >> > > call(SimpleScheduler.java:496) > >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > >> > > at > >> > > java.util.concurrent.ThreadPoolExecutor.runWorker( > >> > > ThreadPoolExecutor.java:1142) > >> > > at > >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run( > >> > > ThreadPoolExecutor.java:617) > >> > > at java.lang.Thread.run(Thread.java:745) > >> > > 424573869 [ODEServer-517] ERROR > >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while > >> > processing > >> > > job, retrying in 125s > >> > > 424573869 [ODEServer-504] ERROR > >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while > >> > processing > >> > > job, retrying in 125s > >> > > 424573870 [ODEServer-514] ERROR > >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while > >> > processing > >> > > job, retrying in 125s > >> > > 424573870 [ODEServer-511] ERROR > >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while > >> > processing > >> > > job, retrying in 125s > >> > > 424573868 [ODEServer-519] ERROR > >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while > >> > processing > >> > > a > >> > > persisted job: Job hqejbhcnphrcfcpvi9xhen time: 2017-07-11 14:02:13 > >> EDT > >> > > transacted: true persisted: true details: JobDetails( instanceId: > >> 48210 > >> > > mexId: 50959 processId: null type: INVOKE_RESPONSE channel: 316 > >> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem: > false > >> > > detailsExt: {}) > >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException > >> > > at > >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock( > >> > > BpelEngineImpl.java:394) > >> > > at > >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob( > >> > > BpelEngineImpl.java:403) > >> > > at > >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob( > >> > > BpelServerImpl.java:450) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ > >> > > 1.call(SimpleScheduler.java:518) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ > >> > > 1.call(SimpleScheduler.java:512) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( > >> > > SimpleScheduler.java:284) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( > >> > > SimpleScheduler.java:239) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. > >> > > call(SimpleScheduler.java:512) > >> > > at > >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. > >> > > call(SimpleScheduler.java:496) > >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > >> > > at > >> > > java.util.concurrent.ThreadPoolExecutor.runWorker( > >> > > ThreadPoolExecutor.java:1142) > >> > > at > >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run( > >> > > ThreadPoolExecutor.java:617) > >> > > at java.lang.Thread.run(Thread.java:745) > >> > > 424573870 [ODEServer-507] ERROR > >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while > >> > processing > >> > > job, retrying in 125s > >> > > 424573870 [ODEServer-508] ERROR > >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while > >> > processing > >> > > job, retrying in 125s > >> > > 424573871 [ODEServer-519] ERROR > >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while > >> > processing > >> > > job, retrying in 125s > >> > > 424575807 [ODEServer-511] INFO org.apache.ode.axis2. > ExternalService > >> - > >> > > Response: > >> > > <?xml version="1.0" encoding="UTF-8"?> > >> > > <message><SubProcess24Task135Output><SubProcess24Task135Output > >> xmlns=" > >> > > http://www.altair.com/EPM/Schema/SubProcess24Task135"; > >> xmlns:SOAP-ENV=" > >> > > http://schemas.xmlsoap.org/soap/envelope/"; xmlns:tns=" > >> > > http://www.altair.com/EPM/Schema/SubProcess24Task135";>< > >> > > humanTaskInvokeResponse > >> > > xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"; > >> > > xmlns:htds=" > >> > > http://www.altair.com/WF/Framework/HumanTaskDataSchema > >> > > ">true</humanTaskInvokeResponse></SubProcess24Task135Output></ > >> > > SubProcess24Task135Output></message> > >> > > > >> > > > >> > > On Wed, Jul 12, 2017 at 7:12 PM, Sathwik B P <[email protected]> > >> > wrote: > >> > > > >> > > > Attachment has not come through. > >> > > > > >> > > > put it inline > >> > > > > >> > > > On Jul 12, 2017 18:43, "Gangadhar ireddy" < > >> [email protected]> > >> > > > wrote: > >> > > > > >> > > > > Sathwik, > >> > > > > > >> > > > > Please find the attached log. > >> > > > > > >> > > > > Regards, > >> > > > > Gangadhar. > >> > > > > > >> > > > > On Wed, Jul 12, 2017 at 3:40 PM, Sathwik B P < > >> [email protected]> > >> > > > wrote: > >> > > > > > >> > > > >> Can you send the complete logs. > >> > > > >> > >> > > > >> On Wed, Jul 12, 2017 at 2:32 PM, Sathwik B P < > >> [email protected]> > >> > > > >> wrote: > >> > > > >> > >> > > > >> > Usually, the jobs gets executed pretty much quickly. > >> > > > >> > > >> > > > >> > Factors that might be delaying the execution of jobs is a > slow > >> > > > database. > >> > > > >> > > >> > > > >> > How many concurrent messages is the process expecting? > >> > > > >> > > >> > > > >> > On Jul 12, 2017 13:38, "Gangadhar ireddy" < > >> > > [email protected] > >> > > > > > >> > > > >> > wrote: > >> > > > >> > > >> > > > >> > We are waiting for the jobs and it releases many times, but > few > >> > > times > >> > > > it > >> > > > >> > doesn't release, Is there any limit on the rescheduling? > >> > > > >> > > >> > > > >> > Regards, > >> > > > >> > Gangadhar. > >> > > > >> > > >> > > > >> > On Wed, Jul 12, 2017 at 1:14 PM, Sathwik B P < > >> > [email protected]> > >> > > > >> wrote: > >> > > > >> > > >> > > > >> > > This is normal. Concurrent messages are competing for the > >> > instance > >> > > > >> lock. > >> > > > >> > > Job that doesn't get the lock on the instance has to wait > and > >> > will > >> > > > be > >> > > > >> > > rescheduled. > >> > > > >> > > You should never clear the job table. > >> > > > >> > > > >> > > > >> > > On Jul 12, 2017 12:08, "Gangadhar ireddy" < > >> > > > [email protected] > >> > > > >> > > >> > > > >> > > wrote: > >> > > > >> > > > >> > > > >> > > Sathwik, > >> > > > >> > > > >> > > > >> > > Please find the below log, > >> > > > >> > > > >> > > > >> > > <message><SubProcess24Task137Output>< > SubProcess24Task137Outp > >> ut > >> > > > >> > > xmlns="http://www.altair.com/ > EPM/Schema/SubProcess24Task137" > >> > > > >> > > xmlns:SOAP-ENV="http://schemas.xmlsoap.org/soap/envelope/"; > >> > > > >> > > xmlns:tns="http://www.altair.com/EPM/Schema/ > SubProcess24Task > >> 137 > >> > > ">< > >> > > > >> > > humanTaskInvokeResponse > >> > > > >> > > xmlns="http://www.altair.com/WF/Framework/ > HumanTaskDataSchem > >> a" > >> > > > >> > > xmlns:htds="http://www.altair.com/WF/Framework/ > >> > > HumanTaskDataSchema > >> > > > >> > ">true</ > >> > > > >> > > humanTaskInvokeResponse></SubProcess24Task137Output></ > >> > > > >> > > SubProcess24Task137Output></message> > >> > > > >> > > 424519845 [ODEServer-513] ERROR > >> > > > >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error > >> while > >> > > > >> > > processing a persisted job: Job hqejbhcnphrcfcpvi9xhf3 > time: > >> > > > >> > > 2017-07-11 14:01:07 EDT transacted: true persisted: true > >> > details: > >> > > > >> > > JobDetails( instanceId: 48210 mexId: 50968 processId: null > >> type: > >> > > > >> > > INVOKE_RESPONSE channel: 423 correlatorId: null > >> > correlationKeySet: > >> > > > >> > > null retryCount: 1 inMem: false detailsExt: {}) > >> > > > >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException > >> > > > >> > > at org.apache.ode.bpel.engine.Bpe > >> > > > >> lEngineImpl.acquireInstanceLoc > >> > > > >> > k( > >> > > > >> > > BpelEngineImpl.java:394) > >> > > > >> > > at org.apache.ode.bpel.engine. > >> > > > BpelEngineImpl.onScheduledJob( > >> > > > >> > > BpelEngineImpl.java:403) > >> > > > >> > > at org.apache.ode.bpel.engine. > >> > > > BpelServerImpl.onScheduledJob( > >> > > > >> > > BpelServerImpl.java:450) > >> > > > >> > > at org.apache.ode.scheduler. > >> > > simple.SimpleScheduler$RunJob$ > >> > > > >> > > 1.call(SimpleScheduler.java:518) > >> > > > >> > > at org.apache.ode.scheduler. > >> > > simple.SimpleScheduler$RunJob$ > >> > > > >> > > 1.call(SimpleScheduler.java:512) > >> > > > >> > > at org.apache.ode.scheduler. > simple.SimpleScheduler. > >> > > > >> > > execTransaction( > >> > > > >> > > SimpleScheduler.java:284) > >> > > > >> > > at org.apache.ode.scheduler. > simple.SimpleScheduler. > >> > > > >> > > execTransaction( > >> > > > >> > > SimpleScheduler.java:239) > >> > > > >> > > at org.apache.ode.scheduler. > >> > > simple.SimpleScheduler$RunJob. > >> > > > >> > > call(SimpleScheduler.java:512) > >> > > > >> > > at org.apache.ode.scheduler. > >> > > simple.SimpleScheduler$RunJob. > >> > > > >> > > call(SimpleScheduler.java:496) > >> > > > >> > > at java.util.concurrent.FutureTask.run(FutureTask. > >> > > java:266) > >> > > > >> > > at java.util.concurrent.ThreadPoo > >> lExecutor.runWorker( > >> > > > >> > > ThreadPoolExecutor.java:1142) > >> > > > >> > > at java.util.concurrent.ThreadPoo > >> lExecutor$Worker.run( > >> > > > >> > > ThreadPoolExecutor.java:617) > >> > > > >> > > at java.lang.Thread.run(Thread.java:745) > >> > > > >> > > 424519851 [ODEServer-518] ERROR > >> > > > >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error > >> while > >> > > > >> > > processing a persisted job: Job hqejbhcnphrcfcpvi9xhem > time: > >> > > > >> > > 2017-07-11 14:01:05 EDT transacted: true persisted: true > >> > details: > >> > > > >> > > JobDetails( instanceId: 48210 mexId: 50955 processId: null > >> type: > >> > > > >> > > INVOKE_RESPONSE channel: 269 correlatorId: null > >> > correlationKeySet: > >> > > > >> > > null retryCount: 1 inMem: false detailsExt: {}) > >> > > > >> > > > >> > > > >> > > > >> > > > >> > > Regards, > >> > > > >> > > > >> > > > >> > > Gangadhar. > >> > > > >> > > > >> > > > >> > > > >> > > > >> > > On Tue, Jul 11, 2017 at 12:08 PM, Sathwik B P < > >> > > [email protected] > >> > > > > > >> > > > >> > > wrote: > >> > > > >> > > > >> > > > >> > > > There are multiple factors for intermittent issues. I can > >> only > >> > > > >> > speculate > >> > > > >> > > > here with limited information. > >> > > > >> > > > > >> > > > >> > > > Check your logs for failures when it happens and share it > >> > here, > >> > > so > >> > > > >> that > >> > > > >> > > we > >> > > > >> > > > can help you better. If possible put in a sample process > to > >> > > > >> reproduce > >> > > > >> > > your > >> > > > >> > > > scenario and share here. > >> > > > >> > > > > >> > > > >> > > > > >> > > > >> > > > > >> > > > >> > > > > >> > > > >> > > > > >> > > > >> > > > On Tue, Jul 11, 2017 at 9:55 AM, Gangadhar ireddy < > >> > > > >> > > > [email protected]> wrote: > >> > > > >> > > > > >> > > > >> > > > > Sometimes the activity gets released, if it is due to > >> > failures > >> > > > in > >> > > > >> the > >> > > > >> > > > > process, it should fail every time right? > >> > > > >> > > > > > >> > > > >> > > > > Regards, > >> > > > >> > > > > Gangadhar. > >> > > > >> > > > > > >> > > > >> > > > > On Mon, Jul 10, 2017 at 7:06 PM, Sathwik B P < > >> > > > >> [email protected]> > >> > > > >> > > > wrote: > >> > > > >> > > > > > >> > > > >> > > > > > Jobs might be getting rescheduled due to failures in > >> the > >> > > > >> process. > >> > > > >> > > > > > Check the logs for errors. > >> > > > >> > > > > > > >> > > > >> > > > > > On Mon, Jul 10, 2017 at 10:12 AM, Gangadhar ireddy < > >> > > > >> > > > > > [email protected]> wrote: > >> > > > >> > > > > > > >> > > > >> > > > > > > Hi Sathwik, > >> > > > >> > > > > > > > >> > > > >> > > > > > > I can see INVOKE_RESPONSE type in ode_jobs > table,for > >> > some > >> > > > >> tasks > >> > > > >> > it > >> > > > >> > > > will > >> > > > >> > > > > > be > >> > > > >> > > > > > > updated with INVOKE_CHECK from INVOKE_RESPONSE. > >> > Sometimes > >> > > it > >> > > > >> > takes > >> > > > >> > > > more > >> > > > >> > > > > > > time to release the tasks, sometimes it will not > >> > release. > >> > > > >> > > > > > > > >> > > > >> > > > > > > Regards, > >> > > > >> > > > > > > Ganga. > >> > > > >> > > > > > > > >> > > > >> > > > > > > On Fri, Jul 7, 2017 at 5:04 PM, Sathwik B P < > >> > > > >> > [email protected]> > >> > > > >> > > > > > wrote: > >> > > > >> > > > > > > > >> > > > >> > > > > > > > What kind of jobs are pending? > >> > > > >> > > > > > > > What activities do you have within your <flow>? > >> > > > >> > > > > > > > > >> > > > >> > > > > > > > regards, > >> > > > >> > > > > > > > sathwik > >> > > > >> > > > > > > > > >> > > > >> > > > > > > > On Fri, Jul 7, 2017 at 2:13 PM, Gangadhar ireddy > < > >> > > > >> > > > > > > > [email protected] > >> > > > >> > > > > > > > > wrote: > >> > > > >> > > > > > > > > >> > > > >> > > > > > > > > Hi, > >> > > > >> > > > > > > > > > >> > > > >> > > > > > > > > This is Gangadhar working for Altair, currently > >> we > >> > are > >> > > > >> using > >> > > > >> > > > > > Apache-ode > >> > > > >> > > > > > > > and > >> > > > >> > > > > > > > > facing few issues on flow activity. > >> > > > >> > > > > > > > > > >> > > > >> > > > > > > > > 1. Sometimes all the activities will not be > >> released > >> > > and > >> > > > >> > when i > >> > > > >> > > > > check > >> > > > >> > > > > > > the > >> > > > >> > > > > > > > > ode_job table there are some records not > getting > >> > > > updated. > >> > > > >> But > >> > > > >> > > > when > >> > > > >> > > > > i > >> > > > >> > > > > > > > clean > >> > > > >> > > > > > > > > ode_job table and create a new instance it > works > >> > fine. > >> > > > >> > > > > > > > > > >> > > > >> > > > > > > > > 2. If i have more than 9 activities in flow , > it > >> > takes > >> > > > >> large > >> > > > >> > > > amount > >> > > > >> > > > > > of > >> > > > >> > > > > > > > time > >> > > > >> > > > > > > > > to release all the tasks. > >> > > > >> > > > > > > > > > >> > > > >> > > > > > > > > > >> > > > >> > > > > > > > > Can you help me to fix these issues. > >> > > > >> > > > > > > > > > >> > > > >> > > > > > > > > Thanks, > >> > > > >> > > > > > > > > Gangadhar. > >> > > > >> > > > > > > > > > >> > > > >> > > > > > > > > >> > > > >> > > > > > > > >> > > > >> > > > > > > >> > > > >> > > > > > >> > > > >> > > > > >> > > > >> > > > >> > > > >> > > >> > > > >> > > >> > > > >> > > >> > > > >> > >> > > > > > >> > > > > > >> > > > > >> > > > >> > > >> > > > > >
