Sathwik, I am still facing the issue with flow activity if it has more than 8 tasks in parallel. And also the retry time is getting increased everytime(multipled by 5) . So its a big delay for me to get the activity. Is there any config file to change the retry time?
Regards, Ganga. On Fri, Jul 14, 2017 at 12:03 PM, Gangadhar ireddy < [email protected]> wrote: > Sure Sathwik, let me try on a dedicated database, Thanks a lot for your > help. > > Regards, > Gangadhar. > > On Thu, Jul 13, 2017 at 5:40 PM, Sathwik B P <[email protected]> wrote: > >> I have taken a specific job's execution time from your logs. >> >> Example: >> Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11 14:01:07 EDT refer [1] >> It could not acquire the instance lock and hence was scheduled for 25sec >> later, refer [2]. This is the second retry iteration. The first iteration >> would have been with a 5sec delay, one should have seen this in the logs, >> may be you have truncated that part of the logs. >> When the job got into execution the time should have been sometime >> approximately around 14:01:07 + 25sec = 14:01:32, but its time: 2017-07-11 >> 14:02:13 EDT refer [3], shows a huge additional delay about 40sec more. >> Due to slow running transactions, the Scheduler will throttle the jobs. >> >> To improve the execution times, >> * Put off event generation (http://ode.apache.org/ode-exe >> cution-events.html >> ). >> * Have a dedicated database server with good hardware. >> >> [1] >> 424519845 [ODEServer-513] ERROR >> org.apache.ode.scheduler.simple.SimpleScheduler - Error while >> processing a >> persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11 14:01:07 EDT >> transacted: true persisted: true details: JobDetails( instanceId: 48210 >> mexId: 50968 processId: null type: INVOKE_RESPONSE channel: 423 >> correlatorId: null correlationKeySet: null retryCount: 1 inMem: false >> detailsExt: {}) >> >> [2] >> 424519862 [ODEServer-513] ERROR >> org.apache.ode.scheduler.simple.SimpleScheduler - Error while processing >> job, retrying in 25s >> >> [3] >> 424573863 [ODEServer-517] ERROR >> org.apache.ode.scheduler.simple.SimpleScheduler - Error while >> processing a >> persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11 14:02:13 EDT >> transacted: true persisted: true details: JobDetails( instanceId: 48210 >> mexId: 50968 processId: null type: INVOKE_RESPONSE channel: 423 >> correlatorId: null correlationKeySet: null retryCount: 2 inMem: false >> detailsExt: {}) >> >> regards, >> sathwik >> >> On Thu, Jul 13, 2017 at 3:03 PM, Sathwik B P <[email protected]> >> wrote: >> >> > What is the setting for the below config parameter in your >> > ode.axis2.properties file >> > ode-axis2.tx.factory.class= >> > >> > Have you configured a Transaction Manager in your tomcat? >> > >> > On Thu, Jul 13, 2017 at 2:23 PM, Gangadhar ireddy < >> > [email protected]> wrote: >> > >> >> Hi Sathwik, >> >> >> >> Please find the details below:- >> >> >> >> ODE version :- 1.3.5 >> >> Server :- Apache tomcat >> >> Database :- Oracle >> >> OpenJPA or Hibernate:- Hibernate >> >> >> >> Regards, >> >> Gangadhar. >> >> >> >> On Thu, Jul 13, 2017 at 12:43 PM, Sathwik B P <[email protected]> >> >> wrote: >> >> >> >> > Can you provide these info please >> >> > ODE version? >> >> > Server? >> >> > Database? >> >> > OpenJPA or Hibernate? >> >> > >> >> > On Thu, Jul 13, 2017 at 5:45 AM, Gangadhar ireddy < >> >> > [email protected]> wrote: >> >> > >> >> > > 424519400 [ODEServer-505] INFO org.apache.ode.axis2.ExternalS >> ervice >> >> - >> >> > > Response: >> >> > > <?xml version="1.0" encoding="UTF-8"?> >> >> > > <message><SubProcess24Task137Output><SubProcess24Task137Output >> >> xmlns=" >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task137"; >> >> xmlns:SOAP-ENV=" >> >> > > http://schemas.xmlsoap.org/soap/envelope/"; xmlns:tns=" >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task137";>< >> >> > > humanTaskInvokeResponse >> >> > > xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"; >> >> > > xmlns:htds=" >> >> > > http://www.altair.com/WF/Framework/HumanTaskDataSchema >> >> > > ">true</humanTaskInvokeResponse></SubProcess24Task137Output></ >> >> > > SubProcess24Task137Output></message> >> >> > > 424519845 [ODEServer-513] ERROR >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while >> >> > processing >> >> > > a >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11 14:01:07 >> >> EDT >> >> > > transacted: true persisted: true details: JobDetails( instanceId: >> >> 48210 >> >> > > mexId: 50968 processId: null type: INVOKE_RESPONSE channel: 423 >> >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem: >> false >> >> > > detailsExt: {}) >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock( >> >> > > BpelEngineImpl.java:394) >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob( >> >> > > BpelEngineImpl.java:403) >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob( >> >> > > BpelServerImpl.java:450) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ >> >> > > 1.call(SimpleScheduler.java:518) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ >> >> > > 1.call(SimpleScheduler.java:512) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( >> >> > > SimpleScheduler.java:284) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( >> >> > > SimpleScheduler.java:239) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. >> >> > > call(SimpleScheduler.java:512) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. >> >> > > call(SimpleScheduler.java:496) >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266) >> >> > > at >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker( >> >> > > ThreadPoolExecutor.java:1142) >> >> > > at >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run( >> >> > > ThreadPoolExecutor.java:617) >> >> > > at java.lang.Thread.run(Thread.java:745) >> >> > > 424519851 [ODEServer-518] ERROR >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while >> >> > processing >> >> > > a >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhem time: 2017-07-11 14:01:05 >> >> EDT >> >> > > transacted: true persisted: true details: JobDetails( instanceId: >> >> 48210 >> >> > > mexId: 50955 processId: null type: INVOKE_RESPONSE channel: 269 >> >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem: >> false >> >> > > detailsExt: {}) >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock( >> >> > > BpelEngineImpl.java:394) >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob( >> >> > > BpelEngineImpl.java:403) >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob( >> >> > > BpelServerImpl.java:450) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ >> >> > > 1.call(SimpleScheduler.java:518) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ >> >> > > 1.call(SimpleScheduler.java:512) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( >> >> > > SimpleScheduler.java:284) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( >> >> > > SimpleScheduler.java:239) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. >> >> > > call(SimpleScheduler.java:512) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. >> >> > > call(SimpleScheduler.java:496) >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266) >> >> > > at >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker( >> >> > > ThreadPoolExecutor.java:1142) >> >> > > at >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run( >> >> > > ThreadPoolExecutor.java:617) >> >> > > at java.lang.Thread.run(Thread.java:745) >> >> > > 424519854 [ODEServer-508] ERROR >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while >> >> > processing >> >> > > a >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xheq time: 2017-07-11 14:01:05 >> >> EDT >> >> > > transacted: true persisted: true details: JobDetails( instanceId: >> >> 48210 >> >> > > mexId: 50964 processId: null type: INVOKE_RESPONSE channel: 378 >> >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem: >> false >> >> > > detailsExt: {}) >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock( >> >> > > BpelEngineImpl.java:394) >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob( >> >> > > BpelEngineImpl.java:403) >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob( >> >> > > BpelServerImpl.java:450) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ >> >> > > 1.call(SimpleScheduler.java:518) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ >> >> > > 1.call(SimpleScheduler.java:512) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( >> >> > > SimpleScheduler.java:284) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( >> >> > > SimpleScheduler.java:239) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. >> >> > > call(SimpleScheduler.java:512) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. >> >> > > call(SimpleScheduler.java:496) >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266) >> >> > > at >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker( >> >> > > ThreadPoolExecutor.java:1142) >> >> > > at >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run( >> >> > > ThreadPoolExecutor.java:617) >> >> > > at java.lang.Thread.run(Thread.java:745) >> >> > > 424519853 [ODEServer-502] ERROR >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while >> >> > processing >> >> > > a >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhen time: 2017-07-11 14:01:05 >> >> EDT >> >> > > transacted: true persisted: true details: JobDetails( instanceId: >> >> 48210 >> >> > > mexId: 50959 processId: null type: INVOKE_RESPONSE channel: 316 >> >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem: >> false >> >> > > detailsExt: {}) >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock( >> >> > > BpelEngineImpl.java:394) >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob( >> >> > > BpelEngineImpl.java:403) >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob( >> >> > > BpelServerImpl.java:450) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ >> >> > > 1.call(SimpleScheduler.java:518) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ >> >> > > 1.call(SimpleScheduler.java:512) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( >> >> > > SimpleScheduler.java:284) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( >> >> > > SimpleScheduler.java:239) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. >> >> > > call(SimpleScheduler.java:512) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. >> >> > > call(SimpleScheduler.java:496) >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266) >> >> > > at >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker( >> >> > > ThreadPoolExecutor.java:1142) >> >> > > at >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run( >> >> > > ThreadPoolExecutor.java:617) >> >> > > at java.lang.Thread.run(Thread.java:745) >> >> > > 424519849 [ODEServer-506] ERROR >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while >> >> > processing >> >> > > a >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhes time: 2017-07-11 14:01:05 >> >> EDT >> >> > > transacted: true persisted: true details: JobDetails( instanceId: >> >> 48210 >> >> > > mexId: 50956 processId: null type: INVOKE_RESPONSE channel: 282 >> >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem: >> false >> >> > > detailsExt: {}) >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock( >> >> > > BpelEngineImpl.java:394) >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob( >> >> > > BpelEngineImpl.java:403) >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob( >> >> > > BpelServerImpl.java:450) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ >> >> > > 1.call(SimpleScheduler.java:518) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ >> >> > > 1.call(SimpleScheduler.java:512) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( >> >> > > SimpleScheduler.java:284) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( >> >> > > SimpleScheduler.java:239) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. >> >> > > call(SimpleScheduler.java:512) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. >> >> > > call(SimpleScheduler.java:496) >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266) >> >> > > at >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker( >> >> > > ThreadPoolExecutor.java:1142) >> >> > > at >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run( >> >> > > ThreadPoolExecutor.java:617) >> >> > > at java.lang.Thread.run(Thread.java:745) >> >> > > 424519852 [ODEServer-504] ERROR >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while >> >> > processing >> >> > > a >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xheu time: 2017-07-11 14:01:05 >> >> EDT >> >> > > transacted: true persisted: true details: JobDetails( instanceId: >> >> 48210 >> >> > > mexId: 50966 processId: null type: INVOKE_RESPONSE channel: 401 >> >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem: >> false >> >> > > detailsExt: {}) >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock( >> >> > > BpelEngineImpl.java:394) >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob( >> >> > > BpelEngineImpl.java:403) >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob( >> >> > > BpelServerImpl.java:450) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ >> >> > > 1.call(SimpleScheduler.java:518) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ >> >> > > 1.call(SimpleScheduler.java:512) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( >> >> > > SimpleScheduler.java:284) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( >> >> > > SimpleScheduler.java:239) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. >> >> > > call(SimpleScheduler.java:512) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. >> >> > > call(SimpleScheduler.java:496) >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266) >> >> > > at >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker( >> >> > > ThreadPoolExecutor.java:1142) >> >> > > at >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run( >> >> > > ThreadPoolExecutor.java:617) >> >> > > at java.lang.Thread.run(Thread.java:745) >> >> > > 424519865 [ODEServer-506] ERROR >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while >> >> > processing >> >> > > job, retrying in 25s >> >> > > 424519865 [ODEServer-502] ERROR >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while >> >> > processing >> >> > > job, retrying in 25s >> >> > > 424519866 [ODEServer-508] ERROR >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while >> >> > processing >> >> > > job, retrying in 25s >> >> > > 424519863 [ODEServer-511] ERROR >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while >> >> > processing >> >> > > a >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhev time: 2017-07-11 14:01:05 >> >> EDT >> >> > > transacted: true persisted: true details: JobDetails( instanceId: >> >> 48210 >> >> > > mexId: 50965 processId: null type: INVOKE_RESPONSE channel: 383 >> >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem: >> false >> >> > > detailsExt: {}) >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock( >> >> > > BpelEngineImpl.java:394) >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob( >> >> > > BpelEngineImpl.java:403) >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob( >> >> > > BpelServerImpl.java:450) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ >> >> > > 1.call(SimpleScheduler.java:518) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ >> >> > > 1.call(SimpleScheduler.java:512) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( >> >> > > SimpleScheduler.java:284) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( >> >> > > SimpleScheduler.java:239) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. >> >> > > call(SimpleScheduler.java:512) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. >> >> > > call(SimpleScheduler.java:496) >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266) >> >> > > at >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker( >> >> > > ThreadPoolExecutor.java:1142) >> >> > > at >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run( >> >> > > ThreadPoolExecutor.java:617) >> >> > > at java.lang.Thread.run(Thread.java:745) >> >> > > 424519863 [ODEServer-507] ERROR >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while >> >> > processing >> >> > > a >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhep time: 2017-07-11 14:01:05 >> >> EDT >> >> > > transacted: true persisted: true details: JobDetails( instanceId: >> >> 48210 >> >> > > mexId: 50953 processId: null type: INVOKE_RESPONSE channel: 226 >> >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem: >> false >> >> > > detailsExt: {}) >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock( >> >> > > BpelEngineImpl.java:394) >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob( >> >> > > BpelEngineImpl.java:403) >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob( >> >> > > BpelServerImpl.java:450) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ >> >> > > 1.call(SimpleScheduler.java:518) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ >> >> > > 1.call(SimpleScheduler.java:512) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( >> >> > > SimpleScheduler.java:284) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( >> >> > > SimpleScheduler.java:239) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. >> >> > > call(SimpleScheduler.java:512) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. >> >> > > call(SimpleScheduler.java:496) >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266) >> >> > > at >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker( >> >> > > ThreadPoolExecutor.java:1142) >> >> > > at >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run( >> >> > > ThreadPoolExecutor.java:617) >> >> > > at java.lang.Thread.run(Thread.java:745) >> >> > > 424519862 [ODEServer-519] ERROR >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while >> >> > processing >> >> > > a >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhel time: 2017-07-11 14:01:05 >> >> EDT >> >> > > transacted: true persisted: true details: JobDetails( instanceId: >> >> 48210 >> >> > > mexId: 50963 processId: null type: INVOKE_RESPONSE channel: 365 >> >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem: >> false >> >> > > detailsExt: {}) >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock( >> >> > > BpelEngineImpl.java:394) >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob( >> >> > > BpelEngineImpl.java:403) >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob( >> >> > > BpelServerImpl.java:450) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ >> >> > > 1.call(SimpleScheduler.java:518) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ >> >> > > 1.call(SimpleScheduler.java:512) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( >> >> > > SimpleScheduler.java:284) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( >> >> > > SimpleScheduler.java:239) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. >> >> > > call(SimpleScheduler.java:512) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. >> >> > > call(SimpleScheduler.java:496) >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266) >> >> > > at >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker( >> >> > > ThreadPoolExecutor.java:1142) >> >> > > at >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run( >> >> > > ThreadPoolExecutor.java:617) >> >> > > at java.lang.Thread.run(Thread.java:745) >> >> > > 424519868 [ODEServer-511] ERROR >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while >> >> > processing >> >> > > job, retrying in 25s >> >> > > 424519862 [ODEServer-513] ERROR >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while >> >> > processing >> >> > > job, retrying in 25s >> >> > > 424519868 [ODEServer-507] ERROR >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while >> >> > processing >> >> > > job, retrying in 25s >> >> > > 424519868 [ODEServer-519] ERROR >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while >> >> > processing >> >> > > job, retrying in 25s >> >> > > 424519867 [ODEServer-518] ERROR >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while >> >> > processing >> >> > > job, retrying in 25s >> >> > > 424519866 [ODEServer-504] ERROR >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while >> >> > processing >> >> > > job, retrying in 25s >> >> > > 424519866 [ODEServer-510] ERROR >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while >> >> > processing >> >> > > a >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xher time: 2017-07-11 14:01:05 >> >> EDT >> >> > > transacted: true persisted: true details: JobDetails( instanceId: >> >> 48210 >> >> > > mexId: 50957 processId: null type: INVOKE_RESPONSE channel: 295 >> >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem: >> false >> >> > > detailsExt: {}) >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock( >> >> > > BpelEngineImpl.java:394) >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob( >> >> > > BpelEngineImpl.java:403) >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob( >> >> > > BpelServerImpl.java:450) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ >> >> > > 1.call(SimpleScheduler.java:518) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ >> >> > > 1.call(SimpleScheduler.java:512) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( >> >> > > SimpleScheduler.java:284) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( >> >> > > SimpleScheduler.java:239) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. >> >> > > call(SimpleScheduler.java:512) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. >> >> > > call(SimpleScheduler.java:496) >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266) >> >> > > at >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker( >> >> > > ThreadPoolExecutor.java:1142) >> >> > > at >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run( >> >> > > ThreadPoolExecutor.java:617) >> >> > > at java.lang.Thread.run(Thread.java:745) >> >> > > 424519870 [ODEServer-510] ERROR >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while >> >> > processing >> >> > > job, retrying in 25s >> >> > > 424522517 [ODEServer-510] INFO org.apache.ode.axis2.ExternalS >> ervice >> >> - >> >> > > Response: >> >> > > <?xml version="1.0" encoding="UTF-8"?> >> >> > > <message><SubProcess24Task131Output><SubProcess24Task131Output >> >> xmlns=" >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task131"; >> >> xmlns:SOAP-ENV=" >> >> > > http://schemas.xmlsoap.org/soap/envelope/"; xmlns:tns=" >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task131";>< >> >> > > humanTaskInvokeResponse >> >> > > xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"; >> >> > > xmlns:htds=" >> >> > > http://www.altair.com/WF/Framework/HumanTaskDataSchema >> >> > > ">true</humanTaskInvokeResponse></SubProcess24Task131Output></ >> >> > > SubProcess24Task131Output></message> >> >> > > 424573639 [ODEServer-510] INFO org.apache.ode.axis2.ExternalS >> ervice >> >> - >> >> > > Response: >> >> > > <?xml version="1.0" encoding="UTF-8"?> >> >> > > <message><SubProcess24Task132Output><SubProcess24Task132Output >> >> xmlns=" >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task132"; >> >> xmlns:SOAP-ENV=" >> >> > > http://schemas.xmlsoap.org/soap/envelope/"; xmlns:tns=" >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task132";>< >> >> > > humanTaskInvokeResponse >> >> > > xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"; >> >> > > xmlns:htds=" >> >> > > http://www.altair.com/WF/Framework/HumanTaskDataSchema >> >> > > ">true</humanTaskInvokeResponse></SubProcess24Task132Output></ >> >> > > SubProcess24Task132Output></message> >> >> > > 424573852 [ODEServer-513] ERROR >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while >> >> > processing >> >> > > a >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhev time: 2017-07-11 14:02:13 >> >> EDT >> >> > > transacted: true persisted: true details: JobDetails( instanceId: >> >> 48210 >> >> > > mexId: 50965 processId: null type: INVOKE_RESPONSE channel: 383 >> >> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem: >> false >> >> > > detailsExt: {}) >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock( >> >> > > BpelEngineImpl.java:394) >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob( >> >> > > BpelEngineImpl.java:403) >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob( >> >> > > BpelServerImpl.java:450) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ >> >> > > 1.call(SimpleScheduler.java:518) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ >> >> > > 1.call(SimpleScheduler.java:512) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( >> >> > > SimpleScheduler.java:284) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( >> >> > > SimpleScheduler.java:239) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. >> >> > > call(SimpleScheduler.java:512) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. >> >> > > call(SimpleScheduler.java:496) >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266) >> >> > > at >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker( >> >> > > ThreadPoolExecutor.java:1142) >> >> > > at >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run( >> >> > > ThreadPoolExecutor.java:617) >> >> > > at java.lang.Thread.run(Thread.java:745) >> >> > > 424573856 [ODEServer-511] ERROR >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while >> >> > processing >> >> > > a >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhel time: 2017-07-11 14:02:13 >> >> EDT >> >> > > transacted: true persisted: true details: JobDetails( instanceId: >> >> 48210 >> >> > > mexId: 50963 processId: null type: INVOKE_RESPONSE channel: 365 >> >> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem: >> false >> >> > > detailsExt: {}) >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock( >> >> > > BpelEngineImpl.java:394) >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob( >> >> > > BpelEngineImpl.java:403) >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob( >> >> > > BpelServerImpl.java:450) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ >> >> > > 1.call(SimpleScheduler.java:518) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ >> >> > > 1.call(SimpleScheduler.java:512) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( >> >> > > SimpleScheduler.java:284) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( >> >> > > SimpleScheduler.java:239) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. >> >> > > call(SimpleScheduler.java:512) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. >> >> > > call(SimpleScheduler.java:496) >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266) >> >> > > at >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker( >> >> > > ThreadPoolExecutor.java:1142) >> >> > > at >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run( >> >> > > ThreadPoolExecutor.java:617) >> >> > > at java.lang.Thread.run(Thread.java:745) >> >> > > 424573863 [ODEServer-504] ERROR >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while >> >> > processing >> >> > > a >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhes time: 2017-07-11 14:02:13 >> >> EDT >> >> > > transacted: true persisted: true details: JobDetails( instanceId: >> >> 48210 >> >> > > mexId: 50956 processId: null type: INVOKE_RESPONSE channel: 282 >> >> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem: >> false >> >> > > detailsExt: {}) >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock( >> >> > > BpelEngineImpl.java:394) >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob( >> >> > > BpelEngineImpl.java:403) >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob( >> >> > > BpelServerImpl.java:450) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ >> >> > > 1.call(SimpleScheduler.java:518) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ >> >> > > 1.call(SimpleScheduler.java:512) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( >> >> > > SimpleScheduler.java:284) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( >> >> > > SimpleScheduler.java:239) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. >> >> > > call(SimpleScheduler.java:512) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. >> >> > > call(SimpleScheduler.java:496) >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266) >> >> > > at >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker( >> >> > > ThreadPoolExecutor.java:1142) >> >> > > at >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run( >> >> > > ThreadPoolExecutor.java:617) >> >> > > at java.lang.Thread.run(Thread.java:745) >> >> > > 424573865 [ODEServer-513] ERROR >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while >> >> > processing >> >> > > job, retrying in 125s >> >> > > 424573863 [ODEServer-517] ERROR >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while >> >> > processing >> >> > > a >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11 14:02:13 >> >> EDT >> >> > > transacted: true persisted: true details: JobDetails( instanceId: >> >> 48210 >> >> > > mexId: 50968 processId: null type: INVOKE_RESPONSE channel: 423 >> >> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem: >> false >> >> > > detailsExt: {}) >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock( >> >> > > BpelEngineImpl.java:394) >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob( >> >> > > BpelEngineImpl.java:403) >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob( >> >> > > BpelServerImpl.java:450) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ >> >> > > 1.call(SimpleScheduler.java:518) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ >> >> > > 1.call(SimpleScheduler.java:512) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( >> >> > > SimpleScheduler.java:284) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( >> >> > > SimpleScheduler.java:239) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. >> >> > > call(SimpleScheduler.java:512) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. >> >> > > call(SimpleScheduler.java:496) >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266) >> >> > > at >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker( >> >> > > ThreadPoolExecutor.java:1142) >> >> > > at >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run( >> >> > > ThreadPoolExecutor.java:617) >> >> > > at java.lang.Thread.run(Thread.java:745) >> >> > > 424573863 [ODEServer-514] ERROR >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while >> >> > processing >> >> > > a >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhem time: 2017-07-11 14:02:13 >> >> EDT >> >> > > transacted: true persisted: true details: JobDetails( instanceId: >> >> 48210 >> >> > > mexId: 50955 processId: null type: INVOKE_RESPONSE channel: 269 >> >> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem: >> false >> >> > > detailsExt: {}) >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock( >> >> > > BpelEngineImpl.java:394) >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob( >> >> > > BpelEngineImpl.java:403) >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob( >> >> > > BpelServerImpl.java:450) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ >> >> > > 1.call(SimpleScheduler.java:518) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ >> >> > > 1.call(SimpleScheduler.java:512) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( >> >> > > SimpleScheduler.java:284) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( >> >> > > SimpleScheduler.java:239) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. >> >> > > call(SimpleScheduler.java:512) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. >> >> > > call(SimpleScheduler.java:496) >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266) >> >> > > at >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker( >> >> > > ThreadPoolExecutor.java:1142) >> >> > > at >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run( >> >> > > ThreadPoolExecutor.java:617) >> >> > > at java.lang.Thread.run(Thread.java:745) >> >> > > 424573868 [ODEServer-508] ERROR >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while >> >> > processing >> >> > > a >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhep time: 2017-07-11 14:02:13 >> >> EDT >> >> > > transacted: true persisted: true details: JobDetails( instanceId: >> >> 48210 >> >> > > mexId: 50953 processId: null type: INVOKE_RESPONSE channel: 226 >> >> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem: >> false >> >> > > detailsExt: {}) >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock( >> >> > > BpelEngineImpl.java:394) >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob( >> >> > > BpelEngineImpl.java:403) >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob( >> >> > > BpelServerImpl.java:450) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ >> >> > > 1.call(SimpleScheduler.java:518) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ >> >> > > 1.call(SimpleScheduler.java:512) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( >> >> > > SimpleScheduler.java:284) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( >> >> > > SimpleScheduler.java:239) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. >> >> > > call(SimpleScheduler.java:512) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. >> >> > > call(SimpleScheduler.java:496) >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266) >> >> > > at >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker( >> >> > > ThreadPoolExecutor.java:1142) >> >> > > at >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run( >> >> > > ThreadPoolExecutor.java:617) >> >> > > at java.lang.Thread.run(Thread.java:745) >> >> > > 424573868 [ODEServer-507] ERROR >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while >> >> > processing >> >> > > a >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xheu time: 2017-07-11 14:02:13 >> >> EDT >> >> > > transacted: true persisted: true details: JobDetails( instanceId: >> >> 48210 >> >> > > mexId: 50966 processId: null type: INVOKE_RESPONSE channel: 401 >> >> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem: >> false >> >> > > detailsExt: {}) >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock( >> >> > > BpelEngineImpl.java:394) >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob( >> >> > > BpelEngineImpl.java:403) >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob( >> >> > > BpelServerImpl.java:450) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ >> >> > > 1.call(SimpleScheduler.java:518) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ >> >> > > 1.call(SimpleScheduler.java:512) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( >> >> > > SimpleScheduler.java:284) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( >> >> > > SimpleScheduler.java:239) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. >> >> > > call(SimpleScheduler.java:512) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. >> >> > > call(SimpleScheduler.java:496) >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266) >> >> > > at >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker( >> >> > > ThreadPoolExecutor.java:1142) >> >> > > at >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run( >> >> > > ThreadPoolExecutor.java:617) >> >> > > at java.lang.Thread.run(Thread.java:745) >> >> > > 424573869 [ODEServer-517] ERROR >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while >> >> > processing >> >> > > job, retrying in 125s >> >> > > 424573869 [ODEServer-504] ERROR >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while >> >> > processing >> >> > > job, retrying in 125s >> >> > > 424573870 [ODEServer-514] ERROR >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while >> >> > processing >> >> > > job, retrying in 125s >> >> > > 424573870 [ODEServer-511] ERROR >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while >> >> > processing >> >> > > job, retrying in 125s >> >> > > 424573868 [ODEServer-519] ERROR >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while >> >> > processing >> >> > > a >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhen time: 2017-07-11 14:02:13 >> >> EDT >> >> > > transacted: true persisted: true details: JobDetails( instanceId: >> >> 48210 >> >> > > mexId: 50959 processId: null type: INVOKE_RESPONSE channel: 316 >> >> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem: >> false >> >> > > detailsExt: {}) >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock( >> >> > > BpelEngineImpl.java:394) >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob( >> >> > > BpelEngineImpl.java:403) >> >> > > at >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob( >> >> > > BpelServerImpl.java:450) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ >> >> > > 1.call(SimpleScheduler.java:518) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$ >> >> > > 1.call(SimpleScheduler.java:512) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( >> >> > > SimpleScheduler.java:284) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction( >> >> > > SimpleScheduler.java:239) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. >> >> > > call(SimpleScheduler.java:512) >> >> > > at >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob. >> >> > > call(SimpleScheduler.java:496) >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266) >> >> > > at >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker( >> >> > > ThreadPoolExecutor.java:1142) >> >> > > at >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run( >> >> > > ThreadPoolExecutor.java:617) >> >> > > at java.lang.Thread.run(Thread.java:745) >> >> > > 424573870 [ODEServer-507] ERROR >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while >> >> > processing >> >> > > job, retrying in 125s >> >> > > 424573870 [ODEServer-508] ERROR >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while >> >> > processing >> >> > > job, retrying in 125s >> >> > > 424573871 [ODEServer-519] ERROR >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error while >> >> > processing >> >> > > job, retrying in 125s >> >> > > 424575807 [ODEServer-511] INFO org.apache.ode.axis2.ExternalS >> ervice >> >> - >> >> > > Response: >> >> > > <?xml version="1.0" encoding="UTF-8"?> >> >> > > <message><SubProcess24Task135Output><SubProcess24Task135Output >> >> xmlns=" >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task135"; >> >> xmlns:SOAP-ENV=" >> >> > > http://schemas.xmlsoap.org/soap/envelope/"; xmlns:tns=" >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task135";>< >> >> > > humanTaskInvokeResponse >> >> > > xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"; >> >> > > xmlns:htds=" >> >> > > http://www.altair.com/WF/Framework/HumanTaskDataSchema >> >> > > ">true</humanTaskInvokeResponse></SubProcess24Task135Output></ >> >> > > SubProcess24Task135Output></message> >> >> > > >> >> > > >> >> > > On Wed, Jul 12, 2017 at 7:12 PM, Sathwik B P <[email protected] >> > >> >> > wrote: >> >> > > >> >> > > > Attachment has not come through. >> >> > > > >> >> > > > put it inline >> >> > > > >> >> > > > On Jul 12, 2017 18:43, "Gangadhar ireddy" < >> >> [email protected]> >> >> > > > wrote: >> >> > > > >> >> > > > > Sathwik, >> >> > > > > >> >> > > > > Please find the attached log. >> >> > > > > >> >> > > > > Regards, >> >> > > > > Gangadhar. >> >> > > > > >> >> > > > > On Wed, Jul 12, 2017 at 3:40 PM, Sathwik B P < >> >> [email protected]> >> >> > > > wrote: >> >> > > > > >> >> > > > >> Can you send the complete logs. >> >> > > > >> >> >> > > > >> On Wed, Jul 12, 2017 at 2:32 PM, Sathwik B P < >> >> [email protected]> >> >> > > > >> wrote: >> >> > > > >> >> >> > > > >> > Usually, the jobs gets executed pretty much quickly. >> >> > > > >> > >> >> > > > >> > Factors that might be delaying the execution of jobs is a >> slow >> >> > > > database. >> >> > > > >> > >> >> > > > >> > How many concurrent messages is the process expecting? >> >> > > > >> > >> >> > > > >> > On Jul 12, 2017 13:38, "Gangadhar ireddy" < >> >> > > [email protected] >> >> > > > > >> >> > > > >> > wrote: >> >> > > > >> > >> >> > > > >> > We are waiting for the jobs and it releases many times, but >> few >> >> > > times >> >> > > > it >> >> > > > >> > doesn't release, Is there any limit on the rescheduling? >> >> > > > >> > >> >> > > > >> > Regards, >> >> > > > >> > Gangadhar. >> >> > > > >> > >> >> > > > >> > On Wed, Jul 12, 2017 at 1:14 PM, Sathwik B P < >> >> > [email protected]> >> >> > > > >> wrote: >> >> > > > >> > >> >> > > > >> > > This is normal. Concurrent messages are competing for the >> >> > instance >> >> > > > >> lock. >> >> > > > >> > > Job that doesn't get the lock on the instance has to wait >> and >> >> > will >> >> > > > be >> >> > > > >> > > rescheduled. >> >> > > > >> > > You should never clear the job table. >> >> > > > >> > > >> >> > > > >> > > On Jul 12, 2017 12:08, "Gangadhar ireddy" < >> >> > > > [email protected] >> >> > > > >> > >> >> > > > >> > > wrote: >> >> > > > >> > > >> >> > > > >> > > Sathwik, >> >> > > > >> > > >> >> > > > >> > > Please find the below log, >> >> > > > >> > > >> >> > > > >> > > <message><SubProcess24Task137O >> utput><SubProcess24Task137Outp >> >> ut >> >> > > > >> > > xmlns="http://www.altair.com/E >> PM/Schema/SubProcess24Task137" >> >> > > > >> > > xmlns:SOAP-ENV="http://schemas.xmlsoap.org/soap/envelope/ >> " >> >> > > > >> > > xmlns:tns="http://www.altair.c >> om/EPM/Schema/SubProcess24Task >> >> 137 >> >> > > ">< >> >> > > > >> > > humanTaskInvokeResponse >> >> > > > >> > > xmlns="http://www.altair.com/W >> F/Framework/HumanTaskDataSchem >> >> a" >> >> > > > >> > > xmlns:htds="http://www.altair.com/WF/Framework/ >> >> > > HumanTaskDataSchema >> >> > > > >> > ">true</ >> >> > > > >> > > humanTaskInvokeResponse></SubProcess24Task137Output></ >> >> > > > >> > > SubProcess24Task137Output></message> >> >> > > > >> > > 424519845 [ODEServer-513] ERROR >> >> > > > >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error >> >> while >> >> > > > >> > > processing a persisted job: Job hqejbhcnphrcfcpvi9xhf3 >> time: >> >> > > > >> > > 2017-07-11 14:01:07 EDT transacted: true persisted: true >> >> > details: >> >> > > > >> > > JobDetails( instanceId: 48210 mexId: 50968 processId: null >> >> type: >> >> > > > >> > > INVOKE_RESPONSE channel: 423 correlatorId: null >> >> > correlationKeySet: >> >> > > > >> > > null retryCount: 1 inMem: false detailsExt: {}) >> >> > > > >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException >> >> > > > >> > > at org.apache.ode.bpel.engine.Bpe >> >> > > > >> lEngineImpl.acquireInstanceLoc >> >> > > > >> > k( >> >> > > > >> > > BpelEngineImpl.java:394) >> >> > > > >> > > at org.apache.ode.bpel.engine. >> >> > > > BpelEngineImpl.onScheduledJob( >> >> > > > >> > > BpelEngineImpl.java:403) >> >> > > > >> > > at org.apache.ode.bpel.engine. >> >> > > > BpelServerImpl.onScheduledJob( >> >> > > > >> > > BpelServerImpl.java:450) >> >> > > > >> > > at org.apache.ode.scheduler. >> >> > > simple.SimpleScheduler$RunJob$ >> >> > > > >> > > 1.call(SimpleScheduler.java:518) >> >> > > > >> > > at org.apache.ode.scheduler. >> >> > > simple.SimpleScheduler$RunJob$ >> >> > > > >> > > 1.call(SimpleScheduler.java:512) >> >> > > > >> > > at org.apache.ode.scheduler.simpl >> e.SimpleScheduler. >> >> > > > >> > > execTransaction( >> >> > > > >> > > SimpleScheduler.java:284) >> >> > > > >> > > at org.apache.ode.scheduler.simpl >> e.SimpleScheduler. >> >> > > > >> > > execTransaction( >> >> > > > >> > > SimpleScheduler.java:239) >> >> > > > >> > > at org.apache.ode.scheduler. >> >> > > simple.SimpleScheduler$RunJob. >> >> > > > >> > > call(SimpleScheduler.java:512) >> >> > > > >> > > at org.apache.ode.scheduler. >> >> > > simple.SimpleScheduler$RunJob. >> >> > > > >> > > call(SimpleScheduler.java:496) >> >> > > > >> > > at java.util.concurrent.FutureTas >> k.run(FutureTask. >> >> > > java:266) >> >> > > > >> > > at java.util.concurrent.ThreadPoo >> >> lExecutor.runWorker( >> >> > > > >> > > ThreadPoolExecutor.java:1142) >> >> > > > >> > > at java.util.concurrent.ThreadPoo >> >> lExecutor$Worker.run( >> >> > > > >> > > ThreadPoolExecutor.java:617) >> >> > > > >> > > at java.lang.Thread.run(Thread.java:745) >> >> > > > >> > > 424519851 [ODEServer-518] ERROR >> >> > > > >> > > org.apache.ode.scheduler.simple.SimpleScheduler - Error >> >> while >> >> > > > >> > > processing a persisted job: Job hqejbhcnphrcfcpvi9xhem >> time: >> >> > > > >> > > 2017-07-11 14:01:05 EDT transacted: true persisted: true >> >> > details: >> >> > > > >> > > JobDetails( instanceId: 48210 mexId: 50955 processId: null >> >> type: >> >> > > > >> > > INVOKE_RESPONSE channel: 269 correlatorId: null >> >> > correlationKeySet: >> >> > > > >> > > null retryCount: 1 inMem: false detailsExt: {}) >> >> > > > >> > > >> >> > > > >> > > >> >> > > > >> > > Regards, >> >> > > > >> > > >> >> > > > >> > > Gangadhar. >> >> > > > >> > > >> >> > > > >> > > >> >> > > > >> > > On Tue, Jul 11, 2017 at 12:08 PM, Sathwik B P < >> >> > > [email protected] >> >> > > > > >> >> > > > >> > > wrote: >> >> > > > >> > > >> >> > > > >> > > > There are multiple factors for intermittent issues. I >> can >> >> only >> >> > > > >> > speculate >> >> > > > >> > > > here with limited information. >> >> > > > >> > > > >> >> > > > >> > > > Check your logs for failures when it happens and share >> it >> >> > here, >> >> > > so >> >> > > > >> that >> >> > > > >> > > we >> >> > > > >> > > > can help you better. If possible put in a sample >> process to >> >> > > > >> reproduce >> >> > > > >> > > your >> >> > > > >> > > > scenario and share here. >> >> > > > >> > > > >> >> > > > >> > > > >> >> > > > >> > > > >> >> > > > >> > > > >> >> > > > >> > > > >> >> > > > >> > > > On Tue, Jul 11, 2017 at 9:55 AM, Gangadhar ireddy < >> >> > > > >> > > > [email protected]> wrote: >> >> > > > >> > > > >> >> > > > >> > > > > Sometimes the activity gets released, if it is due to >> >> > failures >> >> > > > in >> >> > > > >> the >> >> > > > >> > > > > process, it should fail every time right? >> >> > > > >> > > > > >> >> > > > >> > > > > Regards, >> >> > > > >> > > > > Gangadhar. >> >> > > > >> > > > > >> >> > > > >> > > > > On Mon, Jul 10, 2017 at 7:06 PM, Sathwik B P < >> >> > > > >> [email protected]> >> >> > > > >> > > > wrote: >> >> > > > >> > > > > >> >> > > > >> > > > > > Jobs might be getting rescheduled due to failures in >> >> the >> >> > > > >> process. >> >> > > > >> > > > > > Check the logs for errors. >> >> > > > >> > > > > > >> >> > > > >> > > > > > On Mon, Jul 10, 2017 at 10:12 AM, Gangadhar ireddy < >> >> > > > >> > > > > > [email protected]> wrote: >> >> > > > >> > > > > > >> >> > > > >> > > > > > > Hi Sathwik, >> >> > > > >> > > > > > > >> >> > > > >> > > > > > > I can see INVOKE_RESPONSE type in ode_jobs >> table,for >> >> > some >> >> > > > >> tasks >> >> > > > >> > it >> >> > > > >> > > > will >> >> > > > >> > > > > > be >> >> > > > >> > > > > > > updated with INVOKE_CHECK from INVOKE_RESPONSE. >> >> > Sometimes >> >> > > it >> >> > > > >> > takes >> >> > > > >> > > > more >> >> > > > >> > > > > > > time to release the tasks, sometimes it will not >> >> > release. >> >> > > > >> > > > > > > >> >> > > > >> > > > > > > Regards, >> >> > > > >> > > > > > > Ganga. >> >> > > > >> > > > > > > >> >> > > > >> > > > > > > On Fri, Jul 7, 2017 at 5:04 PM, Sathwik B P < >> >> > > > >> > [email protected]> >> >> > > > >> > > > > > wrote: >> >> > > > >> > > > > > > >> >> > > > >> > > > > > > > What kind of jobs are pending? >> >> > > > >> > > > > > > > What activities do you have within your <flow>? >> >> > > > >> > > > > > > > >> >> > > > >> > > > > > > > regards, >> >> > > > >> > > > > > > > sathwik >> >> > > > >> > > > > > > > >> >> > > > >> > > > > > > > On Fri, Jul 7, 2017 at 2:13 PM, Gangadhar >> ireddy < >> >> > > > >> > > > > > > > [email protected] >> >> > > > >> > > > > > > > > wrote: >> >> > > > >> > > > > > > > >> >> > > > >> > > > > > > > > Hi, >> >> > > > >> > > > > > > > > >> >> > > > >> > > > > > > > > This is Gangadhar working for Altair, >> currently >> >> we >> >> > are >> >> > > > >> using >> >> > > > >> > > > > > Apache-ode >> >> > > > >> > > > > > > > and >> >> > > > >> > > > > > > > > facing few issues on flow activity. >> >> > > > >> > > > > > > > > >> >> > > > >> > > > > > > > > 1. Sometimes all the activities will not be >> >> released >> >> > > and >> >> > > > >> > when i >> >> > > > >> > > > > check >> >> > > > >> > > > > > > the >> >> > > > >> > > > > > > > > ode_job table there are some records not >> getting >> >> > > > updated. >> >> > > > >> But >> >> > > > >> > > > when >> >> > > > >> > > > > i >> >> > > > >> > > > > > > > clean >> >> > > > >> > > > > > > > > ode_job table and create a new instance it >> works >> >> > fine. >> >> > > > >> > > > > > > > > >> >> > > > >> > > > > > > > > 2. If i have more than 9 activities in flow , >> it >> >> > takes >> >> > > > >> large >> >> > > > >> > > > amount >> >> > > > >> > > > > > of >> >> > > > >> > > > > > > > time >> >> > > > >> > > > > > > > > to release all the tasks. >> >> > > > >> > > > > > > > > >> >> > > > >> > > > > > > > > >> >> > > > >> > > > > > > > > Can you help me to fix these issues. >> >> > > > >> > > > > > > > > >> >> > > > >> > > > > > > > > Thanks, >> >> > > > >> > > > > > > > > Gangadhar. >> >> > > > >> > > > > > > > > >> >> > > > >> > > > > > > > >> >> > > > >> > > > > > > >> >> > > > >> > > > > > >> >> > > > >> > > > > >> >> > > > >> > > > >> >> > > > >> > > >> >> > > > >> > >> >> > > > >> > >> >> > > > >> > >> >> > > > >> >> >> > > > > >> >> > > > > >> >> > > > >> >> > > >> >> > >> >> >> > >> > >> > >
