How long does the job run before stopping? Cancelled by user could come if the job is submitted with cancel_on_interrupt and the client submitting the job were stopped.
Eddie On Tue, May 16, 2017 at 8:31 AM, Lou DeGenaro <[email protected]> wrote: > Dunno why the connection would be refused. Are the JD and JP on the same > or different machines? Is the network viable between the machines on which > each is located? > > Lou. > > On Tue, May 16, 2017 at 8:18 AM, priyank sharma <[email protected] > > > wrote: > > > Hey! > > > > There were no error found in JD log.Following is a snippet of the jD log > > > > 14 May 2017 18:47:39,593 INFO ActionGet - T[482] engage seqNo=3484 > > remote=S144.3170.35 > > 14 May 2017 18:47:39,641 INFO ActionGet - T[283] engage seqNo=3485 > > remote=S144.2443.34 > > 14 May 2017 18:47:40,688 INFO ActionEnd - T[284] engage seqNo=3470 > > remote=S144.2443.36 ended > > in getNext > > 14 May 2017 18:47:40,736 INFO ActionGet - T[483] engage seqNo=3486 > > remote=S144.2443.36 > > 14 May 2017 18:47:43,207 INFO ActionEnd - T[482] engage seqNo=3477 > > remote=S144.3346.32 ended > > in getNext > > 14 May 2017 18:47:43,254 INFO ActionGet - T[284] engage seqNo=3487 > > remote=S144.3346.32 > > 14 May 2017 18:47:43,258 INFO ActionEnd - T[283] engage seqNo=3467 > > remote=S144.2443.35 ended > > in getNext > > 14 May 2017 18:47:43,296 INFO ActionGet - T[483] engage seqNo=3488 > > remote=S144.2443.35 > > 14 May 2017 18:47:44,425 INFO ActionEnd - T[283] engage seqNo=3468 > > remote=S144.3346.34 ended > > in getNext > > 14 May 2017 18:47:44,605 INFO ActionGet - T[483] engage seqNo=3489 > > remote=S144.3346.34 > > 14 May 2017 18:47:46,105 INFO ActionEnd - T[283] engage seqNo=3480 > > remote=S144.3346.33 ended > > in getNext > > 14 May 2017 18:47:46,166 INFO ActionGet - T[482] engage seqNo=3490 > > remote=S144.3346.33 > > 14 May 2017 18:47:46,233 INFO ActionEnd - T[284] engage seqNo=3478 > > remote=S144.3346.36 ended > > in getNext > > 14 May 2017 18:47:46,415 INFO ActionGet - T[482] engage seqNo=3491 > > remote=S144.3346.36 > > 14 May 2017 18:47:49,924 INFO ActionEnd - T[284] engage seqNo=3475 > > remote=S144.3348.35 ended > > in getNext > > 14 May 2017 18:47:49,968 INFO ActionGet - T[482] engage seqNo=3492 > > remote=S144.3348.35 > > 14 May 2017 18:47:50,856 INFO ActionEnd - T[283] engage seqNo=3469 > > remote=S144.3348.32 ended > > in getNext > > 14 May 2017 18:47:50,918 INFO ActionGet - T[284] engage seqNo=3493 > > remote=S144.3348.32 > > 14 May 2017 18:47:53,566 INFO ActionEnd - T[284] engage seqNo=3459 > > remote=S144.2443.33 ended > > in getNext > > 14 May 2017 18:47:53,599 INFO ActionGet - T[483] engage seqNo=3494 > > remote=S144.2443.33 > > 14 May 2017 18:47:58,507 INFO ActionEnd - T[283] engage seqNo=3473 > > remote=S144.3348.36 ended > > in getNext > > 14 May 2017 18:47:58,565 INFO ActionGet - T[284] engage seqNo=3495 > > remote=S144.3348.36 > > 14 May 2017 18:48:06,218 INFO ActionEnd - T[283] engage seqNo=3460 > > remote=S144.3348.34 ended > > in getNext > > 14 May 2017 18:48:06,360 INFO ActionGet - T[483] engage seqNo=3496 > > remote=S144.3348.34 > > 14 May 2017 18:48:09,619 INFO ActionEnd - T[283] engage seqNo=3481 > > remote=S144.2443.32 ended > > in getNext > > 14 May 2017 18:48:09,674 INFO ActionEnd - T[483] engage seqNo=3479 > > remote=S144.3170.36 ended > > 14 May 2017 18:48:09,681 INFO ActionGet - T[284] engage seqNo=3497 > > remote=S144.2443.32 > > in getNext > > 14 May 2017 18:48:09,814 INFO ActionGet - T[482] engage seqNo=3498 > > remote=S144.3170.36 > > 14 May 2017 18:48:13,464 INFO ActionEnd - T[283] engage seqNo=3476 > > remote=S144.3346.35 ended > > in getNext > > 14 May 2017 18:48:13,498 INFO ActionGet - T[483] engage seqNo=3499 > > remote=S144.3346.35 > > 14 May 2017 18:48:15,116 INFO ActionEnd - T[284] engage seqNo=3482 > > remote=S144.3170.32 ended > > in getNext > > 14 May 2017 18:48:15,163 INFO ActionGet - T[283] engage seqNo=3500 > > remote=S144.3170.32 > > 14 May 2017 18:48:17,050 INFO ActionEnd - T[284] engage seqNo=3465 > > remote=S144.3170.33 ended > > in getNext > > 14 May 2017 18:48:17,141 INFO ActionGet - T[482] engage seqNo=3501 > > remote=S144.3170.33 > > 14 May 2017 18:48:19,138 INFO ActionEnd - T[284] engage seqNo=3471 > > remote=S144.3170.34 ended > > 14 May 2017 18:48:19,148 INFO ActionEnd - T[283] engage seqNo=3487 > > remote=S144.3346.32 ended > > in getNext > > in getNext > > 14 May 2017 18:48:19,180 INFO ActionGet - T[483] engage seqNo=3502 > > remote=S144.3170.34 > > 14 May 2017 18:48:19,262 INFO ActionGet - T[284] engage seqNo=3503 > > remote=S144.3346.32 > > 14 May 2017 18:48:22,923 INFO ActionEnd - T[482] engage seqNo=3486 > > remote=S144.2443.36 ended > > in getNext > > 14 May 2017 18:48:22,977 INFO ActionGet - T[284] engage seqNo=3504 > > remote=S144.2443.36 > > 14 May 2017 18:48:32,013 INFO ActionEnd - T[284] engage seqNo=3492 > > remote=S144.3348.35 ended > > in getNext > > 14 May 2017 18:48:32,055 INFO ActionGet - T[483] engage seqNo=3505 > > remote=S144.3348.35 > > 14 May 2017 18:48:34,053 INFO ActionEnd - T[284] engage seqNo=3501 > > remote=S144.3170.33 ended > > in getNext > > 14 May 2017 18:48:34,145 INFO ActionGet - T[483] engage seqNo=3506 > > remote=S144.3170.33 > > 14 May 2017 18:48:36,116 INFO ActionEnd - T[483] engage seqNo=3485 > > remote=S144.2443.34 ended > > in getNext > > 14 May 2017 18:48:36,156 INFO ActionGet - T[482] engage seqNo=3507 > > remote=S144.2443.34 > > 14 May 2017 18:48:37,736 INFO ActionEnd - T[284] engage seqNo=3488 > > remote=S144.2443.35 ended > > in getNext > > 14 May 2017 18:48:37,770 INFO ActionEnd - T[483] engage seqNo=3484 > > remote=S144.3170.35 ended > > 14 May 2017 18:48:37,776 INFO ActionGet - T[283] engage seqNo=3508 > > remote=S144.2443.35 > > in getNext > > 14 May 2017 18:48:37,834 INFO ActionGet - T[482] engage seqNo=3509 > > remote=S144.3170.35 > > 14 May 2017 18:48:40,161 INFO ActionEnd - T[483] engage seqNo=3490 > > remote=S144.3346.33 ended > > in getNext > > 14 May 2017 18:48:40,256 INFO ActionGet - T[482] engage seqNo=3510 > > remote=S144.3346.33 > > 14 May 2017 18:48:44,891 INFO ActionEnd - T[284] engage seqNo=3493 > > remote=S144.3348.32 ended > > in getNext > > 14 May 2017 18:48:44,929 INFO ActionGet - T[483] engage seqNo=3511 > > remote=S144.3348.32 > > 14 May 2017 18:49:02,007 INFO ActionEnd - T[483] engage seqNo=3489 > > remote=S144.3346.34 ended > > in getNext > > 14 May 2017 18:49:02,086 INFO ActionGet - T[283] engage seqNo=3512 > > remote=S144.3346.34 > > 14 May 2017 18:49:03,407 INFO ActionEnd - T[283] engage seqNo=3502 > > remote=S144.3170.34 ended > > in getNext > > 14 May 2017 18:49:03,439 INFO ActionGet - T[482] engage seqNo=3513 > > remote=S144.3170.34 > > 14 May 2017 18:49:04,963 INFO ActionEnd - T[482] engage seqNo=3498 > > remote=S144.3170.36 ended > > in getNext > > 14 May 2017 18:49:05,010 INFO ActionGet - T[284] engage seqNo=3514 > > remote=S144.3170.36 > > 14 May 2017 18:49:06,442 INFO ActionEnd - T[284] engage seqNo=3495 > > remote=S144.3348.36 ended > > in getNext > > 14 May 2017 18:49:06,501 INFO ActionGet - T[483] engage seqNo=3515 > > remote=S144.3348.36 > > 14 May 2017 18:49:07,690 INFO ActionEnd - T[284] engage seqNo=3500 > > remote=S144.3170.32 ended > > in getNext > > 14 May 2017 18:49:07,730 INFO ActionGet - T[483] engage seqNo=3516 > > remote=S144.3170.32 > > 14 May 2017 18:49:08,734 INFO ActionEnd - T[284] engage seqNo=3497 > > remote=S144.2443.32 ended > > 14 May 2017 18:49:08,757 INFO ActionEnd - T[283] engage seqNo=3496 > > remote=S144.3348.34 ended > > in getNext > > in getNext > > 14 May 2017 18:49:08,792 INFO ActionGet - T[483] engage seqNo=3517 > > remote=S144.2443.32 > > 14 May 2017 18:49:08,874 INFO ActionGet - T[482] engage seqNo=3518 > > remote=S144.3348.34 > > 14 May 2017 18:49:10,904 INFO ActionEnd - T[284] engage seqNo=3510 > > remote=S144.3346.33 ended > > in getNext > > 14 May 2017 18:49:10,952 INFO ActionGet - T[283] engage seqNo=3519 > > remote=S144.3346.33 > > 14 May 2017 18:49:12,970 INFO ActionEnd - T[482] engage seqNo=3504 > > remote=S144.2443.36 ended > > in getNext > > 14 May 2017 18:49:13,022 INFO ActionGet - T[284] engage seqNo=3520 > > remote=S144.2443.36 > > > > > > Thanks and Regards > > Priyank Sharma > > > > > > On Tuesday 16 May 2017 04:41 PM, Lou DeGenaro wrote: > > > >> Hello, > >> > >> There are two parts: JP (one or more) and JD (one). You have shown the > >> log > >> from a JP, which is trying to contact the JD for more work. Can you > share > >> the JD log? > >> > >> Also, you can find me on HipChat https://apache.hipchat.com/cha > >> t/room/3665278 > >> in about an hour from now. > >> > >> Lou. > >> > >> On Tue, May 16, 2017 at 2:04 AM, priyank sharma < > >> [email protected]> > >> wrote: > >> > >> Hey > >>> > >>> I was running the Ducc job with the batch of around 4000 document. It > was > >>> able to ingest around 3000 document but after that it automatically > >>> stopped > >>> and gave the Reason or extraordinary status as canceled by user. Then > it > >>> started the new job with the same batch, and it has been going on in > the > >>> same manner. > >>> > >>> As checked in the logs the following error was found:- > >>> > >>> java.net.ConnectException: Connection refused > >>> at java.net.PlainSocketImpl.socketConnect(Native Method) > >>> at java.net.AbstractPlainSocketImpl. > doConnect(AbstractPlainSock > >>> etImpl.java:339) > >>> at java.net.AbstractPlainSocketImpl. > connectToAddress(AbstractPl > >>> ainSocketImpl.java:200) > >>> at java.net.AbstractPlainSocketImpl. > connect(AbstractPlainSocket > >>> Impl.java:182) > >>> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) > >>> at java.net.Socket.connect(Socket.java:579) > >>> at java.net.Socket.connect(Socket.java:528) > >>> at java.net.Socket.<init>(Socket.java:425) > >>> at java.net.Socket.<init>(Socket.java:280) > >>> at org.apache.commons.httpclient. > protocol.DefaultProtocolSocket > >>> Factory.createSocket(DefaultProtocolSocketFactory.java:80) > >>> at org.apache.commons.httpclient. > protocol.DefaultProtocolSocket > >>> Factory.createSocket(DefaultProtocolSocketFactory.java:122) > >>> at org.apache.commons.httpclient. > HttpConnection.open(HttpConnec > >>> tion.java:707) > >>> at org.apache.commons.httpclient. > MultiThreadedHttpConnectionMan > >>> ager$HttpConnectionAdapter.open(MultiThreadedHttpConnectionM > >>> anager.java:1361) > >>> at org.apache.commons.httpclient. > HttpMethodDirector.executeWith > >>> Retry(HttpMethodDirector.java:387) > >>> at org.apache.commons.httpclient. > HttpMethodDirector.executeMeth > >>> od(HttpMethodDirector.java:171) > >>> at org.apache.commons.httpclient. > HttpClient.executeMethod(HttpC > >>> lient.java:397) > >>> at org.apache.commons.httpclient. > HttpClient.executeMethod(HttpC > >>> lient.java:323) > >>> at org.apache.uima.ducc.transport.configuration.jp. > DuccHttpClie > >>> nt.execute(DuccHttpClient.java:217) > >>> at org.apache.uima.ducc.transport.configuration.jp. > HttpWorkerTh > >>> read.run(HttpWorkerThread.java:287) > >>> at java.util.concurrent.Executors$RunnableAdapter.call( > >>> Executors.java:471) > >>> at java.util.concurrent.FutureTask.run(FutureTask.java:262) > >>> at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPool > >>> Executor.java:1145) > >>> at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoo > >>> lExecutor.java:615) > >>> at org.apache.uima.ducc.transport.configuration.jp. > UimaServiceT > >>> hreadFactory$1.run(UimaServiceThreadFactory.java:85) > >>> at java.lang.Thread.run(Thread.java:745) > >>> 15 May 2017 16:18:23,760 ERROR DuccHttpClient - T[36] run > >>> java.net.ConnectException: Connection refused > >>> at java.net.PlainSocketImpl.socketConnect(Native Method) > >>> at java.net.AbstractPlainSocketImpl. > doConnect(AbstractPlainSock > >>> etImpl.java:339) > >>> at java.net.AbstractPlainSocketImpl. > connectToAddress(AbstractPl > >>> ainSocketImpl.java:200) > >>> at java.net.AbstractPlainSocketImpl. > connect(AbstractPlainSocket > >>> Impl.java:182) > >>> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) > >>> at java.net.Socket.connect(Socket.java:579) > >>> at java.net.Socket.connect(Socket.java:528) > >>> at java.net.Socket.<init>(Socket.java:425) > >>> at java.net.Socket.<init>(Socket.java:280) > >>> at org.apache.commons.httpclient. > protocol.DefaultProtocolSocket > >>> Factory.createSocket(DefaultProtocolSocketFactory.java:80) > >>> at org.apache.commons.httpclient. > protocol.DefaultProtocolSocket > >>> Factory.createSocket(DefaultProtocolSocketFactory.java:122) > >>> at org.apache.commons.httpclient. > HttpConnection.open(HttpConnec > >>> tion.java:707) > >>> at org.apache.commons.httpclient. > MultiThreadedHttpConnectionMan > >>> ager$HttpConnectionAdapter.open(MultiThreadedHttpConnectionM > >>> anager.java:1361) > >>> at org.apache.commons.httpclient. > HttpMethodDirector.executeWith > >>> Retry(HttpMethodDirector.java:387) > >>> at org.apache.commons.httpclient. > HttpMethodDirector.executeMeth > >>> od(HttpMethodDirector.java:171) > >>> at org.apache.commons.httpclient. > HttpClient.executeMethod(HttpC > >>> lient.java:397) > >>> at org.apache.commons.httpclient. > HttpClient.executeMethod(HttpC > >>> lient.java:323) > >>> at org.apache.uima.ducc.transport.configuration.jp. > DuccHttpClie > >>> nt.execute(DuccHttpClient.java:217) > >>> at org.apache.uima.ducc.transport.configuration.jp. > HttpWorkerTh > >>> read.run(HttpWorkerThread.java:287) > >>> at java.util.concurrent.Executors$RunnableAdapter.call( > >>> Executors.java:471) > >>> at java.util.concurrent.FutureTask.run(FutureTask.java:262) > >>> at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPool > >>> Executor.java:1145) > >>> at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoo > >>> lExecutor.java:615) > >>> at org.apache.uima.ducc.transport.configuration.jp. > UimaServiceT > >>> hreadFactory$1.run(UimaServiceThreadFactory.java:85) > >>> at java.lang.Thread.run(Thread.java:745) > >>> 15 May 2017 16:18:23,760 ERROR HttpWorkerThread - T[36] run > >>> java.net.ConnectException: Connection refused > >>> at java.net.PlainSocketImpl.socketConnect(Native Method) > >>> at java.net.AbstractPlainSocketImpl. > doConnect(AbstractPlainSock > >>> etImpl.java:339) > >>> at java.net.AbstractPlainSocketImpl. > connectToAddress(AbstractPl > >>> ainSocketImpl.java:200) > >>> at java.net.AbstractPlainSocketImpl. > connect(AbstractPlainSocket > >>> Impl.java:182) > >>> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) > >>> at java.net.Socket.connect(Socket.java:579) > >>> at java.net.Socket.connect(Socket.java:528) > >>> at java.net.Socket.<init>(Socket.java:425) > >>> at java.net.Socket.<init>(Socket.java:280) > >>> at org.apache.commons.httpclient. > protocol.DefaultProtocolSocket > >>> Factory.createSocket(DefaultProtocolSocketFactory.java:80) > >>> at org.apache.commons.httpclient. > protocol.DefaultProtocolSocket > >>> Factory.createSocket(DefaultProtocolSocketFactory.java:122) > >>> at org.apache.commons.httpclient. > HttpConnection.open(HttpConnec > >>> tion.java:707) > >>> at org.apache.commons.httpclient. > MultiThreadedHttpConnectionMan > >>> ager$HttpConnectionAdapter.open(MultiThreadedHttpConnectionM > >>> anager.java:1361) > >>> at org.apache.commons.httpclient. > HttpMethodDirector.executeWith > >>> Retry(HttpMethodDirector.java:387) > >>> at org.apache.commons.httpclient. > HttpMethodDirector.executeMeth > >>> od(HttpMethodDirector.java:171) > >>> at org.apache.commons.httpclient. > HttpClient.executeMethod(HttpC > >>> lient.java:397) > >>> at org.apache.commons.httpclient. > HttpClient.executeMethod(HttpC > >>> lient.java:323) > >>> at org.apache.uima.ducc.transport.configuration.jp. > DuccHttpClie > >>> nt.execute(DuccHttpClient.java:217) > >>> at org.apache.uima.ducc.transport.configuration.jp. > HttpWorkerTh > >>> read.run(HttpWorkerThread.java:287) > >>> at java.util.concurrent.Executors$RunnableAdapter.call( > >>> Executors.java:471) > >>> at java.util.concurrent.FutureTask.run(FutureTask.java:262) > >>> at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPool > >>> Executor.java:1145) > >>> at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoo > >>> lExecutor.java:615) > >>> at org.apache.uima.ducc.transport.configuration.jp. > UimaServiceT > >>> hreadFactory$1.run(UimaServiceThreadFactory.java:85) > >>> at java.lang.Thread.run(Thread.java:745) > >>> java.net.ConnectException: Connection refused > >>> at java.net.PlainSocketImpl.socketConnect(Native Method) > >>> at java.net.AbstractPlainSocketImpl. > doConnect(AbstractPlainSock > >>> etImpl.java:339) > >>> at java.net.AbstractPlainSocketImpl. > connectToAddress(AbstractPl > >>> ainSocketImpl.java:200) > >>> at java.net.AbstractPlainSocketImpl. > connect(AbstractPlainSocket > >>> Impl.java:182) > >>> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) > >>> at java.net.Socket.connect(Socket.java:579) > >>> at java.net.Socket.connect(Socket.java:528) > >>> at java.net.Socket.<init>(Socket.java:425) > >>> at java.net.Socket.<init>(Socket.java:280) > >>> at org.apache.commons.httpclient. > protocol.DefaultProtocolSocket > >>> Factory.createSocket(DefaultProtocolSocketFactory.java:80) > >>> at org.apache.commons.httpclient. > protocol.DefaultProtocolSocket > >>> Factory.createSocket(DefaultProtocolSocketFactory.java:122) > >>> at org.apache.commons.httpclient. > HttpConnection.open(HttpConnec > >>> tion.java:707) > >>> at org.apache.commons.httpclient. > MultiThreadedHttpConnectionMan > >>> ager$HttpConnectionAdapter.open(MultiThreadedHttpConnectionM > >>> anager.java:1361) > >>> at org.apache.commons.httpclient. > HttpMethodDirector.executeWith > >>> Retry(HttpMethodDirector.java:387) > >>> at org.apache.commons.httpclient. > HttpMethodDirector.executeMeth > >>> od(HttpMethodDirector.java:171) > >>> at org.apache.commons.httpclient. > HttpClient.executeMethod(HttpC > >>> lient.java:397) > >>> at org.apache.commons.httpclient. > HttpClient.executeMethod(HttpC > >>> lient.java:323) > >>> at org.apache.uima.ducc.transport.configuration.jp. > DuccHttpClie > >>> nt.execute(DuccHttpClient.java:217) > >>> at org.apache.uima.ducc.transport.configuration.jp. > HttpWorkerTh > >>> read.run(HttpWorkerThread.java:287) > >>> at java.util.concurrent.Executors$RunnableAdapter.call( > >>> Executors.java:471) > >>> at java.util.concurrent.FutureTask.run(FutureTask.java:262) > >>> at java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPool > >>> Executor.java:1145) > >>> at java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoo > >>> lExecutor.java:615) > >>> at org.apache.uima.ducc.transport.configuration.jp. > UimaServiceT > >>> hreadFactory$1.run(UimaServiceThreadFactory.java:85) > >>> at java.lang.Thread.run(Thread.java:745) > >>> Exiting Process Due to a Framework error > >>> 15 May 2017 16:18:23,761 ERROR HttpWorkerThread - T[36] run The Job > >>> Process Terminating Due To a Framework Error > >>> > >>> Please reply as soon as possible. > >>> Thanks in advance. > >>> > >>> Priyank Sharma > >>> > >>> > >>> > > >
