Please share the ar.cfg / ar.conf as well as pluginsvr_config.xml file . We may need to tweak some config to see if there is improvement in performance.
On Sun, Aug 11, 2019 at 6:16 AM LJ LongWing <[email protected]> wrote: > You won't see an error in the logs, the error isn't a server error, it is > a client timeout error, what you are looking for in the logs is what is > causing the xmlce or xmlse api call to not finish in less than 120 seconds > > On August 10, 2019 6:15:33 PM [email protected] wrote: > >> Hi LJ, >> >> Thank you for the reply J >> >> That is the problem I am having. The API/SQL/Filter log is not capturing >> any error. I even added the AL log. And that is where I see that the AL is >> failing from the Push field that triggers the web service on Create. But I >> do not see any error on the filter or database. >> >> I do have the Plugin error I sent and that is the extend of it, beside >> the error thrown to the user. >> >> >> >> I am completely baffled by this one. It is intermittent. When it does >> happen, the application freeze completely nothing works, the user need to >> logout and relaunch a new session. >> >> >> >> But, I will review the logs once more. >> >> >> >> Thank you, >> >> >> >> Pascale Sterrett >> >> BSA – Remedy App Owner >> >> Atos | Syntel, external service provider of Daimler Truck North America >> LLC (DTNA) >> IT SCS - Sales Customer Support >> Montgomery Park, 9th floor >> Portland, OR 97210 U.S.A >> >> Phone:503-745-6569 >> >> >> Email:[email protected] >> >> >> >> Up coming Vacations: >> >> Up coming Holiday: >> >> DTNA Shutdown: >> >> Kenavo ar wech all >> >> >> >> *From:* ARSList <[email protected]> *On Behalf Of *LJ LongWing >> *Sent:* Saturday, August 10, 2019 3:29 PM >> *To:* ARSList <[email protected]> >> *Subject:* Re: Web service timing out - need help >> >> >> >> Pascale, >> >> The only way to troubleshoot this is with API/SQL/Filter logs, then them >> on, wait the two mins it takes to generate the error, wait another few >> mins, then review the loss, see what ther thread that was used to call the >> external service is doing that's causing the timeout. >> >> >> >> On August 10, 2019 1:44:47 PM [email protected] wrote: >> >> Hi everyone, >> >> >> >> This is on an old dinosaur: >> >> ARS 7.6.4 SP5 (100% custom apps) >> >> Windows 2012 >> >> MSSQL 2012 >> >> Mid Tier 8.1.SP02 Patch 002 201611240104 Hotfix >> >> >> >> >> >> This is a production issue that is going from bad to worse. It was an >> intermittent problem that is now a continuous issue. >> >> We have an API call that has 3 methods. This particular API is being used >> by multiple other applications within the company but Remedy is the only >> one having issues with it (of course L ) >> >> >> >> The first 2 methods within the API are working fine, but the third method >> is timing out giving the error message below. >> >> The 3rd method sometimes works fine other times will just timeout. And >> It will do so with the same data. So it is not a data issue. >> >> >> >> Now on the application exposing the Web Service all is working fine. I >> can retrieve the data without any issue using SoapUI on my server within an >> average of 40ms. >> >> This 3rd method retrieves multiple records that we save on a table and >> that should create on average about 13 rows into that table. That table is >> purged nightly. >> >> Once that is completed the system automatically display the data to the >> users. >> >> The current error message being returned to the users is the ARERR 92: >> Timeout during database update – The operation has been accepted by the >> server and will usually complete successfully : servername: ONC/RPC call >> timed out >> >> >> >> But the data doesn’t show up in the database at all and if I look in the >> logs this is what I have: >> >> >> >> 2019-08-10 09:35:18,974 ERROR [pool-2-thread-1] >> com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) - >> <ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required >> Security header >> >> 2019-08-10 09:35:28,880 ERROR [pool-2-thread-3] >> com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) - >> <ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required >> Security header >> >> 2019-08-10 09:35:29,005 ERROR [pool-2-thread-5] >> com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) - >> <ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required >> Security header >> >> 2019-08-10 09:36:42,788 ERROR [pool-2-thread-2] >> com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) - >> <ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required >> Security header >> >> 2019-08-10 09:36:42,913 ERROR [pool-2-thread-4] >> com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) - >> <ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required >> Security header >> >> 2019-08-10 09:39:14,386 ERROR [pool-2-thread-1] >> com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) - >> <ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: cannot convert into document; nested >> exception is: >> >> java.net.SocketTimeoutException: Read timed out >> >> 2019-08-10 09:39:14,386 ERROR [pool-2-thread-1] >> com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) - >> <ARSYS.ARF.WEBSERVICE>WS timeout setting = 150 sec >> >> 2019-08-10 09:39:14,386 ERROR [pool-2-thread-1] >> com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) - >> <ARSYS.ARF.WEBSERVICE>AxisFault during = 151441 millisec >> >> 2019-08-10 09:39:14,386 ERROR [pool-2-thread-1] >> com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) - >> <ARSYS.ARF.WEBSERVICE>soapService = VehicleInformationPacketService_V2_vs0 >> >> 2019-08-10 09:39:14,386 ERROR [pool-2-thread-1] >> com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) - >> <ARSYS.ARF.WEBSERVICE>soapMethod = getMajorComponentDataForRemedy >> >> 2019-08-10 09:39:14,386 ERROR [pool-2-thread-1] >> com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) - >> <ARSYS.ARF.WEBSERVICE>soapURL = >> ************************************************************ >> >> 2019-08-10 09:39:14,386 ERROR [pool-2-thread-1] >> com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) - >> <ARSYS.ARF.WEBSERVICE>soapNamespace = >> **************************************/ >> >> 2019-08-10 09:39:14,386 ERROR [pool-2-thread-1] >> com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) - >> <ARSYS.ARF.WEBSERVICE>soapInputDocument = <?xml version="1.0" >> encoding="windows-1252"?> >> >> <ns0:ROOT xmlns:ns0="**********************************/" xmlns:ns1=" >> http://docs.oasis-open.org/wss/2004/01/oasis-200401-wss-wssecurity-secext-1.0.xsd"; >> xmlns:xsd="http://www.w3.org/2001/XMLSchema"; xmlns:xsi=" >> http://www.w3.org/2001/XMLSchema-instance";> >> >> <ns0:SOAPHeader> >> >> <ns1:Security> >> >> <ns1:UsernameToken> >> >> >> <ns1:Username>***************</ns1:Username> >> >> >> <ns1:Password>****</ns1:Password> >> >> </ns1:UsernameToken> >> >> </ns1:Security> >> >> </ns0:SOAPHeader> >> >> <p_request> >> >> <userName/> >> >> <password/> >> >> <languageCode/> >> >> <sequenceNumber/> >> >> <retreiveModelDescriptionIndc/> >> >> <mcpTypeCode/> >> >> <serialNumber/> >> >> <VIN>3AKJGLD57ESFP9937</VIN> >> >> </p_request> >> >> </ns0:ROOT> >> >> >> >> 2019-08-10 09:39:14,386 ERROR [pool-2-thread-1] >> com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) - >> <ARSYS.ARF.WEBSERVICE>soapOperationDoc = <?xml version="1.0" >> encoding="UTF-8"?> >> >> <operation bindingStyle="document" name="getMajorComponentDataForRemedy" >> >> type="create" useStyle="literal"> >> >> <arOptions> >> >> <setOptions> >> >> <type>setFirst</type> >> >> <documentType>full</documentType> >> >> </setOptions> >> >> </arOptions> >> >> <inputMapping name="getMajorComponentDataForRemedy" >> >> namespace="http://*********************/"; >> topLevelElement="getMajorComponentDataForRemedy"/> >> >> <outputMapping name="getMajorComponentDataForRemedyResponse" >> >> namespace="http://*****************************/"; >> topLevelElement="getMajorComponentDataForRemedyResponse"/> >> >> </operation> >> >> >> >> 2019-08-10 09:39:14,386 ERROR [pool-2-thread-1] >> com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) - >> <ARSYS.ARF.WEBSERVICE>soapAction = >> >> 2019-08-10 09:39:14,386 ERROR [pool-2-thread-1] >> com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) - >> <ARSYS.ARF.WEBSERVICE>soapMethod = getMajorComponentDataForRemedy >> >> 2019-08-10 09:39:14,386 ERROR [pool-2-thread-1] >> com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) - >> <ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: cannot convert into document; nested >> exception is: >> >> java.net.SocketTimeoutException: Read timed out >> >> 2019-08-10 09:39:14,386 ERROR [pool-2-thread-1] >> com.bmc.arsys.pluginsvr.plugins.ARFilterAPIPluginRepository (?:?) - >> ARFilterApiCall FAILs in plugin: ARSYS.ARF.WEBSERVICE >> >> ERROR (9130): Error encountered while executing a Web Service; >> WSDoAllReceiver: cannot convert into document; nested exception is: >> >> java.net.SocketTimeoutException: Read timed out >> >> at >> com.bmc.arsys.ws.plugin.WSPlugin.ThrowException(WSPlugin.java:158) >> >> at >> com.bmc.arsys.ws.plugin.WSPlugin.filterAPICall(WSPlugin.java:151) >> >> at >> com.bmc.arsys.pluginsvr.plugins.ARFilterAPIPluginRepository.ARFilterApiCall(Unknown >> Source) >> >> at com.bmc.arsys.pluginsvr.a.ArEsFilterApi_5(Unknown Source) >> >> at com.bmc.arsys.pluginsvr.a.ArEsFilterApi_4(Unknown Source) >> >> at >> com.bmc.arsys.arrpc.ARPluginServerDispatcher.dispatchOncRpcCall(Unknown >> Source) >> >> at >> com.bmc.arsys.arrpc.nio.ArRpcCallHandler.dispatchCall(Unknown Source) >> >> at com.bmc.arsys.arrpc.nio.ArRpcCallHandler.if(Unknown >> Source) >> >> at >> com.bmc.arsys.arrpc.nio.ArRpcCallHandler.processRpcCall(Unknown Source) >> >> at >> com.bmc.arsys.arrpc.nio.ArRpcCallHandler$Processor.run(Unknown Source) >> >> at >> java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) >> >> at >> java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) >> >> at java.lang.Thread.run(Unknown Source) >> >> 2019-08-10 09:39:16,839 ERROR [pool-2-thread-3] >> com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) - >> <ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required >> Security header >> >> 2019-08-10 09:39:16,933 ERROR [pool-2-thread-5] >> com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) - >> <ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required >> Security header >> >> 2019-08-10 09:39:17,074 ERROR [pool-2-thread-2] >> com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) - >> <ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required >> Security header >> >> 2019-08-10 09:39:49,028 ERROR [pool-2-thread-4] >> com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) - >> <ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required >> Security header >> >> 2019-08-10 09:39:49,122 ERROR [pool-2-thread-3] >> com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) - >> <ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required >> Security header >> >> 2019-08-10 09:39:49,293 ERROR [pool-2-thread-5] >> com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) - >> <ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required >> Security header >> >> 2019-08-10 09:39:56,216 ERROR [pool-2-thread-2] >> com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) - >> <ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required >> Security header >> >> 2019-08-10 09:39:56,278 ERROR [pool-2-thread-1] >> com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) - >> <ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required >> Security header >> >> >> >> >> >> >> >> The DBA doesn’t see any issue with the Database, no issue with the >> network, no issue with the web service. And we haven’t made any changes >> with the code in years. This is happening on both the windows client and >> web client >> >> Any ideas and help would be greatly appreciated >> >> >> >> >> >> >> >> >> >> Thank you, >> >> >> >> Pascale Sterrett >> >> >> >> >> If you are not the addressee, please inform us immediately that you have >> received this e-mail by mistake, and delete it. We thank you for your >> support. >> >> -- >> >> ARSList mailing list >> >> *[email protected]* <ARSList%40arslist.org> >> >> *https://mailman.rrr.se/cgi/listinfo/arslist* >> <https://mailman.rrr.se/cgi/listinfo/arslist> >> >> >> >> >> >> If you are not the addressee, please inform us immediately that you have >> received this e-mail by mistake, and delete it. We thank you for your >> support. >> >> -- >> ARSList mailing list >> [email protected] >> https://mailman.rrr.se/cgi/listinfo/arslist >> >> > -- > ARSList mailing list > [email protected] > https://mailman.rrr.se/cgi/listinfo/arslist > -- Best Regards, Anantha
-- ARSList mailing list [email protected] https://mailman.rrr.se/cgi/listinfo/arslist
