Hi everyone, This is on an old dinosaur: ARS 7.6.4 SP5 (100% custom apps) Windows 2012 MSSQL 2012 Mid Tier 8.1.SP02 Patch 002 201611240104 Hotfix
This is a production issue that is going from bad to worse. It was an intermittent problem that is now a continuous issue. We have an API call that has 3 methods. This particular API is being used by multiple other applications within the company but Remedy is the only one having issues with it (of course :( ) The first 2 methods within the API are working fine, but the third method is timing out giving the error message below. The 3rd method sometimes works fine other times will just timeout. And It will do so with the same data. So it is not a data issue. Now on the application exposing the Web Service all is working fine. I can retrieve the data without any issue using SoapUI on my server within an average of 40ms. This 3rd method retrieves multiple records that we save on a table and that should create on average about 13 rows into that table. That table is purged nightly. Once that is completed the system automatically display the data to the users. The current error message being returned to the users is the ARERR 92: Timeout during database update - The operation has been accepted by the server and will usually complete successfully : servername: ONC/RPC call timed out But the data doesn't show up in the database at all and if I look in the logs this is what I have: 2019-08-10 09:35:18,974 ERROR [pool-2-thread-1] com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) - <ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required Security header 2019-08-10 09:35:28,880 ERROR [pool-2-thread-3] com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) - <ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required Security header 2019-08-10 09:35:29,005 ERROR [pool-2-thread-5] com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) - <ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required Security header 2019-08-10 09:36:42,788 ERROR [pool-2-thread-2] com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) - <ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required Security header 2019-08-10 09:36:42,913 ERROR [pool-2-thread-4] com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) - <ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required Security header 2019-08-10 09:39:14,386 ERROR [pool-2-thread-1] com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) - <ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: cannot convert into document; nested exception is: java.net.SocketTimeoutException: Read timed out 2019-08-10 09:39:14,386 ERROR [pool-2-thread-1] com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) - <ARSYS.ARF.WEBSERVICE>WS timeout setting = 150 sec 2019-08-10 09:39:14,386 ERROR [pool-2-thread-1] com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) - <ARSYS.ARF.WEBSERVICE>AxisFault during = 151441 millisec 2019-08-10 09:39:14,386 ERROR [pool-2-thread-1] com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) - <ARSYS.ARF.WEBSERVICE>soapService = VehicleInformationPacketService_V2_vs0 2019-08-10 09:39:14,386 ERROR [pool-2-thread-1] com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) - <ARSYS.ARF.WEBSERVICE>soapMethod = getMajorComponentDataForRemedy 2019-08-10 09:39:14,386 ERROR [pool-2-thread-1] com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) - <ARSYS.ARF.WEBSERVICE>soapURL = ************************************************************ 2019-08-10 09:39:14,386 ERROR [pool-2-thread-1] com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) - <ARSYS.ARF.WEBSERVICE>soapNamespace = **************************************/ 2019-08-10 09:39:14,386 ERROR [pool-2-thread-1] com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) - <ARSYS.ARF.WEBSERVICE>soapInputDocument = <?xml version="1.0" encoding="windows-1252"?> <ns0:ROOT xmlns:ns0="**********************************/" xmlns:ns1="http://docs.oasis-open.org/wss/2004/01/oasis-200401-wss-wssecurity-secext-1.0.xsd" xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"> <ns0:SOAPHeader> <ns1:Security> <ns1:UsernameToken> <ns1:Username>***************</ns1:Username> <ns1:Password>****</ns1:Password> </ns1:UsernameToken> </ns1:Security> </ns0:SOAPHeader> <p_request> <userName/> <password/> <languageCode/> <sequenceNumber/> <retreiveModelDescriptionIndc/> <mcpTypeCode/> <serialNumber/> <VIN>3AKJGLD57ESFP9937</VIN> </p_request> </ns0:ROOT> 2019-08-10 09:39:14,386 ERROR [pool-2-thread-1] com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) - <ARSYS.ARF.WEBSERVICE>soapOperationDoc = <?xml version="1.0" encoding="UTF-8"?> <operation bindingStyle="document" name="getMajorComponentDataForRemedy" type="create" useStyle="literal"> <arOptions> <setOptions> <type>setFirst</type> <documentType>full</documentType> </setOptions> </arOptions> <inputMapping name="getMajorComponentDataForRemedy" namespace="http://*********************/" topLevelElement="getMajorComponentDataForRemedy"/> <outputMapping name="getMajorComponentDataForRemedyResponse" namespace="http://*****************************/" topLevelElement="getMajorComponentDataForRemedyResponse"/> </operation> 2019-08-10 09:39:14,386 ERROR [pool-2-thread-1] com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) - <ARSYS.ARF.WEBSERVICE>soapAction = 2019-08-10 09:39:14,386 ERROR [pool-2-thread-1] com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) - <ARSYS.ARF.WEBSERVICE>soapMethod = getMajorComponentDataForRemedy 2019-08-10 09:39:14,386 ERROR [pool-2-thread-1] com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) - <ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: cannot convert into document; nested exception is: java.net.SocketTimeoutException: Read timed out 2019-08-10 09:39:14,386 ERROR [pool-2-thread-1] com.bmc.arsys.pluginsvr.plugins.ARFilterAPIPluginRepository (?:?) - ARFilterApiCall FAILs in plugin: ARSYS.ARF.WEBSERVICE ERROR (9130): Error encountered while executing a Web Service; WSDoAllReceiver: cannot convert into document; nested exception is: java.net.SocketTimeoutException: Read timed out at com.bmc.arsys.ws.plugin.WSPlugin.ThrowException(WSPlugin.java:158) at com.bmc.arsys.ws.plugin.WSPlugin.filterAPICall(WSPlugin.java:151) at com.bmc.arsys.pluginsvr.plugins.ARFilterAPIPluginRepository.ARFilterApiCall(Unknown Source) at com.bmc.arsys.pluginsvr.a.ArEsFilterApi_5(Unknown Source) at com.bmc.arsys.pluginsvr.a.ArEsFilterApi_4(Unknown Source) at com.bmc.arsys.arrpc.ARPluginServerDispatcher.dispatchOncRpcCall(Unknown Source) at com.bmc.arsys.arrpc.nio.ArRpcCallHandler.dispatchCall(Unknown Source) at com.bmc.arsys.arrpc.nio.ArRpcCallHandler.if(Unknown Source) at com.bmc.arsys.arrpc.nio.ArRpcCallHandler.processRpcCall(Unknown Source) at com.bmc.arsys.arrpc.nio.ArRpcCallHandler$Processor.run(Unknown Source) at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.lang.Thread.run(Unknown Source) 2019-08-10 09:39:16,839 ERROR [pool-2-thread-3] com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) - <ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required Security header 2019-08-10 09:39:16,933 ERROR [pool-2-thread-5] com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) - <ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required Security header 2019-08-10 09:39:17,074 ERROR [pool-2-thread-2] com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) - <ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required Security header 2019-08-10 09:39:49,028 ERROR [pool-2-thread-4] com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) - <ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required Security header 2019-08-10 09:39:49,122 ERROR [pool-2-thread-3] com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) - <ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required Security header 2019-08-10 09:39:49,293 ERROR [pool-2-thread-5] com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) - <ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required Security header 2019-08-10 09:39:56,216 ERROR [pool-2-thread-2] com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) - <ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required Security header 2019-08-10 09:39:56,278 ERROR [pool-2-thread-1] com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) - <ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required Security header The DBA doesn't see any issue with the Database, no issue with the network, no issue with the web service. And we haven't made any changes with the code in years. This is happening on both the windows client and web client Any ideas and help would be greatly appreciated Thank you, Pascale Sterrett If you are not the addressee, please inform us immediately that you have received this e-mail by mistake, and delete it. We thank you for your support.
-- ARSList mailing list ARSList@arslist.org https://mailman.rrr.se/cgi/listinfo/arslist