Pascale,
The only way to troubleshoot this is with API/SQL/Filter logs, then them
on, wait the two mins it takes to generate the error, wait another few
mins, then review the loss, see what ther thread that was used to call the
external service is doing that's causing the timeout.
On August 10, 2019 1:44:47 PM [email protected] wrote:
Hi everyone,
This is on an old dinosaur:
ARS 7.6.4 SP5 (100% custom apps)
Windows 2012
MSSQL 2012
Mid Tier 8.1.SP02 Patch 002 201611240104 Hotfix
This is a production issue that is going from bad to worse. It was an
intermittent problem that is now a continuous issue.
We have an API call that has 3 methods. This particular API is being used
by multiple other applications within the company but Remedy is the only
one having issues with it (of course L )
The first 2 methods within the API are working fine, but the third method
is timing out giving the error message below.
The 3rd method sometimes works fine other times will just timeout. And It
will do so with the same data. So it is not a data issue.
Now on the application exposing the Web Service all is working fine. I can
retrieve the data without any issue using SoapUI on my server within an
average of 40ms.
This 3rd method retrieves multiple records that we save on a table and that
should create on average about 13 rows into that table. That table is
purged nightly.
Once that is completed the system automatically display the data to the users.
The current error message being returned to the users is the ARERR 92:
Timeout during database update – The operation has been accepted by the
server and will usually complete successfully : servername: ONC/RPC call
timed out
But the data doesn’t show up in the database at all and if I look in the
logs this is what I have:
2019-08-10 09:35:18,974 ERROR [pool-2-thread-1]
com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) -
<ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required
Security header
2019-08-10 09:35:28,880 ERROR [pool-2-thread-3]
com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) -
<ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required
Security header
2019-08-10 09:35:29,005 ERROR [pool-2-thread-5]
com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) -
<ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required
Security header
2019-08-10 09:36:42,788 ERROR [pool-2-thread-2]
com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) -
<ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required
Security header
2019-08-10 09:36:42,913 ERROR [pool-2-thread-4]
com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) -
<ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required
Security header
2019-08-10 09:39:14,386 ERROR [pool-2-thread-1]
com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) -
<ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: cannot convert into document; nested
exception is:
java.net.SocketTimeoutException: Read timed out
2019-08-10 09:39:14,386 ERROR [pool-2-thread-1]
com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) -
<ARSYS.ARF.WEBSERVICE>WS timeout setting = 150 sec
2019-08-10 09:39:14,386 ERROR [pool-2-thread-1]
com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) -
<ARSYS.ARF.WEBSERVICE>AxisFault during = 151441 millisec
2019-08-10 09:39:14,386 ERROR [pool-2-thread-1]
com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) -
<ARSYS.ARF.WEBSERVICE>soapService = VehicleInformationPacketService_V2_vs0
2019-08-10 09:39:14,386 ERROR [pool-2-thread-1]
com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) -
<ARSYS.ARF.WEBSERVICE>soapMethod = getMajorComponentDataForRemedy
2019-08-10 09:39:14,386 ERROR [pool-2-thread-1]
com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) -
<ARSYS.ARF.WEBSERVICE>soapURL =
************************************************************
2019-08-10 09:39:14,386 ERROR [pool-2-thread-1]
com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) -
<ARSYS.ARF.WEBSERVICE>soapNamespace = **************************************/
2019-08-10 09:39:14,386 ERROR [pool-2-thread-1]
com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) -
<ARSYS.ARF.WEBSERVICE>soapInputDocument = <?xml version="1.0"
encoding="windows-1252"?>
<ns0:ROOT xmlns:ns0="**********************************/"
xmlns:ns1="http://docs.oasis-open.org/wss/2004/01/oasis-200401-wss-wssecurity-secext-1.0.xsd";
xmlns:xsd="http://www.w3.org/2001/XMLSchema";
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance";>
<ns0:SOAPHeader>
<ns1:Security>
<ns1:UsernameToken>
<ns1:Username>***************</ns1:Username>
<ns1:Password>****</ns1:Password>
</ns1:UsernameToken>
</ns1:Security>
</ns0:SOAPHeader>
<p_request>
<userName/>
<password/>
<languageCode/>
<sequenceNumber/>
<retreiveModelDescriptionIndc/>
<mcpTypeCode/>
<serialNumber/>
<VIN>3AKJGLD57ESFP9937</VIN>
</p_request>
</ns0:ROOT>
2019-08-10 09:39:14,386 ERROR [pool-2-thread-1]
com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) -
<ARSYS.ARF.WEBSERVICE>soapOperationDoc = <?xml version="1.0" encoding="UTF-8"?>
<operation bindingStyle="document" name="getMajorComponentDataForRemedy"
type="create" useStyle="literal">
<arOptions>
<setOptions>
<type>setFirst</type>
<documentType>full</documentType>
</setOptions>
</arOptions>
<inputMapping name="getMajorComponentDataForRemedy"
namespace="http://*********************/";
topLevelElement="getMajorComponentDataForRemedy"/>
<outputMapping name="getMajorComponentDataForRemedyResponse"
namespace="http://*****************************/";
topLevelElement="getMajorComponentDataForRemedyResponse"/>
</operation>
2019-08-10 09:39:14,386 ERROR [pool-2-thread-1]
com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) -
<ARSYS.ARF.WEBSERVICE>soapAction =
2019-08-10 09:39:14,386 ERROR [pool-2-thread-1]
com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) -
<ARSYS.ARF.WEBSERVICE>soapMethod = getMajorComponentDataForRemedy
2019-08-10 09:39:14,386 ERROR [pool-2-thread-1]
com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) -
<ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: cannot convert into document; nested
exception is:
java.net.SocketTimeoutException: Read timed out
2019-08-10 09:39:14,386 ERROR [pool-2-thread-1]
com.bmc.arsys.pluginsvr.plugins.ARFilterAPIPluginRepository (?:?) -
ARFilterApiCall FAILs in plugin: ARSYS.ARF.WEBSERVICE
ERROR (9130): Error encountered while executing a Web Service;
WSDoAllReceiver: cannot convert into document; nested exception is:
java.net.SocketTimeoutException: Read timed out
at
com.bmc.arsys.ws.plugin.WSPlugin.ThrowException(WSPlugin.java:158)
at
com.bmc.arsys.ws.plugin.WSPlugin.filterAPICall(WSPlugin.java:151)
at
com.bmc.arsys.pluginsvr.plugins.ARFilterAPIPluginRepository.ARFilterApiCall(Unknown
Source)
at com.bmc.arsys.pluginsvr.a.ArEsFilterApi_5(Unknown Source)
at com.bmc.arsys.pluginsvr.a.ArEsFilterApi_4(Unknown Source)
at com.bmc.arsys.arrpc.ARPluginServerDispatcher.dispatchOncRpcCall(Unknown
Source)
at com.bmc.arsys.arrpc.nio.ArRpcCallHandler.dispatchCall(Unknown
Source)
at com.bmc.arsys.arrpc.nio.ArRpcCallHandler.if(Unknown Source)
at com.bmc.arsys.arrpc.nio.ArRpcCallHandler.processRpcCall(Unknown
Source)
at com.bmc.arsys.arrpc.nio.ArRpcCallHandler$Processor.run(Unknown
Source)
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown
Source)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown
Source)
at java.lang.Thread.run(Unknown Source)
2019-08-10 09:39:16,839 ERROR [pool-2-thread-3]
com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) -
<ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required
Security header
2019-08-10 09:39:16,933 ERROR [pool-2-thread-5]
com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) -
<ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required
Security header
2019-08-10 09:39:17,074 ERROR [pool-2-thread-2]
com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) -
<ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required
Security header
2019-08-10 09:39:49,028 ERROR [pool-2-thread-4]
com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) -
<ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required
Security header
2019-08-10 09:39:49,122 ERROR [pool-2-thread-3]
com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) -
<ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required
Security header
2019-08-10 09:39:49,293 ERROR [pool-2-thread-5]
com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) -
<ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required
Security header
2019-08-10 09:39:56,216 ERROR [pool-2-thread-2]
com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) -
<ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required
Security header
2019-08-10 09:39:56,278 ERROR [pool-2-thread-1]
com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) -
<ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required
Security header
The DBA doesn’t see any issue with the Database, no issue with the network,
no issue with the web service. And we haven’t made any changes with the
code in years. This is happening on both the windows client and web client
Any ideas and help would be greatly appreciated
Thank you,
Pascale Sterrett
If you are not the addressee, please inform us immediately that you have
received this e-mail by mistake, and delete it. We thank you for your support.
--
ARSList mailing list
[email protected]
https://mailman.rrr.se/cgi/listinfo/arslist
--
ARSList mailing list
[email protected]
https://mailman.rrr.se/cgi/listinfo/arslist
