You won't see an error in the logs, the error isn't a server error, it is a
client timeout error, what you are looking for in the logs is what is
causing the xmlce or xmlse api call to not finish in less than 120 seconds
On August 10, 2019 6:15:33 PM pascale.sterr...@daimler.com wrote:
Hi LJ,
Thank you for the reply
J
That is the problem I am having. The API/SQL/Filter log is not capturing
any error. I even added the AL log. And that is where I see that the AL is
failing from the Push field that triggers the web service on Create. But I
do not see any error on the filter or database.
I do have the Plugin error I sent and that is the extend of it, beside the
error thrown to the user.
I am completely baffled by this one. It is intermittent. When it does
happen, the application freeze completely nothing works, the user need to
logout and relaunch a new session.
But, I will review the logs once more.
Thank you,
Pascale Sterrett
BSA – Remedy App Owner
Atos | Syntel, external service provider of Daimler Truck North America LLC
(DTNA)
IT SCS - Sales Customer Support
Montgomery Park, 9th floor
Portland, OR 97210 U.S.A
Phone:503-745-6569
Email:pascale.sterr...@daimler.com
Up coming Vacations:
Up coming Holiday:
DTNA Shutdown:
Kenavo ar wech all
From: ARSList <arslist-boun...@arslist.org>
On Behalf Of LJ LongWing
Sent: Saturday, August 10, 2019 3:29 PM
To: ARSList <arslist@arslist.org>
Subject: Re: Web service timing out - need help
Pascale,
The only way to troubleshoot this is with API/SQL/Filter logs, then them
on, wait the two mins it takes to generate the error, wait another few
mins, then review the loss, see what ther thread that was used to call the
external service is doing that's causing the timeout.
On August 10, 2019 1:44:47 PM
pascale.sterr...@daimler.com wrote:
Hi everyone,
This is on an old dinosaur:
ARS 7.6.4 SP5 (100% custom apps)
Windows 2012
MSSQL 2012
Mid Tier 8.1.SP02 Patch 002 201611240104 Hotfix
This is a production issue that is going from bad to worse. It was an
intermittent problem that is now a continuous issue.
We have an API call that has 3 methods. This particular API is being used
by multiple other applications within the company but Remedy is the only
one having issues with it (of course L )
The first 2 methods within the API are working fine, but the third method
is timing out giving the error message below.
The 3rd method sometimes works fine other times will just timeout. And It
will do so with the same data. So it is not a data issue.
Now on the application exposing the Web Service all is working fine. I can
retrieve the data without any issue using SoapUI on my server within an
average of 40ms.
This 3rd method retrieves multiple records that we save on a table and that
should create on average about 13 rows into that table. That table is
purged nightly.
Once that is completed the system automatically display the data to the users.
The current error message being returned to the users is the ARERR 92:
Timeout during database update – The operation has been accepted by the
server and will usually complete successfully : servername: ONC/RPC call
timed out
But the data doesn’t show up in the database at all and if I look in the
logs this is what I have:
2019-08-10 09:35:18,974 ERROR [pool-2-thread-1]
com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) -
<ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required
Security header
2019-08-10 09:35:28,880 ERROR [pool-2-thread-3]
com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) -
<ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required
Security header
2019-08-10 09:35:29,005 ERROR [pool-2-thread-5]
com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) -
<ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required
Security header
2019-08-10 09:36:42,788 ERROR [pool-2-thread-2]
com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) -
<ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required
Security header
2019-08-10 09:36:42,913 ERROR [pool-2-thread-4]
com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) -
<ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required
Security header
2019-08-10 09:39:14,386 ERROR [pool-2-thread-1]
com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) -
<ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: cannot convert into document; nested
exception is:
java.net.SocketTimeoutException: Read timed out
2019-08-10 09:39:14,386 ERROR [pool-2-thread-1]
com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) -
<ARSYS.ARF.WEBSERVICE>WS timeout setting = 150 sec
2019-08-10 09:39:14,386 ERROR [pool-2-thread-1]
com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) -
<ARSYS.ARF.WEBSERVICE>AxisFault during = 151441 millisec
2019-08-10 09:39:14,386 ERROR [pool-2-thread-1]
com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) -
<ARSYS.ARF.WEBSERVICE>soapService = VehicleInformationPacketService_V2_vs0
2019-08-10 09:39:14,386 ERROR [pool-2-thread-1]
com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) -
<ARSYS.ARF.WEBSERVICE>soapMethod = getMajorComponentDataForRemedy
2019-08-10 09:39:14,386 ERROR [pool-2-thread-1]
com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) -
<ARSYS.ARF.WEBSERVICE>soapURL =
************************************************************
2019-08-10 09:39:14,386 ERROR [pool-2-thread-1]
com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) -
<ARSYS.ARF.WEBSERVICE>soapNamespace = **************************************/
2019-08-10 09:39:14,386 ERROR [pool-2-thread-1]
com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) -
<ARSYS.ARF.WEBSERVICE>soapInputDocument = <?xml version="1.0"
encoding="windows-1252"?>
<ns0:ROOT xmlns:ns0="**********************************/"
xmlns:ns1="http://docs.oasis-open.org/wss/2004/01/oasis-200401-wss-wssecurity-secext-1.0.xsd"
xmlns:xsd="http://www.w3.org/2001/XMLSchema"
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
<ns0:SOAPHeader>
<ns1:Security>
<ns1:UsernameToken>
<ns1:Username>***************</ns1:Username>
<ns1:Password>****</ns1:Password>
</ns1:UsernameToken>
</ns1:Security>
</ns0:SOAPHeader>
<p_request>
<userName/>
<password/>
<languageCode/>
<sequenceNumber/>
<retreiveModelDescriptionIndc/>
<mcpTypeCode/>
<serialNumber/>
<VIN>3AKJGLD57ESFP9937</VIN>
</p_request>
</ns0:ROOT>
2019-08-10 09:39:14,386 ERROR [pool-2-thread-1]
com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) -
<ARSYS.ARF.WEBSERVICE>soapOperationDoc = <?xml version="1.0" encoding="UTF-8"?>
<operation bindingStyle="document" name="getMajorComponentDataForRemedy"
type="create" useStyle="literal">
<arOptions>
<setOptions>
<type>setFirst</type>
<documentType>full</documentType>
</setOptions>
</arOptions>
<inputMapping name="getMajorComponentDataForRemedy"
namespace="http://*********************/"
topLevelElement="getMajorComponentDataForRemedy"/>
<outputMapping name="getMajorComponentDataForRemedyResponse"
namespace="http://*****************************/"
topLevelElement="getMajorComponentDataForRemedyResponse"/>
</operation>
2019-08-10 09:39:14,386 ERROR [pool-2-thread-1]
com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) -
<ARSYS.ARF.WEBSERVICE>soapAction =
2019-08-10 09:39:14,386 ERROR [pool-2-thread-1]
com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) -
<ARSYS.ARF.WEBSERVICE>soapMethod = getMajorComponentDataForRemedy
2019-08-10 09:39:14,386 ERROR [pool-2-thread-1]
com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) -
<ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: cannot convert into document; nested
exception is:
java.net.SocketTimeoutException: Read timed out
2019-08-10 09:39:14,386 ERROR [pool-2-thread-1]
com.bmc.arsys.pluginsvr.plugins.ARFilterAPIPluginRepository (?:?) -
ARFilterApiCall FAILs in plugin: ARSYS.ARF.WEBSERVICE
ERROR (9130): Error encountered while executing a Web Service;
WSDoAllReceiver: cannot convert into document; nested exception is:
java.net.SocketTimeoutException: Read timed out
at
com.bmc.arsys.ws.plugin.WSPlugin.ThrowException(WSPlugin.java:158)
at
com.bmc.arsys.ws.plugin.WSPlugin.filterAPICall(WSPlugin.java:151)
at
com.bmc.arsys.pluginsvr.plugins.ARFilterAPIPluginRepository.ARFilterApiCall(Unknown
Source)
at com.bmc.arsys.pluginsvr.a.ArEsFilterApi_5(Unknown Source)
at com.bmc.arsys.pluginsvr.a.ArEsFilterApi_4(Unknown Source)
at com.bmc.arsys.arrpc.ARPluginServerDispatcher.dispatchOncRpcCall(Unknown
Source)
at com.bmc.arsys.arrpc.nio.ArRpcCallHandler.dispatchCall(Unknown
Source)
at com.bmc.arsys.arrpc.nio.ArRpcCallHandler.if(Unknown Source)
at com.bmc.arsys.arrpc.nio.ArRpcCallHandler.processRpcCall(Unknown
Source)
at com.bmc.arsys.arrpc.nio.ArRpcCallHandler$Processor.run(Unknown
Source)
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown
Source)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown
Source)
at java.lang.Thread.run(Unknown Source)
2019-08-10 09:39:16,839 ERROR [pool-2-thread-3]
com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) -
<ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required
Security header
2019-08-10 09:39:16,933 ERROR [pool-2-thread-5]
com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) -
<ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required
Security header
2019-08-10 09:39:17,074 ERROR [pool-2-thread-2]
com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) -
<ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required
Security header
2019-08-10 09:39:49,028 ERROR [pool-2-thread-4]
com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) -
<ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required
Security header
2019-08-10 09:39:49,122 ERROR [pool-2-thread-3]
com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) -
<ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required
Security header
2019-08-10 09:39:49,293 ERROR [pool-2-thread-5]
com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) -
<ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required
Security header
2019-08-10 09:39:56,216 ERROR [pool-2-thread-2]
com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) -
<ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required
Security header
2019-08-10 09:39:56,278 ERROR [pool-2-thread-1]
com.bmc.arsys.pluginsvr.plugins.ARPluginContext (?:?) -
<ARSYS.ARF.WEBSERVICE>WSDoAllReceiver: Request does not contain required
Security header
The DBA doesn’t see any issue with the Database, no issue with the network,
no issue with the web service. And we haven’t made any changes with the
code in years. This is happening on both the windows client and web client
Any ideas and help would be greatly appreciated
Thank you,
Pascale Sterrett
If you are not the addressee, please inform us immediately that you have
received this e-mail by mistake, and delete it. We thank you for your support.
--
ARSList mailing list
ARSList@arslist.org
https://mailman.rrr.se/cgi/listinfo/arslist
If you are not the addressee, please inform us immediately that you have
received this e-mail by mistake, and delete it. We thank you for your support.
--
ARSList mailing list
ARSList@arslist.org
https://mailman.rrr.se/cgi/listinfo/arslist
--
ARSList mailing list
ARSList@arslist.org
https://mailman.rrr.se/cgi/listinfo/arslist