Thanks Venkata. The increase in timeout really helped. Around 15.5Mbit data is fetched in 3:42 seconds. This is standalone VM deployment which could be major cause of issue. We will shift on K8s and try to check the performance. There are around 64K sites and associated relationship with single or 2 objects per sites.
-----Original Message----- From: [email protected] [mailto:[email protected]] On Behalf Of Venkata Harish K Kajur Sent: 11 April 2019 23:29 To: [email protected]; Chandrashekhar Thakare <[email protected]>; [email protected] Subject: Re: [onap-discuss] [aai] Increase response timeout Hi Chandra, Inside the container of aai-resources microservice, there is an aaiconfig.properties in the following path: /opt/app/aai-resources/resources/etc/appprops/aaiconfig.properties In that file, there are three properties related to the timeout that can be configured in the resources microservice. # Whether or not the timeout is enabled for resources CRUD APIs aai.crud.timeoutenabled=true # Specifies the amount of time in milliseconds before the CRUD APIs timeout aai.crud.timeoutlimit=100000 # Pipe delimited list of application and its timeouts # Specifies in a more fine grain control of how long the timeout should be # for an specific application that you can override # If the TIMEOUT_OF_APPLICATION_ONE is -1, then only that application will never timeout # Any other positive integer will be specified by how many seconds it should timeout aai.crud.timeout.appspecific=<APPLICATION_ONE_FROMAPPID>,<TIMEOUT_OF_APPLICATION_ONE>|< APPLICATION_TWO_FROMAPPID>,<TIMEOUT_OF_APPLICATION_TWO> I would suggest that you update the aai.crud.timeout=300000 to see if that is the issue. If you are deploying via helm charts using oom repo, then you can override by adding the following flag in the helm deploy step: --set aai.aai-resources.config.crud.timeout.limit=300000 On a side note, I would like to know why this is timing out, can you provide the following information? How many complexes are in your AAI database? And how many relationships are there for each of the complexes? Thanks, Harish -----Original Message----- From: [email protected] <[email protected]> On Behalf Of Chandra Sent: Thursday, April 11, 2019 1:16 PM To: [email protected]; Chandrashekhar Thakare <[email protected]>; [email protected] Subject: Re: [onap-discuss] [aai] Increase response timeout Getting below error in log 2019-04-11T17:11:09.897+0000|32f7fb9d-5dc3-4772-a011-05dd4b86805b|qtp452805835-84|GET /aai/v14/cloud-infrastructure/complexes/|SO|aai-resources|GET /aai/v14/cloud-infrastructure/complexes/|ERROR|400|Request Timed Out:7406:Bad Request:Timeout limit of 100 seconds reached.|co=SO:ERR.5.4.7406 ex=org.onap.aai.exceptions.AAIException: Timeout limit of 100 seconds reached. ClassName- org.onap.aai.restcore.RESTAPI :LineNumber- 349 :MethodName- executeProcess ClassName- org.onap.aai.restcore.RESTAPI :LineNumber- 382 :MethodName- runner ClassName- org.onap.aai.rest.LegacyMoxyConsumer :LineNumber- 221 :MethodName- getLegacy ClassName- sun.reflect.NativeMethodAccessorImpl :LineNumber- -2 :MethodName- invoke0 ClassName- sun.reflect.NativeMethodAccessorImpl :LineNumber- 62 :MethodName- invoke ClassName- sun.reflect.DelegatingMethodAccessorImpl :LineNumber- 43 :MethodName- invoke ClassName- java.lang.reflect.Method :LineNumber- 498 :MethodName- invoke ClassName- org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory$1 :LineNumber- 81 :MethodName- invoke ClassName- org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1 :LineNumber- 144 :MethodName- run ClassName- org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher :LineNumber- 161 :MethodName- invoke -----Original Message----- From: [email protected] [mailto:[email protected]] On Behalf Of Chandra Sent: 11 April 2019 20:29 To: [email protected]; [email protected] Subject: Re: [onap-discuss] [aai] Increase response timeout Yes , I will check the logs.. I am trying to get /cloud-infrastructure/complexes only. -----Original Message----- From: [email protected] [mailto:[email protected]] On Behalf Of Keong Lim Sent: 11 April 2019 18:25 To: Chandrashekhar Thakare <[email protected]>; [email protected] Subject: Re: [onap-discuss] [aai] Increase response timeout Hi Chandra, If your system is running OK for smaller queries, perhaps you could get some logs from aai-resources and cassandra from the big queries that are taking over 100 seconds? I don't know how/where the 100 second timeout is set, but will try to find out. What is the exact HTTP method and URL you are using? Any additional query parameters, for example? Perhaps you could report the number of objects in your database by using the query parameter "?format=count" e.g. GET /cloud-infrastructure/complexes?format=count as per: https://urldefense.proofpoint.com/v2/url?u=https-3A__docs.onap.org_en_casablanca_submodules_aai_aai-2Dcommon.git_docs_AAI-2520REST-2520API-2520Documentation_AAIRESTAPI-5FCASABLANCA.html-23count&d=DwIGaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=f44eG3iZaja2ozEA2yRZnQ&m=glW6kyM6SD7lW7dqWTF25HpJHX7DPSW7om6-UKuPTMU&s=KN8PznZLYHvcoPKySHjRLWTn9T2d6wA-iU7hK6wQm3c&e= Are you using the Bulk API? https://urldefense.proofpoint.com/v2/url?u=https-3A__docs.onap.org_en_casablanca_submodules_aai_aai-2Dcommon.git_docs_AAI-2520REST-2520API-2520Documentation_bulkApi.html&d=DwIGaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=f44eG3iZaja2ozEA2yRZnQ&m=glW6kyM6SD7lW7dqWTF25HpJHX7DPSW7om6-UKuPTMU&s=POZCyoXBIUhSrM4ds961g3IgkApXbtsje2HQAfOiuUE&e= or is it just a GET of all the complexes? e.g. GET /cloud-infrastructure/complexes Keong ============================================================================================================================ Disclaimer: This message and the information contained herein is proprietary and confidential and subject to the Tech Mahindra policy statement, you may review the policy at https://urldefense.proofpoint.com/v2/url?u=http-3A__www.techmahindra.com_Disclaimer.html&d=DwIGaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=f44eG3iZaja2ozEA2yRZnQ&m=glW6kyM6SD7lW7dqWTF25HpJHX7DPSW7om6-UKuPTMU&s=jHek8q3aHZpM40sQGhoFYmW1LqoNYki_zY_mYXcpHSI&e= <https://urldefense.proofpoint.com/v2/url?u=http-3A__www.techmahindra.com_Disclaimer.html&d=DwIGaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=f44eG3iZaja2ozEA2yRZnQ&m=glW6kyM6SD7lW7dqWTF25HpJHX7DPSW7om6-UKuPTMU&s=jHek8q3aHZpM40sQGhoFYmW1LqoNYki_zY_mYXcpHSI&e=> externally https://urldefense.proofpoint.com/v2/url?u=http-3A__tim.techmahindra.com_tim_disclaimer.html&d=DwIGaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=f44eG3iZaja2ozEA2yRZnQ&m=glW6kyM6SD7lW7dqWTF25HpJHX7DPSW7om6-UKuPTMU&s=lEu14ZmpOsYB8-j4UTU59aBdsoHVqt6nVsdjT_iGjB8&e= <https://urldefense.proofpoint.com/v2/url?u=http-3A__tim.techmahindra.com_tim_disclaimer.html&d=DwIGaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=f44eG3iZaja2ozEA2yRZnQ&m=glW6kyM6SD7lW7dqWTF25HpJHX7DPSW7om6-UKuPTMU&s=lEu14ZmpOsYB8-j4UTU59aBdsoHVqt6nVsdjT_iGjB8&e=> internally within TechMahindra. ============================================================================================================================ -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#16541): https://lists.onap.org/g/onap-discuss/message/16541 Mute This Topic: https://lists.onap.org/mt/31019307/21656 Group Owner: [email protected] Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub [[email protected]] -=-=-=-=-=-=-=-=-=-=-=-
