Slow server starts
Hi All, I am respectfully asking for your wisdom in an issue I am having. I have noticed that our virtual servers are taking upwards to 45 minutes - 1 hour to start-up. This is unacceptable and I am currently in a guessing game for the true cause. Memory, connections, ... 1 physical 124 gig running 6 virtual machines 4- 12 gig ARS servers 2- 2 gig mid-tiers All running Windows 2008 ARS 7.6.04 ITSM Suite 10 gig single nic 1 gig network pipeline The Oracle database is on a different machine. It used to take about 20 minutes to start and now it is upwards to 45 min to an hour. Do you have any suggestions for this issue? Respectfully, William This email message is intended for the use of the person to whom it has been sent, and may contain information that is confidential or legally protected. If you are not the intended recipient or have received this message in error, you are not authorized to copy, distribute, or otherwise use this message or its attachments. Please notify the sender immediately by return e-mail and permanently delete this message and any attachments. Verio, Inc. makes no warranty that this email is error or virus free. Thank you. ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are
Re: Slow server starts
You should enable SQL and/or API logging and then perform a restart to see where you are getting hung up. It could be some external DB link or something that ARS is getting hung up on if you have any integrations. Sent from my iPhone On Mar 1, 2012, at 11:26 AM, William Abdo william.a...@verio.net wrote: ** Hi All, I am respectfully asking for your wisdom in an issue I am having. I have noticed that our virtual servers are taking upwards to 45 minutes – 1 hour to start-up. This is unacceptable and I am currently in a guessing game for the true cause. Memory, connections, … 1 physical 124 gig running 6 virtual machines 4- 12 gig ARS servers 2- 2 gig mid-tiers All running Windows 2008 ARS 7.6.04 ITSM Suite 10 gig single nic 1 gig network pipeline The Oracle database is on a different machine. It used to take about 20 minutes to start and now it is upwards to 45 min to an hour. Do you have any suggestions for this issue? Respectfully, William This email message is intended for the use of the person to whom it has been sent, and may contain information that is confidential or legally protected. If you are not the intended recipient or have received this message in error, you are not authorized to copy, distribute, or otherwise use this message or its attachments. Please notify the sender immediately by return e-mail and permanently delete this message and any attachments. Verio, Inc. makes no warranty that this email is error or virus free. Thank you. _attend WWRUG12 www.wwrug.com ARSlist: Where the Answers Are_ ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are
Re: Slow server starts
William, I have the same issue...when the application server is located a different data center than where the Oracle DB is located. The latency seems to be the cause. My restarts in the same Data center take 10 minutes and when in a different DC it takes 30 minutes. Thanks, Ed From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of William Abdo Sent: Thursday, March 01, 2012 11:26 AM To: arslist@ARSLIST.ORG Subject: Slow server starts ** Hi All, I am respectfully asking for your wisdom in an issue I am having. I have noticed that our virtual servers are taking upwards to 45 minutes - 1 hour to start-up. This is unacceptable and I am currently in a guessing game for the true cause. Memory, connections, ... 1 physical 124 gig running 6 virtual machines 4- 12 gig ARS servers 2- 2 gig mid-tiers All running Windows 2008 ARS 7.6.04 ITSM Suite 10 gig single nic 1 gig network pipeline The Oracle database is on a different machine. It used to take about 20 minutes to start and now it is upwards to 45 min to an hour. Do you have any suggestions for this issue? Respectfully, William This email message is intended for the use of the person to whom it has been sent, and may contain information that is confidential or legally protected. If you are not the intended recipient or have received this message in error, you are not authorized to copy, distribute, or otherwise use this message or its attachments. Please notify the sender immediately by return e-mail and permanently delete this message and any attachments. Verio, Inc. makes no warranty that this email is error or virus free. Thank you. _attend WWRUG12 www.wwrug.com ARSlist: Where the Answers Are_ -- This message w/attachments (message) is intended solely for the use of the intended recipient(s) and may contain information that is privileged, confidential or proprietary. If you are not an intended recipient, please notify the sender, and then please delete and destroy all copies and attachments, and be advised that any review or dissemination of, or the taking of any action in reliance on, the information contained in or attached to this message is prohibited. Unless specifically indicated, this message is not an offer to sell or a solicitation of any investment products or other financial product or service, an official confirmation of any transaction, or an official statement of Sender. Subject to applicable law, Sender may intercept, monitor, review and retain e-communications (EC) traveling through its networks/systems and may produce any such EC to regulators, law enforcement, in litigation and as required by law. The laws of the country of each sender/recipient may impact the handling of EC, and EC may be archived, supervised and produced in countries other than the country in which you are located. This message cannot be guaranteed to be secure or free of errors or viruses. References to Sender are references to any subsidiary of Bank of America Corporation. Securities and Insurance Products: * Are Not FDIC Insured * Are Not Bank Guaranteed * May Lose Value * Are Not a Bank Deposit * Are Not a Condition to Any Banking Service or Activity * Are Not Insured by Any Federal Government Agency. Attachments that are part of this EC may have additional important disclosures and disclaimers, which you should read. This message is subject to terms available at the following link: http://www.bankofamerica.com/emaildisclaimer. By messaging with Sender you consent to the foregoing. ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are
Re: Slow server starts
You can also check the server logs and see what errors the service is reporting on startup. I had this happen (though not as extensive) and could see DB timeouts in the logs. From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of La Grua, Edward Sent: Thursday, March 01, 2012 10:39 AM To: arslist@ARSLIST.ORG Subject: Re: Slow server starts ** William, I have the same issue...when the application server is located a different data center than where the Oracle DB is located. The latency seems to be the cause. My restarts in the same Data center take 10 minutes and when in a different DC it takes 30 minutes. Thanks, Ed From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of William Abdo Sent: Thursday, March 01, 2012 11:26 AM To: arslist@ARSLIST.ORG Subject: Slow server starts ** Hi All, I am respectfully asking for your wisdom in an issue I am having. I have noticed that our virtual servers are taking upwards to 45 minutes - 1 hour to start-up. This is unacceptable and I am currently in a guessing game for the true cause. Memory, connections, ... 1 physical 124 gig running 6 virtual machines 4- 12 gig ARS servers 2- 2 gig mid-tiers All running Windows 2008 ARS 7.6.04 ITSM Suite 10 gig single nic 1 gig network pipeline The Oracle database is on a different machine. It used to take about 20 minutes to start and now it is upwards to 45 min to an hour. Do you have any suggestions for this issue? Respectfully, William This email message is intended for the use of the person to whom it has been sent, and may contain information that is confidential or legally protected. If you are not the intended recipient or have received this message in error, you are not authorized to copy, distribute, or otherwise use this message or its attachments. Please notify the sender immediately by return e-mail and permanently delete this message and any attachments. Verio, Inc. makes no warranty that this email is error or virus free. Thank you. _attend WWRUG12 www.wwrug.comhttp://www.wwrug.com ARSlist: Where the Answers Are_ This message w/attachments (message) is intended solely for the use of the intended recipient(s) and may contain information that is privileged, confidential or proprietary. If you are not an intended recipient, please notify the sender, and then please delete and destroy all copies and attachments, and be advised that any review or dissemination of, or the taking of any action in reliance on, the information contained in or attached to this message is prohibited. Unless specifically indicated, this message is not an offer to sell or a solicitation of any investment products or other financial product or service, an official confirmation of any transaction, or an official statement of Sender. Subject to applicable law, Sender may intercept, monitor, review and retain e-communications (EC) traveling through its networks/systems and may produce any such EC to regulators, law enforcement, in litigation and as required by law. The laws of the country of each sender/recipient may impact the handling of EC, and EC may be archived, supervised and produced in countries other than the country in which you are located. This message cannot be guaranteed to be secure or free of errors or viruses. References to Sender are references to any subsidiary of Bank of America Corporation. Securities and Insurance Products: * Are Not FDIC Insured * Are Not Bank Guaranteed * May Lose Value * Are Not a Bank Deposit * Are Not a Condition to Any Banking Service or Activity * Are Not Insured by Any Federal Government Agency. Attachments that are part of this EC may have additional important disclosures and disclaimers, which you should read. This message is subject to terms available at the following link: http://www.bankofamerica.com/emaildisclaimer. By messaging with Sender you consent to the foregoing. _attend WWRUG12 www.wwrug.comhttp://www.wwrug.com ARSlist: Where the Answers Are_ ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are
Re: Slow server starts
William, I got the same issue on MS SQL on a remote server and find it very slow to start-up. Are you using FQDN (fully qualified domain name) for all server references within BMC? With a correct setup in you DNS servers it should not make a difference. I found that we had less issues and quicker startup if I used FQDN for all server references. Your RAM your your mid-tier sounds low to me. Bring it up to 4 CPU's and minimum 4 GB RAM. This make no difference in start up for the app server. ~ Terje Sent from my iPad On 1 Mar 2012, at 16:26, William Abdo william.a...@verio.netmailto:william.a...@verio.net wrote: ** Hi All, I am respectfully asking for your wisdom in an issue I am having. I have noticed that our virtual servers are taking upwards to 45 minutes – 1 hour to start-up. This is unacceptable and I am currently in a guessing game for the true cause. Memory, connections, … 1 physical 124 gig running 6 virtual machines 4- 12 gig ARS servers 2- 2 gig mid-tiers All running Windows 2008 ARS 7.6.04 ITSM Suite 10 gig single nic 1 gig network pipeline The Oracle database is on a different machine. It used to take about 20 minutes to start and now it is upwards to 45 min to an hour. Do you have any suggestions for this issue? Respectfully, William This email message is intended for the use of the person to whom it has been sent, and may contain information that is confidential or legally protected. If you are not the intended recipient or have received this message in error, you are not authorized to copy, distribute, or otherwise use this message or its attachments. Please notify the sender immediately by return e-mail and permanently delete this message and any attachments. Verio, Inc. makes no warranty that this email is error or virus free. Thank you. _attend WWRUG12 www.wwrug.comhttp://www.wwrug.com ARSlist: Where the Answers Are_ ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are
Re: Slow server starts
William, This could be a known problem with the ARS on a VM using Oracle as the DB.. By design, the AR Server is designed to read chunks of 100 records so the bottle neck is when its reading the display properties table which has over a 140 K records if you have all the ITSM applications installed on the AR Server. You could try taking startup logs of the AR Server when you are starting it up.. in order to do this, you would need to add the –t option to the arserver startup line in the armonitor.conf (or cfg if you are on windows) file.. You can put the –t anywhere on the startup line after the path. The startup log will be named arstartup_.log where is a Process ID number and will be found in the AR System directory.. Tail this file during the startup and you might be able to see the progress of its startup.. If there are any other failures other than the latency on reading the display properties meta data table, you should see it on this log.. Joe From: William Abdo Sent: Thursday, March 01, 2012 11:26 AM Newsgroups: public.remedy.arsystem.general To: arslist@ARSLIST.ORG Subject: Slow server starts ** Hi All, I am respectfully asking for your wisdom in an issue I am having. I have noticed that our virtual servers are taking upwards to 45 minutes – 1 hour to start-up. This is unacceptable and I am currently in a guessing game for the true cause. Memory, connections, … 1 physical 124 gig running 6 virtual machines 4- 12 gig ARS servers 2- 2 gig mid-tiers All running Windows 2008 ARS 7.6.04 ITSM Suite 10 gig single nic 1 gig network pipeline The Oracle database is on a different machine. It used to take about 20 minutes to start and now it is upwards to 45 min to an hour. Do you have any suggestions for this issue? Respectfully, William This email message is intended for the use of the person to whom it has been sent, and may contain information that is confidential or legally protected. If you are not the intended recipient or have received this message in error, you are not authorized to copy, distribute, or otherwise use this message or its attachments. Please notify the sender immediately by return e-mail and permanently delete this message and any attachments. Verio, Inc. makes no warranty that this email is error or virus free. Thank you. _attend WWRUG12 www.wwrug.com ARSlist: Where the Answers Are_ ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are
Re: Slow server starts
Additional ideas: 1. Check to see if your network operations team has inserted a firewall or other latency-creating mechanic between the server and the DB. General database tips To avoid a decline in the BMC Remedy AR System server performance, remember the following tips: · Do not use a firewall between the BMC Remedy AR System server and database tiers. This can impact performance significantly. […] 2. Check to see if you are taking advantage of preload threads: Faster server initialization You can now configure the server to use multiple threads (known as “preload threads”) when loading the cache from the database. This option allows the server to make better use of system resources such as CPU and network bandwidth, and can greatly reduce the time required to load the cache at server initialization. This option can also be configured for use during run time. For information about using this option, see “Using preload threads” in the Configuration Guide. -David J. Easter Manager of Product Management, Remedy Platform BMC Software, Inc. The opinions, statements, and/or suggested courses of action expressed in this E-mail do not necessarily reflect those of BMC Software, Inc. My voluntary participation in this forum is not intended to convey a role as a spokesperson, liaison or public relations representative for BMC Software, Inc. From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Terje Moglestue Sent: Thursday, March 01, 2012 8:56 AM To: arslist@ARSLIST.ORG Subject: Re: Slow server starts ** William, I got the same issue on MS SQL on a remote server and find it very slow to start-up. Are you using FQDN (fully qualified domain name) for all server references within BMC? With a correct setup in you DNS servers it should not make a difference. I found that we had less issues and quicker startup if I used FQDN for all server references. Your RAM your your mid-tier sounds low to me. Bring it up to 4 CPU's and minimum 4 GB RAM. This make no difference in start up for the app server. ~ Terje Sent from my iPad On 1 Mar 2012, at 16:26, William Abdo william.a...@verio.netmailto:william.a...@verio.net wrote: ** Hi All, I am respectfully asking for your wisdom in an issue I am having. I have noticed that our virtual servers are taking upwards to 45 minutes – 1 hour to start-up. This is unacceptable and I am currently in a guessing game for the true cause. Memory, connections, … 1 physical 124 gig running 6 virtual machines 4- 12 gig ARS servers 2- 2 gig mid-tiers All running Windows 2008 ARS 7.6.04 ITSM Suite 10 gig single nic 1 gig network pipeline The Oracle database is on a different machine. It used to take about 20 minutes to start and now it is upwards to 45 min to an hour. Do you have any suggestions for this issue? Respectfully, William This email message is intended for the use of the person to whom it has been sent, and may contain information that is confidential or legally protected. If you are not the intended recipient or have received this message in error, you are not authorized to copy, distribute, or otherwise use this message or its attachments. Please notify the sender immediately by return e-mail and permanently delete this message and any attachments. Verio, Inc. makes no warranty that this email is error or virus free. Thank you. _attend WWRUG12 www.wwrug.comhttp://www.wwrug.com ARSlist: Where the Answers Are_ _attend WWRUG12 www.wwrug.com ARSlist: Where the Answers Are_ ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are
Re: Slow server starts
Thanks David Easter , I know we are using the max of 20 preload threads, however I do need to check on the firewall or other latency-creating mechanic between the server and the DB. If you think of anything else my ears are open. Respectfully, William From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Easter, David Sent: Thursday, March 01, 2012 1:16 PM To: arslist@ARSLIST.ORG Subject: Re: Slow server starts ** Additional ideas: 1. Check to see if your network operations team has inserted a firewall or other latency-creating mechanic between the server and the DB. General database tips To avoid a decline in the BMC Remedy AR System server performance, remember the following tips: · Do not use a firewall between the BMC Remedy AR System server and database tiers. This can impact performance significantly. […] 2. Check to see if you are taking advantage of preload threads: Faster server initialization You can now configure the server to use multiple threads (known as “preload threads”) when loading the cache from the database. This option allows the server to make better use of system resources such as CPU and network bandwidth, and can greatly reduce the time required to load the cache at server initialization. This option can also be configured for use during run time. For information about using this option, see “Using preload threads” in the Configuration Guide. -David J. Easter Manager of Product Management, Remedy Platform BMC Software, Inc. The opinions, statements, and/or suggested courses of action expressed in this E-mail do not necessarily reflect those of BMC Software, Inc. My voluntary participation in this forum is not intended to convey a role as a spokesperson, liaison or public relations representative for BMC Software, Inc. From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Terje Moglestue Sent: Thursday, March 01, 2012 8:56 AM To: arslist@ARSLIST.ORG Subject: Re: Slow server starts ** William, I got the same issue on MS SQL on a remote server and find it very slow to start-up. Are you using FQDN (fully qualified domain name) for all server references within BMC? With a correct setup in you DNS servers it should not make a difference. I found that we had less issues and quicker startup if I used FQDN for all server references. Your RAM your your mid-tier sounds low to me. Bring it up to 4 CPU's and minimum 4 GB RAM. This make no difference in start up for the app server. ~ Terje Sent from my iPad On 1 Mar 2012, at 16:26, William Abdo william.a...@verio.net wrote: ** Hi All, I am respectfully asking for your wisdom in an issue I am having. I have noticed that our virtual servers are taking upwards to 45 minutes – 1 hour to start-up. This is unacceptable and I am currently in a guessing game for the true cause. Memory, connections, … 1 physical 124 gig running 6 virtual machines 4- 12 gig ARS servers 2- 2 gig mid-tiers All running Windows 2008 ARS 7.6.04 ITSM Suite 10 gig single nic 1 gig network pipeline The Oracle database is on a different machine. It used to take about 20 minutes to start and now it is upwards to 45 min to an hour. Do you have any suggestions for this issue? Respectfully, William This email message is intended for the use of the person to whom it has been sent, and may contain information that is confidential or legally protected. If you are not the intended recipient or have received this message in error, you are not authorized to copy, distribute, or otherwise use this message or its attachments. Please notify the sender immediately by return e-mail and permanently delete this message and any attachments. Verio, Inc. makes no warranty that this email is error or virus free. Thank you. _attend WWRUG12 www.wwrug.com ARSlist: Where the Answers Are_ _attend WWRUG12 www.wwrug.com ARSlist: Where the Answers Are_ _attend WWRUG12 www.wwrug.com ARSlist: Where the Answers Are_ This email message is intended for the use of the person to whom it has been sent, and may contain information that is confidential or legally protected. If you are not the intended recipient or have received this message in error, you are not authorized to copy, distribute, or otherwise use this message or its attachments. Please notify the sender immediately by return e-mail and permanently delete this message and any attachments. Verio, Inc. makes no warranty that this email is error or virus free. Thank you. ___ UNSUBSCRIBE or access ARSlist
Re: Slow server starts
William, There is a bug in SP1. We experienced the same issue and were told to get to SP2 to fix this. We are running SP2 in Dev now and its only taking about 5 minutes to restart but we don't have a fully populated DB/load on it yet from our prod image. Mike Hamner U.S. Department of Interior From: William Abdo william.a...@verio.net To: arslist@ARSLIST.ORG Date: 03/01/2012 11:43 AM Subject:Re: Slow server starts Sent by:Action Request System discussion list(ARSList) arslist@ARSLIST.ORG ** Thanks David Easter , I know we are using the max of 20 preload threads, however I do need to check on the firewall or other latency-creating mechanic between the server and the DB. If you think of anything else my ears are open. Respectfully, William From: Action Request System discussion list(ARSList) [ mailto:arslist@ARSLIST.ORG] On Behalf Of Easter, David Sent: Thursday, March 01, 2012 1:16 PM To: arslist@ARSLIST.ORG Subject: Re: Slow server starts ** Additional ideas: 1. Check to see if your network operations team has inserted a firewall or other latency-creating mechanic between the server and the DB. General database tips To avoid a decline in the BMC Remedy AR System server performance, remember the following tips: · Do not use a firewall between the BMC Remedy AR System server and database tiers. This can impact performance significantly. […] 2. Check to see if you are taking advantage of preload threads: Faster server initialization You can now configure the server to use multiple threads (known as “preload threads”) when loading the cache from the database. This option allows the server to make better use of system resources such as CPU and network bandwidth, and can greatly reduce the time required to load the cache at server initialization. This option can also be configured for use during run time. For information about using this option, see “Using preload threads” in the Configuration Guide. -David J. Easter Manager of Product Management, Remedy Platform BMC Software, Inc. The opinions, statements, and/or suggested courses of action expressed in this E-mail do not necessarily reflect those of BMC Software, Inc. My voluntary participation in this forum is not intended to convey a role as a spokesperson, liaison or public relations representative for BMC Software, Inc. From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Terje Moglestue Sent: Thursday, March 01, 2012 8:56 AM To: arslist@ARSLIST.ORG Subject: Re: Slow server starts ** William, I got the same issue on MS SQL on a remote server and find it very slow to start-up. Are you using FQDN (fully qualified domain name) for all server references within BMC? With a correct setup in you DNS servers it should not make a difference. I found that we had less issues and quicker startup if I used FQDN for all server references. Your RAM your your mid-tier sounds low to me. Bring it up to 4 CPU's and minimum 4 GB RAM. This make no difference in start up for the app server. ~ Terje Sent from my iPad On 1 Mar 2012, at 16:26, William Abdo william.a...@verio.net wrote: ** Hi All, I am respectfully asking for your wisdom in an issue I am having. I have noticed that our virtual servers are taking upwards to 45 minutes – 1 hour to start-up. This is unacceptable and I am currently in a guessing game for the true cause. Memory, connections, … 1 physical 124 gig running 6 virtual machines 4- 12 gig ARS servers 2- 2 gig mid-tiers All running Windows 2008 ARS 7.6.04 ITSM Suite 10 gig single nic 1 gig network pipeline The Oracle database is on a different machine. It used to take about 20 minutes to start and now it is upwards to 45 min to an hour. Do you have any suggestions for this issue? Respectfully, William This email message is intended for the use of the person to whom it has been sent, and may contain information that is confidential or legally protected. If you are not the intended recipient or have received this message in error, you are not authorized to copy, distribute, or otherwise use this message or its attachments. Please notify the sender immediately by return e-mail and permanently delete this message and any attachments. Verio, Inc. makes no warranty that this email is error or virus free. Thank you. _attend WWRUG12 www.wwrug.com ARSlist: Where the Answers Are_ _attend WWRUG12 www.wwrug.com ARSlist: Where the Answers Are_ _attend WWRUG12 www.wwrug.com ARSlist: Where the Answers Are_ This email message is intended for the use of the person to whom it has been sent, and may contain information that is confidential or legally protected. If you are not the intended recipient or have received this message in error
Re: Slow server starts
Hi Joe, The -t option has been applied to see what turns up From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Joe Martin D'Souza Sent: Thursday, March 01, 2012 12:46 PM To: arslist@ARSLIST.ORG Subject: Re: Slow server starts ** William, This could be a known problem with the ARS on a VM using Oracle as the DB.. By design, the AR Server is designed to read chunks of 100 records so the bottle neck is when its reading the display properties table which has over a 140 K records if you have all the ITSM applications installed on the AR Server. You could try taking startup logs of the AR Server when you are starting it up.. in order to do this, you would need to add the –t option to the arserver startup line in the armonitor.conf (or cfg if you are on windows) file.. You can put the –t anywhere on the startup line after the path. The startup log will be named arstartup_.log where is a Process ID number and will be found in the AR System directory.. Tail this file during the startup and you might be able to see the progress of its startup.. If there are any other failures other than the latency on reading the display properties meta data table, you should see it on this log.. Joe From: William Abdo mailto:william.a...@verio.net Sent: Thursday, March 01, 2012 11:26 AM Newsgroups: public.remedy.arsystem.general To: arslist@ARSLIST.ORG Subject: Slow server starts ** Hi All, I am respectfully asking for your wisdom in an issue I am having. I have noticed that our virtual servers are taking upwards to 45 minutes – 1 hour to start-up. This is unacceptable and I am currently in a guessing game for the true cause. Memory, connections, … 1 physical 124 gig running 6 virtual machines 4- 12 gig ARS servers 2- 2 gig mid-tiers All running Windows 2008 ARS 7.6.04 ITSM Suite 10 gig single nic 1 gig network pipeline The Oracle database is on a different machine. It used to take about 20 minutes to start and now it is upwards to 45 min to an hour. Do you have any suggestions for this issue? Respectfully, William This email message is intended for the use of the person to whom it has been sent, and may contain information that is confidential or legally protected. If you are not the intended recipient or have received this message in error, you are not authorized to copy, distribute, or otherwise use this message or its attachments. Please notify the sender immediately by return e-mail and permanently delete this message and any attachments. Verio, Inc. makes no warranty that this email is error or virus free. Thank you. _attend WWRUG12 www.wwrug.com ARSlist: Where the Answers Are_ _attend WWRUG12 www.wwrug.com ARSlist: Where the Answers Are_ This email message is intended for the use of the person to whom it has been sent, and may contain information that is confidential or legally protected. If you are not the intended recipient or have received this message in error, you are not authorized to copy, distribute, or otherwise use this message or its attachments. Please notify the sender immediately by return e-mail and permanently delete this message and any attachments. Verio, Inc. makes no warranty that this email is error or virus free. Thank you. ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are
Re: Slow server starts
Hi ED, No DB time outs recorded in the logs, could still be latency, I have to prove these things before they will take them seriously. From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Tommy Morris Sent: Thursday, March 01, 2012 11:43 AM To: arslist@ARSLIST.ORG Subject: Re: Slow server starts ** You can also check the server logs and see what errors the service is reporting on startup. I had this happen (though not as extensive) and could see DB timeouts in the logs. From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of La Grua, Edward Sent: Thursday, March 01, 2012 10:39 AM To: arslist@ARSLIST.ORG Subject: Re: Slow server starts ** William, I have the same issue…when the application server is located a different data center than where the Oracle DB is located. The latency seems to be the cause. My restarts in the same Data center take 10 minutes and when in a different DC it takes 30 minutes. Thanks, Ed From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of William Abdo Sent: Thursday, March 01, 2012 11:26 AM To: arslist@ARSLIST.ORG Subject: Slow server starts ** Hi All, I am respectfully asking for your wisdom in an issue I am having. I have noticed that our virtual servers are taking upwards to 45 minutes – 1 hour to start-up. This is unacceptable and I am currently in a guessing game for the true cause. Memory, connections, … 1 physical 124 gig running 6 virtual machines 4- 12 gig ARS servers 2- 2 gig mid-tiers All running Windows 2008 ARS 7.6.04 ITSM Suite 10 gig single nic 1 gig network pipeline The Oracle database is on a different machine. It used to take about 20 minutes to start and now it is upwards to 45 min to an hour. Do you have any suggestions for this issue? Respectfully, William This email message is intended for the use of the person to whom it has been sent, and may contain information that is confidential or legally protected. If you are not the intended recipient or have received this message in error, you are not authorized to copy, distribute, or otherwise use this message or its attachments. Please notify the sender immediately by return e-mail and permanently delete this message and any attachments. Verio, Inc. makes no warranty that this email is error or virus free. Thank you. _attend WWRUG12 www.wwrug.com ARSlist: Where the Answers Are_ This message w/attachments (message) is intended solely for the use of the intended recipient(s) and may contain information that is privileged, confidential or proprietary. If you are not an intended recipient, please notify the sender, and then please delete and destroy all copies and attachments, and be advised that any review or dissemination of, or the taking of any action in reliance on, the information contained in or attached to this message is prohibited. Unless specifically indicated, this message is not an offer to sell or a solicitation of any investment products or other financial product or service, an official confirmation of any transaction, or an official statement of Sender. Subject to applicable law, Sender may intercept, monitor, review and retain e-communications (EC) traveling through its networks/systems and may produce any such EC to regulators, law enforcement, in litigation and as required by law. The laws of the country of each sender/recipient may impact the handling of EC, and EC may be archived, supervised and produced in countries other than the country in which you are located. This message cannot be guaranteed to be secure or free of errors or viruses. References to Sender are references to any subsidiary of Bank of America Corporation. Securities and Insurance Products: * Are Not FDIC Insured * Are Not Bank Guaranteed * May Lose Value * Are Not a Bank Deposit * Are Not a Condition to Any Banking Service or Activity * Are Not Insured by Any Federal Government Agency. Attachments that are part of this EC may have additional important disclosures and disclaimers, which you should read. This message is subject to terms available at the following link: http://www.bankofamerica.com/emaildisclaimer. By messaging with Sender you consent to the foregoing. _attend WWRUG12 www.wwrug.com ARSlist: Where the Answers Are_ _attend WWRUG12 www.wwrug.com ARSlist: Where the Answers Are_ This email message is intended for the use of the person to whom it has been sent, and may contain information that is confidential or legally protected. If you are not the intended recipient or have received this message in error, you are not authorized to copy, distribute, or otherwise use this message or its attachments. Please notify the sender immediately by return e-mail and permanently delete this message
Re: Slow server starts
Hi Tauf Chowdhury, We do see a stall in memory growth however the logs are clear of a noticeable issue. From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Tauf Chowdhury Sent: Thursday, March 01, 2012 11:31 AM To: arslist@ARSLIST.ORG Subject: Re: Slow server starts ** You should enable SQL and/or API logging and then perform a restart to see where you are getting hung up. It could be some external DB link or something that ARS is getting hung up on if you have any integrations. Sent from my iPhone On Mar 1, 2012, at 11:26 AM, William Abdo william.a...@verio.net wrote: ** Hi All, I am respectfully asking for your wisdom in an issue I am having. I have noticed that our virtual servers are taking upwards to 45 minutes - 1 hour to start-up. This is unacceptable and I am currently in a guessing game for the true cause. Memory, connections, ... 1 physical 124 gig running 6 virtual machines 4- 12 gig ARS servers 2- 2 gig mid-tiers All running Windows 2008 ARS 7.6.04 ITSM Suite 10 gig single nic 1 gig network pipeline The Oracle database is on a different machine. It used to take about 20 minutes to start and now it is upwards to 45 min to an hour. Do you have any suggestions for this issue? Respectfully, William This email message is intended for the use of the person to whom it has been sent, and may contain information that is confidential or legally protected. If you are not the intended recipient or have received this message in error, you are not authorized to copy, distribute, or otherwise use this message or its attachments. Please notify the sender immediately by return e-mail and permanently delete this message and any attachments. Verio, Inc. makes no warranty that this email is error or virus free. Thank you. _attend WWRUG12 www.wwrug.com ARSlist: Where the Answers Are_ _attend WWRUG12 www.wwrug.com ARSlist: Where the Answers Are_ This email message is intended for the use of the person to whom it has been sent, and may contain information that is confidential or legally protected. If you are not the intended recipient or have received this message in error, you are not authorized to copy, distribute, or otherwise use this message or its attachments. Please notify the sender immediately by return e-mail and permanently delete this message and any attachments. Verio, Inc. makes no warranty that this email is error or virus free. Thank you. ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are
