Hi Rabi - I've seen memory jumps on arserverd. We had an issue with (I think) patch 21 on ARS 6.3. We were in the process of moving from Unix to Windows environments. As part of the testing that went with this, we saw memory jumping and staying used. We eventually tied it down to an error in one of the Business Time functions. Using a tool called spotlight and logging via individual threads, we could see which user was causing the problem. We could then look at the log files and see what was trying to run. As a result of this, we rolled back to patch 18 and reported the bug to BMC. After much disbelief (surely not....), BMC finally admitted that there was an error. This was corrected for Patch 24.
I think I mentioned this in more detail in a previous post to the arslist. It might be worth looking for that for further information. Thanks, Gavin Coleman Senior Analyst/Programmer Computacenter (UK) Ltd Services & Solutions Hatfield Avenue Hatfield, Hertfordshire, AL10 9TW, United Kingdom T: +44 (0) 1707 631662 E: [email protected] W: www.computacenter.com -----Original Message----- From: Action Request System discussion list(ARSList) [mailto:[email protected]] On Behalf Of Rabi Tripathi Sent: 06 August 2009 15:57 To: [email protected] Subject: Re: ARS 6.3 p20 on SunOS 5.9: memory leak? What patch do you use? Thanks for the tip Shyam. It turns out that after arserverd was started last Dec, within a number of days, it started consuming 2.5 GB in this machine with 2 GB of physical RAM and that's where it stayed for almost 8 months. Apparently, users either didn't have issues, or they didn't make noise because they didn't think much could be done...until very recently. After recent freezes and slowdowns around peak times at random weekdays, which would self-correct in less than half hour, I had the machine rebooted. arserderd started at 500MB and in a few jumps over a few days, is at 2.5 GB again. So in a way, this is "normal". For ARS 6.3/HelpDesk 5 app with no more than 50 peak users, I tend to think this is excessive. Recently, there have been no slowdowns that have been reported to me. I see big spikes in network traffic coming to arserverd box at times, but users haven't complained. At least a few times the spikes in inbound network traffic in ars box coincides with spike in outbound network traffic in the database box. I suspect that a bad query gets to AR Server that causes large number of records to be retrieved from the database. Trying to pin point the user/query/operation that's behaving badly. My guess about the prior freezes is that the machine and arserverd were due for a recycle. Combine that with my bad query theory and it's possible that a threshold was reached in 8 months beyond which the bad query wasn't harmless any more. I have a few suspect queries. I will share any findings. Rick, thanks for the tip on Vista. Something the helpdesk should know. --- On Wed, 7/22/09, Shyam Attavar <[email protected]> wrote: > From: Shyam Attavar <[email protected]> > Subject: Re: ARS 6.3 p20 on SunOS 5.9: memory leak? What patch do you use? > To: [email protected] > Date: Wednesday, July 22, 2009, 2:55 PM > Rabi, > > Are there any batch processes running that maybe bumping > the arserver memory > every night? If there are batch processes, are these also > using the 6.3 > version of the API? > > Just something to think about... > > We had a situation where we had to change an integration > component (from > another application to Remedy) which was built using a > different version of > the API relative to the version of the AR Server we were > running. Once we > brought them to the same version of the API as the AR > Server, this was no > longer an issue... > > But I would recommend that you plan for an upgrade at the > earliest, since > 6.3 is probably ending it support sometime soon. > > Cheers, > -- > Shyam > > > "Rabi Tripathi" <[email protected]> > wrote in message > news:<[email protected]>... > > Shyam, > > Upgrade is on the list, but not right away. I am > considering going to the > highest patch for 6.3, patch 25. > > > > Different question: does anybody have Remedy user 6.3 > (patch 20) running > in Windows vista against ARS 6.3 patch 20? In Solaris? > > > > Another question: What is the first version of Remedy > User that supports > Vista? And is anybody using it against 6.3 server? > > > > > > Fun stuff: > > I just found out that our helpdesk switched from > Windows XP to Vista > roughly around the time the issue started. They hacked the > installer to have > it install on Vista. I had no clue. So one theory is that a > memory leak in > arserverd was triggered by 6.3 clients running in Vista > instead of Windows > XP?? Sounds weird, but I don't know how else to explain it. > Solaris patches > were applied on the server, but I am still trying to find > out details. > > > > And this just in: > > arserverd is now using 1.2 GB of memory, up from 0.540 > GB yesterday. Our > monitoring data isn't process specific, so I can't be sure, > but looks like > it was a gradual increase over night as it was pretty > constant until late > afternoon yesterday during my manual checks. > > > > > > > > --- On Mon, 7/20/09, Shyam Attavar <[email protected]> > wrote: > > > > > From: Shyam Attavar <[email protected]> > > > Subject: Re: ARS 6.3 p20 on SunOS 5.9: memory > leak? What patch do you > use? > > > To: [email protected] > > > Date: Monday, July 20, 2009, 5:17 PM > > > Rabi, > > > > > > This probably does not answer your question, but > do you > > > have the option to > > > upgrade AR System itself? > > > > > > -- > > > Shyam > > > > > > "Rabi Tripathi" <[email protected]> > > > wrote in message > > > news:<[email protected]>... > > > > Hi all, > > > > If you have a stable installation of ARS 6.3 > on > > > Solaris, I would like to > > > know what ARS patch you have and what is your > Solaris > > > version/patch. > > > > > > > > The story is that our ARS server (HelpDesk > 5.x app, > > > 20-40 users at a time) > > > was running fine for 6 months or so. Suddenly > last Thu, > > > arserverd started > > > using 50% more memory (2.5 GB), more than the > installed RAM > > > (2 GB). Resulted > > > in a lot of swapping and sporadic general > slowness. > > > > > > > > Next day server completely froze for half an > hour, > > > without apparent reason > > > and then came back fine. The only Remedy error > that was > > > logged 15 mins after > > > freeze was: > > > > Dispatch : Timeout during database query -- > consider > > > using more specific > > > search criteria to narrow the results, and retry > the > > > operat > > > > ion (tamarind) ARERR - 94 > > > > > > > > It seems to be a symptom, not the cause. > DBAs swear > > > there is nothing at > > > their end. tnsping from arserver to db did show > 370ms as > > > opposed to the > > > usual 10 ms. It's being attributed to issue at > the remedy > > > box. > > > > > > > > Apart from the above, nothing remarkable in > logs > > > anywhere in Remedy, OS or > > > database (Oracle 9.x on separate machine). That > night, we > > > rebooted the > > > machine. ARS came back to using just 350 MB > memory and all > > > was fine. Two > > > days later suddenly jumped to using 550 MB. > Somehow, I lost > > > the filter, db, > > > api log of that period. Today arserverd > memory use > > > seems to be stable, > > > though overall memory consumption in the box is > slowly > > > trending up. A few > > > users have reported general slowness at times. > > > > > > > > I am trying to analyze detailed Remedy logs > for > > > slowness and also trying > > > to figure out which process is causing the upward > trend in > > > box's memory use > > > (it's not arserverd). Also considering going to > the highest > > > patch, 25. > > > > It seems our administrators applied solaris > patches at > > > various times > > > recently. I don't have detailed info, but > something there > > > might have > > > interacted with some issue in ARS. > > > > > > > > Back to the question, I would like to know > any > > > experience regarding > > > stability of anybody else using 6.3 on Solaris. > > > > > > > > Thanks. > > > > > > > > ARs 6.3 p20 > > > > SunOS 5.9 > > > > Oracle 9.2 on a separate Sun box. > > > > HelpDesk 5.x app > > > > > > > > > > > > > > > > > > > > > > > ____________________________________________________________________________ > ___ > > > UNSUBSCRIBE or access ARSlist Archives at > www.arslist.org > > > Platinum Sponsor:[email protected] > > > ARSlist: "Where the Answers Are" > > > > > > > > > > > > > _______________________________________________________________________________ > UNSUBSCRIBE or access ARSlist Archives at www.arslist.org > Platinum Sponsor:[email protected] > ARSlist: "Where the Answers Are" > _______________________________________________________________________________ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Platinum Sponsor:[email protected] ARSlist: "Where the Answers Are" ********************************************************************** COMPUTACENTER PLC is registered in England and Wales with the registered number 03110569. Its registered office is at Hatfield Business Park, Hatfield Avenue, Hatfield, Hertfordshire AL10 9TW COMPUTACENTER (UK) Limited is registered in England and Wales with the registered number 01584718. Its registered office is at Hatfield Business Park, Hatfield Avenue, Hatfield, Hertfordshire AL10 9TW COMPUTACENTER (Mid-Market) Limited is registered in England and Wales with the registered number 3434654. Its registered office is at Hatfield Business Park, Hatfield Avenue, Hatfield, Hertfordshire AL10 9TW COMPUTACENTER (FMS) Limited is registered in England and Wales with the registered number 3798091. Its registered office is at Hatfield Business Park, Hatfield Avenue, Hatfield, Hertfordshire AL10 9TW The contents of this email are intended for the named addressee only. It contains information which may be confidential and which may also be privileged. Unless you are the named addressee (or authorised to receive mail for the addressee) you may not copy or use it, or disclose it to anyone else. If you receive it in error please notify us immediately and then destroy it. Computacenter information is available from: http://www.computacenter.com ********************************************************************** _______________________________________________________________________________ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Platinum Sponsor:[email protected] ARSlist: "Where the Answers Are"
