subject:"\[SLUG\] assessing vps performance issues"

Re: [SLUG] assessing vps performance issues

2013-11-04 Thread Voytek Eymont

Jeremy,

Yes, more than enough .

But, If you wanted to ask 'so who is the real idiot?', well, the answer is 
clear it's me.

In my defense, I've dealt with these people for well over 10 years, though not 
for hosting, and, the vps performed adequately for 1.5 years, with only 1 
glitch I think.( though the Win MS SQL server was a joke from day 1, I guess I 
should've learnt from that debacle)

Two weeks into this incident, today got this:
-
Please find attached our IR for the most recent issue we experienced with our 
infrastructure.
The issue experienced was directly related to maintenance work being conducted 
on the underlying storage.
As a result maintenance tasks have been reviewed to ensure the do not create 
excessive load that will be visible to the customer environment.
In addition it has also become clear that customers may also be able to 
generate high IO load in a similar manner to this maintenance with the 
potential to affect other clients systems. As a result we have now implemented 
hard IO limits on all VPS in the cluster (200IOPS) 

If you would like any further information please respond to this email.
VPS Service Desk
-

Thanks again to everyone


Jeremy Visser jer...@visser.name wrote:
On 01/11/13 21:56, li...@sbt.net.au wrote:
 It only took them one week of on/off outages to arrive at that, I
guess
 they must've been very thorough in reviewing it.
 
 and, about an hour AFTER I got that email, senior idiot phoned me to
tell
 me I've loaded vps in excess of it,s capacity.

So given all that, I think you have collected enough data to warrant
changing providers.

-- 
SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/
Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html

-- 
Sent from my Android phone with K-9 Mail. Please excuse my brevity.
-- 
SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/
Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html

Re: [SLUG] assessing vps performance issues

2013-11-04 Thread Voytek Eymont

David,

You are either very good at guessing, or perhaps you are not guessing...

David Bomba turbo...@gmail.com wrote:
Let me guess,

Netregistry and their awesome support…. right?

On 01/11/2013, at 9:56 PM, li...@sbt.net.au wrote:

Thanks for the link, thanks for all the tips and advice, it's what
kept me
going through:

'we can ping it, why do you think there is a problem?'
'reboot it'
'you need more memory'
'don't you have a cron job every 5 minutes? that's the cause'

I now received this
--
Our System Administrators have reviewed Sar logs on his system and
can see
that increase IOwait can be seen at times that are in line with
storage
upgrade operation we have been conducting over the last few days.

It was expected that storage vmotion of VM's during these upgrades
would
increase IO on the storage cluster however it was unanticipated that
there
would be any noticeable affect to our clients.

We apologies for the interruption will process an SLA rebate for you
as
per our terms and would like to advise that this storage upgrade
activity
was completed Monday night.

If you notice any further issues, please create a new ticket with
details
including output from Sar Logs indicating the time and date as well
as the
load experienced.
--

It only took them one week of on/off outages to arrive at that, I
guess
they must've been very thorough in reviewing it.

and, about an hour AFTER I got that email, senior idiot phoned me to
tell
me I've loaded vps in excess of it,s capacity.

Thanks for both technical and mental support, guys.

{And, they still havent fixed it, last night vps again overloaded}

Amos Shapira amos.shap...@gmail.com wrote:
In addition to Michael's good advise, see

http://blog.scoutapp.com/articles/2013/07/25/understanding-cpu-steal-time-when-should-you-be-worriedabout
steal time.

--
Sent from my Android phone with K-9 Mail. Please excuse my brevity.

--
SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/
Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html

--
Sent from my Android phone with K-9 Mail. Please excuse my brevity.
--
SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/
Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html

Re: [SLUG] assessing vps performance issues

2013-11-04 Thread Jeremy Visser

On 5 Nov 2013, at 3:58 pm, Voytek Eymont li...@sbt.net.au wrote:
 In addition it has also become clear that customers may also be able to 
 generate high IO load in a similar manner to this maintenance with the 
 potential to affect other clients systems. As a result we have now 
 implemented hard IO limits on all VPS in the cluster (200IOPS)

Are you sure 200 IOPS isn’t a typo? If not, you are being ripped off.

I use Linode, for example, and I get *warning* alerts (not a hard limit) by 
default at 1000 IOPS, and even that warning threshold is configurable.

Linode has been benchmarked at much better than 200 IOPS: 
http://serverbear.com/10-linode-1gb-linode

Even though on that ServerBear site, Linode doesn’t score particularly high in 
terms of I/O, I can tell you now, the crap that you’ve gone through generally 
Just Doesn’t Happen™.

-- 
SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/
Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html

Re: [SLUG] assessing vps performance issues

2013-11-04 Thread David Bomba

200 IOPS is criminal, another well known provider is 'promoting' their SSD
backed servers with a default IOP of 100 why bother having SSD's when
it will perform worse than a single 10k SAS drive


On 5 November 2013 17:13, Jeremy Visser jer...@visser.name wrote:

 On 5 Nov 2013, at 3:58 pm, Voytek Eymont li...@sbt.net.au wrote:
  In addition it has also become clear that customers may also be able to
 generate high IO load in a similar manner to this maintenance with the
 potential to affect other clients systems. As a result we have now
 implemented hard IO limits on all VPS in the cluster (200IOPS)

 Are you sure 200 IOPS isn’t a typo? If not, you are being ripped off.

 I use Linode, for example, and I get *warning* alerts (not a hard limit)
 by default at 1000 IOPS, and even that warning threshold is configurable.

 Linode has been benchmarked at much better than 200 IOPS:
 http://serverbear.com/10-linode-1gb-linode

 Even though on that ServerBear site, Linode doesn’t score particularly
 high in terms of I/O, I can tell you now, the crap that you’ve gone through
 generally Just Doesn’t Happen™.

 --
 SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/
 Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html

-- 
SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/
Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html

Re: [SLUG] assessing vps performance issues

2013-11-01 Thread lists

Thanks for the link, thanks for all the tips and advice, it's what kept me
going through:

'we can ping it, why do you think there is a problem?'
'reboot it'
'you need more memory'
'don't you have a cron job every 5 minutes? that's the cause'

I now received this
--
Our System Administrators have reviewed Sar logs on his system and can see
that increase IOwait can be seen at times that are in line with storage
upgrade operation we have been conducting over the last few days.

It was expected that storage vmotion of VM's during these upgrades would
increase IO on the storage cluster however it was unanticipated that there
would be any noticeable affect to our clients.

We apologies for the interruption will process an SLA rebate for you as
per our terms and would like to advise that this storage upgrade activity
was completed Monday night.

If you notice any further issues, please create a new ticket with details
including output from Sar Logs indicating the time and date as well as the
load experienced.
--

It only took them one week of on/off outages to arrive at that, I guess
they must've been very thorough in reviewing it.

and, about an hour AFTER I got that email, senior idiot phoned me to tell
me I've loaded vps in excess of it,s capacity.

Thanks for both technical and mental support, guys.

{And, they still havent fixed it, last night vps again overloaded}

Amos Shapira amos.shap...@gmail.com wrote:
In addition to Michael's good advise, see
http://blog.scoutapp.com/articles/2013/07/25/understanding-cpu-steal-time-when-should-you-be-worriedabout
steal time.

--
Sent from my Android phone with K-9 Mail. Please excuse my brevity.

--
SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/
Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html

Re: [SLUG] assessing vps performance issues

2013-11-01 Thread Jeremy Visser

On 01/11/13 21:56, li...@sbt.net.au wrote:
 It only took them one week of on/off outages to arrive at that, I guess
 they must've been very thorough in reviewing it.
 
 and, about an hour AFTER I got that email, senior idiot phoned me to tell
 me I've loaded vps in excess of it,s capacity.

So given all that, I think you have collected enough data to warrant
changing providers.

-- 
SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/
Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html

Re: [SLUG] assessing vps performance issues

2013-11-01 Thread David Bomba

Let me guess,