Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance -, 15th August
Mark Newton wrote: > It should be made completely clear during customer onboarding that the > facility operator can temporarily shut down a power feed at any time. > Advance warning should be desirable but optional. Whilst I have some sympathy for Mark's position given the preceding discussion, so that colocation providers reading this list are completely clear: the common expectation of your network operator clients is that advance notice is required for planned maintenance; notice is not merely desirable nor optional. If you have a different view then this should be discussed during contract negotiations, not later during onboarding. Sending staff and spares to a colo site to investigate a multiple power supply failure is not cheap in itself, and has a high opportunity cost in that staff member abandoning their planned work for that half a day. Without prior notice these costs and possible client disappointments are incurred more often than they need be. Network operators seek to manage the hazards to their network. One colo doing power works is an everyday event. Two colos unknowingly doing power works simultaneously is a different level of risk again. Without prior notification an operator cannot know what the level of risk to their network is: what is not known cannot be managed. Regards, glen ___ AusNOG mailing list AusNOG@lists.ausnog.net http://lists.ausnog.net/mailman/listinfo/ausnog
Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance -, 15th August
I think it’s more the fact that they will be losing power for 8 hours on the A side. But yes, always best practice to have A and B, however, this is not always suitable in certain circumstances. For example in one facility we have dedicated servers in, we have A only. We know the risks of it as does the clients buying those services. Simon, thanks for the explanation. I guess this is a decision you take as a DC operator that is again, not the law, but a OH & S precaution. As none of those standards advise that the boards need to be de energised to perform the work. Both Global Switch and Equinix do this live or without interruption, as both sites that I have been in have never had an A or B interruption during annual maintenance. Regards, Jared Hirst Servers Australia Pty Ltd Phone: +61 2 8115 8801 Email: jared.hi...@serversaustralia.com.au<mailto:jared.hi...@serversaustralia.com.au> From: AusNOG on behalf of Mark Smith Sent: Saturday, August 12, 2017 12:53:41 PM To: Mark Newton Cc: ; ausnog-requ...@lists.ausnog.net; c...@cpkws.com.au Subject: Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance -, 15th August +1 At least in this situation you'll likely get advanced notice your power is going to go away. When your gear has or sufferers from an unexpected PSU or other failure, you don't. This fundamentally goes to the difference between what availability you happen to get verses what availability you design and engineer to be assured to get. You'll eventually pay the price if you assume coincidental 100% past availability guaratees future 100% availability. It's pretending failure never occurs. If you think you are or would be paying a lot for redundancy, you probably haven't calculated the cost of down time of the service (e.g., lost customer sales, staff sitting around being paid yet unable to do their jobs). That cost of down time is likely to be well in excess of any redundancy costs. Technical infrastructure redundancy is a form of insurance. Would you go without theft, fire and other types of business insurance just because it has never happened to you before? On 11 Aug. 2017 04:54, "Mark Newton" mailto:new...@atdot.dotat.org>> wrote: As someone who has run colo facilities before: It should be made completely clear during customer onboarding that the facility operator can temporarily shut down a power feed at any time. Advance warning should be desirable but optional. If there is risk involved in doing that, it’s your job to mitigate it. The facility operator doesn’t know which bits of equipment in your tenancy are critical, and they’ve already told you to dual-feed where possible and use a rack-mount ATS for single-corded equipment. Power work should be done during business hours, because it’s almost impossible to get emergency support or source replacement equipment out of hours. If it isn’t safe to take a power feed offline during business hours, then you (the customer) have a design problem to solve. - mark > On Aug 10, 2017, at 6:56 AM, Nathan Brookfield > mailto:nathan.brookfi...@simtronic.com.au>> > wrote: > > Chad, > > That's all well and good but when you're paying a premium price for services > of this fashion you expect a certain level of service. There is a risk no > matter what when switching from power supplies taking extra load they would > not usually take as well as swing load issues with PDU's. > > I completely agree with your sentiment but the risk is not to be ignored > especially during those times. > > Kindest Regards, > Nathan Brookfield (VK2NAB) > > -Original Message- > From: AusNOG > [mailto:ausnog-boun...@lists.ausnog.net<mailto:ausnog-boun...@lists.ausnog.net>] > On Behalf Of Chad Kelly > Sent: Thursday, August 10, 2017 2:54 PM > To: ausnog@lists.ausnog.net<mailto:ausnog@lists.ausnog.net>; > ausnog-requ...@lists.ausnog.net<mailto:ausnog-requ...@lists.ausnog.net> > Subject: Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance -, 15th > August > > > > On 8/10/2017 10:13 AM, > ausnog-requ...@lists.ausnog.net<mailto:ausnog-requ...@lists.ausnog.net> wrote: >> From the latest update today, It appears that most of the works are >> being postponed for the time being >> >> Not all devices within racks support 2 feeds and planning is involved >> with these devices, which is why it is crucial to receive accurate >> information about any pending outages or upgrades to the NextDC DataCentres >> which affect services. > If these services are mission critical then you really should have duel PSU > units, so that when one feed gets taken offline the equipment automatically > switches to the other feed. They won't just di
Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance -, 15th August
+1 At least in this situation you'll likely get advanced notice your power is going to go away. When your gear has or sufferers from an unexpected PSU or other failure, you don't. This fundamentally goes to the difference between what availability you happen to get verses what availability you design and engineer to be assured to get. You'll eventually pay the price if you assume coincidental 100% past availability guaratees future 100% availability. It's pretending failure never occurs. If you think you are or would be paying a lot for redundancy, you probably haven't calculated the cost of down time of the service (e.g., lost customer sales, staff sitting around being paid yet unable to do their jobs). That cost of down time is likely to be well in excess of any redundancy costs. Technical infrastructure redundancy is a form of insurance. Would you go without theft, fire and other types of business insurance just because it has never happened to you before? On 11 Aug. 2017 04:54, "Mark Newton" wrote: As someone who has run colo facilities before: It should be made completely clear during customer onboarding that the facility operator can temporarily shut down a power feed at any time. Advance warning should be desirable but optional. If there is risk involved in doing that, it’s your job to mitigate it. The facility operator doesn’t know which bits of equipment in your tenancy are critical, and they’ve already told you to dual-feed where possible and use a rack-mount ATS for single-corded equipment. Power work should be done during business hours, because it’s almost impossible to get emergency support or source replacement equipment out of hours. If it isn’t safe to take a power feed offline during business hours, then you (the customer) have a design problem to solve. - mark > On Aug 10, 2017, at 6:56 AM, Nathan Brookfield < nathan.brookfi...@simtronic.com.au> wrote: > > Chad, > > That's all well and good but when you're paying a premium price for services of this fashion you expect a certain level of service. There is a risk no matter what when switching from power supplies taking extra load they would not usually take as well as swing load issues with PDU's. > > I completely agree with your sentiment but the risk is not to be ignored especially during those times. > > Kindest Regards, > Nathan Brookfield (VK2NAB) > > -Original Message- > From: AusNOG [mailto:ausnog-boun...@lists.ausnog.net] On Behalf Of Chad Kelly > Sent: Thursday, August 10, 2017 2:54 PM > To: ausnog@lists.ausnog.net; ausnog-requ...@lists.ausnog.net > Subject: Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance -, 15th August > > > > On 8/10/2017 10:13 AM, ausnog-requ...@lists.ausnog.net wrote: >> From the latest update today, It appears that most of the works are >> being postponed for the time being >> >> Not all devices within racks support 2 feeds and planning is involved >> with these devices, which is why it is crucial to receive accurate information about any pending outages or upgrades to the NextDC DataCentres which affect services. > If these services are mission critical then you really should have duel PSU units, so that when one feed gets taken offline the equipment automatically switches to the other feed. They won't just disconnect both feeds at once because that would be stupid and if the entire DC was offline for too much time then that would put the owners in a rather awkward situation legally, as after say 8 or 10 hours of downtime it wouldn't be good for the owners lets put it that way. > If the single PSU units are a part of a customers co-located equipment then really your terms of service agreement should exclude liability under your maintenance clauses. > I don't understand why anyone would be using single PSU equipment in a DC environment now a days when you can buy refurbished servers that come with two PSU as standard even when you buy them without raid. > Also for anything that is really really mission critical you should have it hosted in multiple datacentres anyway so if something stupid does happen that you can't control you at least still have services online as the load balanced services would just switch. > Regards Chad. > > -- > Chad Kelly > Manager > CPK Web Services > Phone 03 5273 0246 > Web www.cpkws.com.au > > ___ > AusNOG mailing list > AusNOG@lists.ausnog.net > http://lists.ausnog.net/mailman/listinfo/ausnog > ___ > AusNOG mailing list > AusNOG@lists.ausnog.net > http://lists.ausnog.net/mailman/listinfo/ausnog ___ AusNOG mailing list AusNOG@lists.ausnog.net http://lists.ausnog.net/mailman/listinfo/ausnog ___ AusNOG mailing list AusNOG@lists.ausnog.net http://lists.ausnog.net/mailman/listinfo/ausnog
Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance -, 15th August
Hi Simon, Thank you for getting back to the group we appreciate your input :) We are aware of the legal requirement to complete the checks every 5 years. Generally as we have seen in the industry thermals are taken of the boards to check for any hot spots which are then rectified, by a means of a maintenance window. If the hot spot is behind a breaker or within a breaker then an outage is a requirement to either replace the breaker or tighten Any loose connections, however if bus bars need to be tightened we have seen many cases of these being completed live using the appropriate OH&S safety equipment and Safe Work Method Statement. For sake of clarification, and from what you have explained, NextDC seem to be taking the safe route by de-energising The boards rather than work on them live. Is this because the design of the boards does not allow enough room for a safe work space and you deem this an OH&S high risk? The law component is the actual testing and not the outage itself. Kind Regards Shaun McGuane From: Simon Cooper [mailto:simon.coo...@nextdc.com] Sent: Friday, 11 August 2017 11:14 PM To: Shaun McGuane Cc: ausnog@lists.ausnog.net Subject: RE: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance -, 15th August Hi Shaun, Happy to clarify, and sorry it's taken me a while to get back to the group. Under the Electrical Safety Act compliance with AS3000 is mandatory. Under AS3000, and specifically AS3439, the owner of an electrical system (NEXTDC in this case) is responsible to institute a system of maintenance (aka planned maintenance program). Through that system the manufacturers recommendations should be addressed as well as the recommendations of AS2467. It specifically goes on to state that "Doing so will minimise the risk of injury or breakdown and any consequent human suffering and/or loss of supply." AS2467 suggests that indoor switchgear be examined (examination is more than inspection) at 5 year intervals. Examination includes ensuring that bus mounts and restraints are adequately torqued. Typical circuit breakers O&M manual advise that the devices are examined and tested in their 5th year of operation. Clearly complying to the above is best practice. Equally, no responsible owner would want to be in the position of having failed to comply, then to have something happen and have to explain how they had made all reasonable efforts to mitigate risk. In order to comply, both to examine the switchgear and to complete the circuit breaker manufacturer's advice, the switch board needs to be de-energised. WH&S practises dictate this, as do other parts of AS3000. There are certain circumstances under which work can be done on or near live boards, and certainly inspection is one of those - but examination is not and neither is testing a circuit breaker. Not quite as punchy as one of the ten commandments, but fundamentally - it's all based on safety. Trust that helps. As mentioned earlier, happy to discuss offline. Have a great weekend everyone. Best, Simon Simon Cooper Chief Operating Officer Direct: +61 7 3177 4721 Mobile: +61 488 235 624 Email: simon.coo...@nextdc.com<mailto:simon.coo...@nextdc.com> NEXTDC (ASX: NXT) www.nextdc.com<http://www.nextdc.com> From: Shaun McGuane [mailto:sh...@rackcentral.com] Sent: Friday, 11 August 2017 4:58 PM To: Simon Cooper mailto:simon.coo...@nextdc.com>> Cc: ausnog@lists.ausnog.net<mailto:ausnog@lists.ausnog.net> Subject: RE: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance -, 15th August Hi Simon, For the sake of clarification and not to question NextDC's position, would you mind sharing with us the Explanation of the Law that you are referring to with your response from yesterday? As if you are the only datacentre following this law then others need to follow suite and it would be good To understand if something is not being done that other providers are legally bound to do. Kind Regards Shaun McGuane From: AusNOG [mailto:ausnog-boun...@lists.ausnog.net] On Behalf Of Jared Hirst Sent: Friday, 11 August 2017 10:17 AM To: Mark Newton mailto:new...@atdot.dotat.org>>; Nathan Brookfield mailto:nathan.brookfi...@simtronic.com.au>> Cc: ausnog@lists.ausnog.net<mailto:ausnog@lists.ausnog.net>; ausnog-requ...@lists.ausnog.net<mailto:ausnog-requ...@lists.ausnog.net>; Chad Kelly mailto:c...@cpkws.com.au>> Subject: Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance -, 15th August Mark, Totally agree. I would just like to know what law Simon was referring too? Regards, Jared Hirst Servers Australia Pty Ltd Phone: +61 2 8115 8801 Email: jared.hi...@serversaustralia.com.au<mailto:jared.hi...@serversaustralia.com.au> From: AusNOG mailto:ausnog-boun...@lists.ausnog.net>> on behalf of Mark Newton mailto:new...@atdot.dota
Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance -, 15th August
It would be really nice if the next DC engineer responsible posted a
nice Blog post with the technical details. The vacuum is causing more
damage then it's worth i would think at this point.
Matt.
On 11/8/17 10:34 pm, Chad Kelly wrote:
Hi I did post the following link to the list the other day.
http://www.ohsrep.org.au/faqs/ohs-reps-@-work-electrical-safety-/electrical-equipment-what-are-the-lawsguidelines
but this could also just be a NextDC OH&S policy as well, as
regulation from government in the tech space can be interesting as
they are not always up to date with stuff.
On 8/11/2017 10:05 PM, Sam Silvester wrote:
Hey Chad,
That's a pretty general site you're pointing to.
Could you possibly be a bit more specific? Clicked through a couple
of links on it but everything was very high level.
As I noted elsewhere I am in SA but my employer is national so
keeping across all this is never a bad thing.
Cheers,
Sam
On Friday, 11 August 2017, Chad Kelly <mailto:c...@cpkws.com.au>> wrote:
It comes under the Victorian Occupational Health and safety Act
2004 from the bit of reading I did yesterday.
https://www.worksafe.vic.gov.au/laws/ohs
<https://www.worksafe.vic.gov.au/laws/ohs>
On 8/11/2017 10:17 AM, Jared Hirst wrote:
Mark,
Totally agree. I would just like to know what law Simon was
referring too?
Regards,
Jared Hirst
Servers Australia Pty Ltd
Phone: +61 2 8115 8801
Email: jared.hi...@serversaustralia.com.au
*From:* AusNOG
on behalf of Mark Newton
*Sent:* Friday, August 11, 2017 4:54:10 AM
*To:* Nathan Brookfield
*Cc:* ausnog@lists.ausnog.net
;
ausnog-requ...@lists.ausnog.net
;
Chad Kelly
*Subject:* Re: [AusNOG] NextDC Melbourne - Scheduled Power
Maintenance -, 15th August
As someone who has run colo facilities before:
It should be made completely clear during customer onboarding
that the facility operator can temporarily shut down a power
feed at any time. Advance warning should be desirable but optional.
If there is risk involved in doing that, it’s your job to
mitigate it. The facility operator doesn’t know which bits of
equipment in your tenancy are critical, and they’ve already told
you to dual-feed where possible and use a rack-mount ATS for
single-corded equipment.
Power work should be done during business hours, because it’s
almost impossible to get emergency support or source replacement
equipment out of hours.
If it isn’t safe to take a power feed offline during business
hours, then you (the customer) have a design problem to solve.
- mark
> On Aug 10, 2017, at 6:56 AM, Nathan Brookfield
wrote:
>
> Chad,
>
> That's all well and good but when you're paying a premium
price for services of this fashion you expect a certain level of
service. There is a risk no matter what when switching from
power supplies taking extra load they would not usually take as
well as swing load issues with PDU's.
>
> I completely agree with your sentiment but the risk is not to
be ignored especially during those times.
>
> Kindest Regards,
> Nathan Brookfield (VK2NAB)
>
> -Original Message-
> From: AusNOG [mailto:ausnog-boun...@lists.ausnog.net
]
On Behalf Of Chad Kelly
> Sent: Thursday, August 10, 2017 2:54 PM
> To: ausnog@lists.ausnog.net
;
ausnog-requ...@lists.ausnog.net
> Subject: Re: [AusNOG] NextDC Melbourne - Scheduled Power
Maintenance -, 15th August
>
>
>
> On 8/10/2017 10:13 AM, ausnog-requ...@lists.ausnog.net
wrote:
>> From the latest update today, It appears that most of the
works are
>> being postponed for the time being
>>
>> Not all devices within racks support 2 feeds and planning is
involved
>> with these devices, which is why it is crucial to receive
accurate information about any pending outages or upgrades to
the NextDC DataCentres which affect services.
> If these services are mission critical then you really should
have duel PSU units, so that when one feed gets taken offline
the equipment automatically switches to the other feed. They
won't just disconnect both feeds at once because that would be
stupid and if the entire DC was offline for too much time then
that would put the owners in a rather awkward situation legally,
as after say 8 or 10 hours of downtime it wouldn't be good for
the owners lets put it that way.
> If the single PSU units are a part of a customers co-located
equipment then really your terms of service
Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance -, 15th August
I don’t buy it. HV lines / boards / STS’s are worked on live all the time. Infact Equinix had maintenance this morning I believe or over this weekend on the A1 power and there was no disruptions. The issue I had was the way that it was ‘law’ to actually do this, not the OHS part. Someone should tell that to these guys about the OHS part ;) imagine that Job! https://youtu.be/x94BH9TUiHM Regards, Jared Hirst Servers Australia Pty Ltd Phone: +61 2 8115 8801 Email: jared.hi...@serversaustralia.com.au<mailto:jared.hi...@serversaustralia.com.au> From: Chad Kelly Sent: Friday, August 11, 2017 10:34:57 PM To: Sam Silvester Cc: Jared Hirst; Mark Newton; Nathan Brookfield; ausnog@lists.ausnog.net; ausnog-requ...@lists.ausnog.net Subject: Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance -, 15th August Hi I did post the following link to the list the other day. http://www.ohsrep.org.au/faqs/ohs-reps-@-work-electrical-safety-/electrical-equipment-what-are-the-lawsguidelines but this could also just be a NextDC OH&S policy as well, as regulation from government in the tech space can be interesting as they are not always up to date with stuff. On 8/11/2017 10:05 PM, Sam Silvester wrote: Hey Chad, That's a pretty general site you're pointing to. Could you possibly be a bit more specific? Clicked through a couple of links on it but everything was very high level. As I noted elsewhere I am in SA but my employer is national so keeping across all this is never a bad thing. Cheers, Sam On Friday, 11 August 2017, Chad Kelly mailto:c...@cpkws.com.au>> wrote: It comes under the Victorian Occupational Health and safety Act 2004 from the bit of reading I did yesterday. https://www.worksafe.vic.gov.au/laws/ohs On 8/11/2017 10:17 AM, Jared Hirst wrote: Mark, Totally agree. I would just like to know what law Simon was referring too? Regards, Jared Hirst Servers Australia Pty Ltd Phone: +61 2 8115 8801 Email: jared.hi...@serversaustralia.com.au From: AusNOG on behalf of Mark Newton Sent: Friday, August 11, 2017 4:54:10 AM To: Nathan Brookfield Cc: ausnog@lists.ausnog.net; ausnog-requ...@lists.ausnog.net; Chad Kelly Subject: Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance -, 15th August As someone who has run colo facilities before: It should be made completely clear during customer onboarding that the facility operator can temporarily shut down a power feed at any time. Advance warning should be desirable but optional. If there is risk involved in doing that, it’s your job to mitigate it. The facility operator doesn’t know which bits of equipment in your tenancy are critical, and they’ve already told you to dual-feed where possible and use a rack-mount ATS for single-corded equipment. Power work should be done during business hours, because it’s almost impossible to get emergency support or source replacement equipment out of hours. If it isn’t safe to take a power feed offline during business hours, then you (the customer) have a design problem to solve. - mark > On Aug 10, 2017, at 6:56 AM, Nathan Brookfield > wrote: > > Chad, > > That's all well and good but when you're paying a premium price for services > of this fashion you expect a certain level of service. There is a risk no > matter what when switching from power supplies taking extra load they would > not usually take as well as swing load issues with PDU's. > > I completely agree with your sentiment but the risk is not to be ignored > especially during those times. > > Kindest Regards, > Nathan Brookfield (VK2NAB) > > -Original Message- > From: AusNOG [mailto:ausnog-boun...@lists.ausnog.net] On Behalf Of Chad Kelly > Sent: Thursday, August 10, 2017 2:54 PM > To: ausnog@lists.ausnog.net; ausnog-requ...@lists.ausnog.net > Subject: Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance -, 15th > August > > > > On 8/10/2017 10:13 AM, ausnog-requ...@lists.ausnog.net wrote: >> From the latest update today, It appears that most of the works are >> being postponed for the time being >> >> Not all devices within racks support 2 feeds and planning is involved >> with these devices, which is why it is crucial to receive accurate >> information about any pending outages or upgrades to the NextDC DataCentres >> which affect services. > If these services are mission critical then you really should have duel PSU > units, so that when one feed gets taken offline the equipment automatically > switches to the other feed. They won't just disconnect both feeds at once > because that would be stupid and if the entire DC was offline for too much > time then that would put the owners in a rather awkward situation legally, as > after say 8 o
Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance -, 15th August
Hi I did post the following link to the list the other day.
http://www.ohsrep.org.au/faqs/ohs-reps-@-work-electrical-safety-/electrical-equipment-what-are-the-lawsguidelines
but this could also just be a NextDC OH&S policy as well, as regulation
from government in the tech space can be interesting as they are not
always up to date with stuff.
On 8/11/2017 10:05 PM, Sam Silvester wrote:
Hey Chad,
That's a pretty general site you're pointing to.
Could you possibly be a bit more specific? Clicked through a couple of
links on it but everything was very high level.
As I noted elsewhere I am in SA but my employer is national so keeping
across all this is never a bad thing.
Cheers,
Sam
On Friday, 11 August 2017, Chad Kelly <mailto:c...@cpkws.com.au>> wrote:
It comes under the Victorian Occupational Health and safety Act
2004 from the bit of reading I did yesterday.
https://www.worksafe.vic.gov.au/laws/ohs
<https://www.worksafe.vic.gov.au/laws/ohs>
On 8/11/2017 10:17 AM, Jared Hirst wrote:
Mark,
Totally agree. I would just like to know what law Simon was
referring too?
Regards,
Jared Hirst
Servers Australia Pty Ltd
Phone: +61 2 8115 8801
Email: jared.hi...@serversaustralia.com.au
*From:* AusNOG
on behalf of Mark Newton
*Sent:* Friday, August 11, 2017 4:54:10 AM
*To:* Nathan Brookfield
*Cc:* ausnog@lists.ausnog.net
;
ausnog-requ...@lists.ausnog.net
;
Chad Kelly
*Subject:* Re: [AusNOG] NextDC Melbourne - Scheduled Power
Maintenance -, 15th August
As someone who has run colo facilities before:
It should be made completely clear during customer onboarding
that the facility operator can temporarily shut down a power feed
at any time. Advance warning should be desirable but optional.
If there is risk involved in doing that, it’s your job to
mitigate it. The facility operator doesn’t know which bits of
equipment in your tenancy are critical, and they’ve already told
you to dual-feed where possible and use a rack-mount ATS for
single-corded equipment.
Power work should be done during business hours, because it’s
almost impossible to get emergency support or source replacement
equipment out of hours.
If it isn’t safe to take a power feed offline during business
hours, then you (the customer) have a design problem to solve.
- mark
> On Aug 10, 2017, at 6:56 AM, Nathan Brookfield
wrote:
>
> Chad,
>
> That's all well and good but when you're paying a premium price
for services of this fashion you expect a certain level of
service. There is a risk no matter what when switching from power
supplies taking extra load they would not usually take as well as
swing load issues with PDU's.
>
> I completely agree with your sentiment but the risk is not to
be ignored especially during those times.
>
> Kindest Regards,
> Nathan Brookfield (VK2NAB)
>
> -Original Message-
> From: AusNOG [mailto:ausnog-boun...@lists.ausnog.net
]
On Behalf Of Chad Kelly
> Sent: Thursday, August 10, 2017 2:54 PM
> To: ausnog@lists.ausnog.net
;
ausnog-requ...@lists.ausnog.net
> Subject: Re: [AusNOG] NextDC Melbourne - Scheduled Power
Maintenance -, 15th August
>
>
>
> On 8/10/2017 10:13 AM, ausnog-requ...@lists.ausnog.net
wrote:
>> From the latest update today, It appears that most of the
works are
>> being postponed for the time being
>>
>> Not all devices within racks support 2 feeds and planning is
involved
>> with these devices, which is why it is crucial to receive
accurate information about any pending outages or upgrades to the
NextDC DataCentres which affect services.
> If these services are mission critical then you really should
have duel PSU units, so that when one feed gets taken offline the
equipment automatically switches to the other feed. They won't
just disconnect both feeds at once because that would be stupid
and if the entire DC was offline for too much time then that
would put the owners in a rather awkward situation legally, as
after say 8 or 10 hours of downtime it wouldn't be good for the
owners lets put it that way.
> If the single PSU units are a part of a customers co-located
equipment then really your terms of service agreement should
exclude liability under your maintenance clauses.
> I don't understand why anyone would be using single PSU
equipment in a DC environment now a days when you can buy
refurbished servers that come with two PSU
Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance -, 15th August
Hey Chad, That's a pretty general site you're pointing to. Could you possibly be a bit more specific? Clicked through a couple of links on it but everything was very high level. As I noted elsewhere I am in SA but my employer is national so keeping across all this is never a bad thing. Cheers, Sam On Friday, 11 August 2017, Chad Kelly wrote: > It comes under the Victorian Occupational Health and safety Act 2004 from > the bit of reading I did yesterday. > > https://www.worksafe.vic.gov.au/laws/ohs > > On 8/11/2017 10:17 AM, Jared Hirst wrote: > > Mark, > > Totally agree. I would just like to know what law Simon was referring too? > > Regards, > > Jared Hirst > Servers Australia Pty Ltd > Phone: +61 2 8115 8801 > Email: jared.hi...@serversaustralia.com.au > > -- > *From:* AusNOG > on > behalf of Mark Newton > > *Sent:* Friday, August 11, 2017 4:54:10 AM > *To:* Nathan Brookfield > *Cc:* ausnog@lists.ausnog.net > ; > ausnog-requ...@lists.ausnog.net > ; Chad > Kelly > *Subject:* Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance -, > 15th August > > As someone who has run colo facilities before: > > It should be made completely clear during customer onboarding that the > facility operator can temporarily shut down a power feed at any time. > Advance warning should be desirable but optional. > > If there is risk involved in doing that, it’s your job to mitigate it. The > facility operator doesn’t know which bits of equipment in your tenancy are > critical, and they’ve already told you to dual-feed where possible and use > a rack-mount ATS for single-corded equipment. > > Power work should be done during business hours, because it’s almost > impossible to get emergency support or source replacement equipment out of > hours. > > If it isn’t safe to take a power feed offline during business hours, then > you (the customer) have a design problem to solve. > > - mark > > > > > > On Aug 10, 2017, at 6:56 AM, Nathan Brookfield > > > wrote: > > > > Chad, > > > > That's all well and good but when you're paying a premium price for > services of this fashion you expect a certain level of service. There is a > risk no matter what when switching from power supplies taking extra load > they would not usually take as well as swing load issues with PDU's. > > > > I completely agree with your sentiment but the risk is not to be ignored > especially during those times. > > > > Kindest Regards, > > Nathan Brookfield (VK2NAB) > > > > -Original Message----- > > From: AusNOG [mailto:ausnog-boun...@lists.ausnog.net > ] On > Behalf Of Chad Kelly > > Sent: Thursday, August 10, 2017 2:54 PM > > To: ausnog@lists.ausnog.net > ; > ausnog-requ...@lists.ausnog.net > > > Subject: Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance -, > 15th August > > > > > > > > On 8/10/2017 10:13 AM, ausnog-requ...@lists.ausnog.net > wrote: > >> From the latest update today, It appears that most of the works are > >> being postponed for the time being > >> > >> Not all devices within racks support 2 feeds and planning is involved > >> with these devices, which is why it is crucial to receive accurate > information about any pending outages or upgrades to the NextDC DataCentres > which affect services. > > If these services are mission critical then you really should have duel > PSU units, so that when one feed gets taken offline the equipment > automatically switches to the other feed. They won't just disconnect both > feeds at once because that would be stupid and if the entire DC was offline > for too much time then that would put the owners in a rather awkward > situation legally, as after say 8 or 10 hours of downtime it wouldn't be > good for the owners lets put it that way. > > If the single PSU units are a part of a customers co-located equipment > then really your terms of service agreement should exclude liability under > your maintenance clauses. > > I don't understand why anyone would be using single PSU equipment in a > DC environment now a days when you can buy refurbished servers that come > with two PSU as standard even when you buy them without raid. > > Also for anything that is really really mission critical you should have > it hosted in multiple datacentres anyway so if something stupid does happen > that you can't control you at least still have services online as the load > balanced services would just switch. > > Regards Chad. > > > > -- > > Chad Kelly
Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance -, 15th August
It comes under the Victorian Occupational Health and safety Act 2004 from the bit of reading I did yesterday. https://www.worksafe.vic.gov.au/laws/ohs On 8/11/2017 10:17 AM, Jared Hirst wrote: Mark, Totally agree. I would just like to know what law Simon was referring too? Regards, Jared Hirst Servers Australia Pty Ltd Phone: +61 2 8115 8801 Email: jared.hi...@serversaustralia.com.au <mailto:jared.hi...@serversaustralia.com.au> *From:* AusNOG on behalf of Mark Newton *Sent:* Friday, August 11, 2017 4:54:10 AM *To:* Nathan Brookfield *Cc:* ausnog@lists.ausnog.net; ausnog-requ...@lists.ausnog.net; Chad Kelly *Subject:* Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance -, 15th August As someone who has run colo facilities before: It should be made completely clear during customer onboarding that the facility operator can temporarily shut down a power feed at any time. Advance warning should be desirable but optional. If there is risk involved in doing that, it’s your job to mitigate it. The facility operator doesn’t know which bits of equipment in your tenancy are critical, and they’ve already told you to dual-feed where possible and use a rack-mount ATS for single-corded equipment. Power work should be done during business hours, because it’s almost impossible to get emergency support or source replacement equipment out of hours. If it isn’t safe to take a power feed offline during business hours, then you (the customer) have a design problem to solve. - mark > On Aug 10, 2017, at 6:56 AM, Nathan Brookfield wrote: > > Chad, > > That's all well and good but when you're paying a premium price for services of this fashion you expect a certain level of service. There is a risk no matter what when switching from power supplies taking extra load they would not usually take as well as swing load issues with PDU's. > > I completely agree with your sentiment but the risk is not to be ignored especially during those times. > > Kindest Regards, > Nathan Brookfield (VK2NAB) > > -Original Message- > From: AusNOG [mailto:ausnog-boun...@lists.ausnog.net] On Behalf Of Chad Kelly > Sent: Thursday, August 10, 2017 2:54 PM > To: ausnog@lists.ausnog.net; ausnog-requ...@lists.ausnog.net > Subject: Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance -, 15th August > > > > On 8/10/2017 10:13 AM, ausnog-requ...@lists.ausnog.net wrote: >> From the latest update today, It appears that most of the works are >> being postponed for the time being >> >> Not all devices within racks support 2 feeds and planning is involved >> with these devices, which is why it is crucial to receive accurate information about any pending outages or upgrades to the NextDC DataCentres which affect services. > If these services are mission critical then you really should have duel PSU units, so that when one feed gets taken offline the equipment automatically switches to the other feed. They won't just disconnect both feeds at once because that would be stupid and if the entire DC was offline for too much time then that would put the owners in a rather awkward situation legally, as after say 8 or 10 hours of downtime it wouldn't be good for the owners lets put it that way. > If the single PSU units are a part of a customers co-located equipment then really your terms of service agreement should exclude liability under your maintenance clauses. > I don't understand why anyone would be using single PSU equipment in a DC environment now a days when you can buy refurbished servers that come with two PSU as standard even when you buy them without raid. > Also for anything that is really really mission critical you should have it hosted in multiple datacentres anyway so if something stupid does happen that you can't control you at least still have services online as the load balanced services would just switch. > Regards Chad. > > -- > Chad Kelly > Manager > CPK Web Services > Phone 03 5273 0246 > Web www.cpkws.com.au <http://www.cpkws.com.au> > > ___ > AusNOG mailing list > AusNOG@lists.ausnog.net > http://lists.ausnog.net/mailman/listinfo/ausnog > ___ > AusNOG mailing list > AusNOG@lists.ausnog.net > http://lists.ausnog.net/mailman/listinfo/ausnog ___ AusNOG mailing list AusNOG@lists.ausnog.net http://lists.ausnog.net/mailman/listinfo/ausnog -- Chad Kelly Manager CPK Web Services Phone 03 5273 0246 Web www.cpkws.com.au ___ AusNOG mailing list AusNOG@lists.ausnog.net http://lists.ausnog.net/mailman/listinfo/ausnog
Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance -, 15th August
Hi Simon, For the sake of clarification and not to question NextDC's position, would you mind sharing with us the Explanation of the Law that you are referring to with your response from yesterday? As if you are the only datacentre following this law then others need to follow suite and it would be good To understand if something is not being done that other providers are legally bound to do. Kind Regards Shaun McGuane From: AusNOG [mailto:ausnog-boun...@lists.ausnog.net] On Behalf Of Jared Hirst Sent: Friday, 11 August 2017 10:17 AM To: Mark Newton ; Nathan Brookfield Cc: ausnog@lists.ausnog.net; ausnog-requ...@lists.ausnog.net; Chad Kelly Subject: Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance -, 15th August Mark, Totally agree. I would just like to know what law Simon was referring too? Regards, Jared Hirst Servers Australia Pty Ltd Phone: +61 2 8115 8801 Email: jared.hi...@serversaustralia.com.au<mailto:jared.hi...@serversaustralia.com.au> From: AusNOG mailto:ausnog-boun...@lists.ausnog.net>> on behalf of Mark Newton mailto:new...@atdot.dotat.org>> Sent: Friday, August 11, 2017 4:54:10 AM To: Nathan Brookfield Cc: ausnog@lists.ausnog.net<mailto:ausnog@lists.ausnog.net>; ausnog-requ...@lists.ausnog.net<mailto:ausnog-requ...@lists.ausnog.net>; Chad Kelly Subject: Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance -, 15th August As someone who has run colo facilities before: It should be made completely clear during customer onboarding that the facility operator can temporarily shut down a power feed at any time. Advance warning should be desirable but optional. If there is risk involved in doing that, it's your job to mitigate it. The facility operator doesn't know which bits of equipment in your tenancy are critical, and they've already told you to dual-feed where possible and use a rack-mount ATS for single-corded equipment. Power work should be done during business hours, because it's almost impossible to get emergency support or source replacement equipment out of hours. If it isn't safe to take a power feed offline during business hours, then you (the customer) have a design problem to solve. - mark > On Aug 10, 2017, at 6:56 AM, Nathan Brookfield > mailto:nathan.brookfi...@simtronic.com.au>> > wrote: > > Chad, > > That's all well and good but when you're paying a premium price for services > of this fashion you expect a certain level of service. There is a risk no > matter what when switching from power supplies taking extra load they would > not usually take as well as swing load issues with PDU's. > > I completely agree with your sentiment but the risk is not to be ignored > especially during those times. > > Kindest Regards, > Nathan Brookfield (VK2NAB) > > -Original Message- > From: AusNOG [mailto:ausnog-boun...@lists.ausnog.net] On Behalf Of Chad Kelly > Sent: Thursday, August 10, 2017 2:54 PM > To: ausnog@lists.ausnog.net<mailto:ausnog@lists.ausnog.net>; > ausnog-requ...@lists.ausnog.net<mailto:ausnog-requ...@lists.ausnog.net> > Subject: Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance -, 15th > August > > > > On 8/10/2017 10:13 AM, > ausnog-requ...@lists.ausnog.net<mailto:ausnog-requ...@lists.ausnog.net> wrote: >> From the latest update today, It appears that most of the works are >> being postponed for the time being >> >> Not all devices within racks support 2 feeds and planning is involved >> with these devices, which is why it is crucial to receive accurate >> information about any pending outages or upgrades to the NextDC DataCentres >> which affect services. > If these services are mission critical then you really should have duel PSU > units, so that when one feed gets taken offline the equipment automatically > switches to the other feed. They won't just disconnect both feeds at once > because that would be stupid and if the entire DC was offline for too much > time then that would put the owners in a rather awkward situation legally, as > after say 8 or 10 hours of downtime it wouldn't be good for the owners lets > put it that way. > If the single PSU units are a part of a customers co-located equipment then > really your terms of service agreement should exclude liability under your > maintenance clauses. > I don't understand why anyone would be using single PSU equipment in a DC > environment now a days when you can buy refurbished servers that come with > two PSU as standard even when you buy them without raid. > Also for anything that is really really mission critical you should have it > hosted in multiple datacentres anyw
Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance -, 15th August
Mark, Totally agree. I would just like to know what law Simon was referring too? Regards, Jared Hirst Servers Australia Pty Ltd Phone: +61 2 8115 8801 Email: jared.hi...@serversaustralia.com.au<mailto:jared.hi...@serversaustralia.com.au> From: AusNOG on behalf of Mark Newton Sent: Friday, August 11, 2017 4:54:10 AM To: Nathan Brookfield Cc: ausnog@lists.ausnog.net; ausnog-requ...@lists.ausnog.net; Chad Kelly Subject: Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance -, 15th August As someone who has run colo facilities before: It should be made completely clear during customer onboarding that the facility operator can temporarily shut down a power feed at any time. Advance warning should be desirable but optional. If there is risk involved in doing that, it’s your job to mitigate it. The facility operator doesn’t know which bits of equipment in your tenancy are critical, and they’ve already told you to dual-feed where possible and use a rack-mount ATS for single-corded equipment. Power work should be done during business hours, because it’s almost impossible to get emergency support or source replacement equipment out of hours. If it isn’t safe to take a power feed offline during business hours, then you (the customer) have a design problem to solve. - mark > On Aug 10, 2017, at 6:56 AM, Nathan Brookfield > wrote: > > Chad, > > That's all well and good but when you're paying a premium price for services > of this fashion you expect a certain level of service. There is a risk no > matter what when switching from power supplies taking extra load they would > not usually take as well as swing load issues with PDU's. > > I completely agree with your sentiment but the risk is not to be ignored > especially during those times. > > Kindest Regards, > Nathan Brookfield (VK2NAB) > > -Original Message- > From: AusNOG [mailto:ausnog-boun...@lists.ausnog.net] On Behalf Of Chad Kelly > Sent: Thursday, August 10, 2017 2:54 PM > To: ausnog@lists.ausnog.net; ausnog-requ...@lists.ausnog.net > Subject: Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance -, 15th > August > > > > On 8/10/2017 10:13 AM, ausnog-requ...@lists.ausnog.net wrote: >> From the latest update today, It appears that most of the works are >> being postponed for the time being >> >> Not all devices within racks support 2 feeds and planning is involved >> with these devices, which is why it is crucial to receive accurate >> information about any pending outages or upgrades to the NextDC DataCentres >> which affect services. > If these services are mission critical then you really should have duel PSU > units, so that when one feed gets taken offline the equipment automatically > switches to the other feed. They won't just disconnect both feeds at once > because that would be stupid and if the entire DC was offline for too much > time then that would put the owners in a rather awkward situation legally, as > after say 8 or 10 hours of downtime it wouldn't be good for the owners lets > put it that way. > If the single PSU units are a part of a customers co-located equipment then > really your terms of service agreement should exclude liability under your > maintenance clauses. > I don't understand why anyone would be using single PSU equipment in a DC > environment now a days when you can buy refurbished servers that come with > two PSU as standard even when you buy them without raid. > Also for anything that is really really mission critical you should have it > hosted in multiple datacentres anyway so if something stupid does happen that > you can't control you at least still have services online as the load > balanced services would just switch. > Regards Chad. > > -- > Chad Kelly > Manager > CPK Web Services > Phone 03 5273 0246 > Web www.cpkws.com.au<http://www.cpkws.com.au> > > ___ > AusNOG mailing list > AusNOG@lists.ausnog.net > http://lists.ausnog.net/mailman/listinfo/ausnog > ___ > AusNOG mailing list > AusNOG@lists.ausnog.net > http://lists.ausnog.net/mailman/listinfo/ausnog ___ AusNOG mailing list AusNOG@lists.ausnog.net http://lists.ausnog.net/mailman/listinfo/ausnog ___ AusNOG mailing list AusNOG@lists.ausnog.net http://lists.ausnog.net/mailman/listinfo/ausnog
Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - 15th August
An STS is more expensive, is only suitable for use when the two supplies are phase-synchronized, and typically runs at 99% thermal efficiency. While UPS power feeds should be phase-syncronized to mains, there are certain failure modes where they’ll drift, resulting in A and B losing sync; additionally, your colo provider might be powering your rack’s A and B supplies from different phases (if not today, then maybe tomorrow - it’s their prerogative) Also: The only reason an STS switches to a replacement supply is if the normal supply has failed, so it’s difficult to imagine how that can be a no-break operation anyway. A relay or contactor driven ATS typically has a high MTBF, doesn’t care about input phases at all, and runs with the same thermal efficiency as a piece of wire. The break in an ATS is circa 50 mSec, which is well within the endurance of the capacitors in the cheapest switch mode power supply you’re capable of buying. I’ve never seen IT equipment notice a rack ATS changeover. - mark > On Aug 10, 2017, at 4:24 AM, James Braunegg > wrote: > > Dear All > > Anyone with single power supply devices please do not look at getting an ATS, > get a STS !!! > > Short version > > ATS (Automatic Transfer Switch) will typically break power before it makes, > thus the connected device could reboot !! > > STS (Static Transfer Switch) will make power before it breaks, providing no > break to the power ! > > An example of a recommended device is below > > https://www.vertivco.com/en-asia/products-catalog/critical-power/power-transfer-switches/liebert-lts-63-to-400a/ > > <https://www.vertivco.com/en-asia/products-catalog/critical-power/power-transfer-switches/liebert-lts-63-to-400a/> > > Kindest Regards, > > James Braunegg > > 1300 769 972 / 0488 997 207 > ja...@micron21.com <mailto:ja...@micron21.com> > www.micron21.com/ <http://www.micron21.com/> > <http://www.micron21.com/> > <https://www.facebook.com/micron21/> > <https://twitter.com/micron21> > Follow us on Twitter <https://twitter.com/micron21> for important service and > system updates. > This message is intended for the addressee named above. It may contain > privileged or confidential information. If you are not the intended recipient > of this message you must not use, copy, distribute or disclose it to anyone > other than the addressee. If you have received this message in error please > return the message to the sender by replying to it and then delete the > message from your computer. > > > From: AusNOG [mailto:ausnog-boun...@lists.ausnog.net > <mailto:ausnog-boun...@lists.ausnog.net>] On Behalf Of Matthew Smee > Sent: Thursday, 10 August 2017 12:00 PM > To: ausnog@lists.ausnog.net <mailto:ausnog@lists.ausnog.net> > Subject: Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - 15th > August > > +1 > Every DC agreement I’ve seen (3) have mentioned that you are responsible for > supplying it with power and they aren’t responsible if it loses power (i.e. > use an ATS). > > From: AusNOG [mailto:ausnog-boun...@lists.ausnog.net > <mailto:ausnog-boun...@lists.ausnog.net>] On Behalf Of Sam Silvester > Sent: Thursday, 10 August 2017 10:14 AM > To: Shaun McGuane mailto:sh...@rackcentral.com>> > Cc: ausnog@lists.ausnog.net <mailto:ausnog@lists.ausnog.net> > Subject: Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - 15th > August > > If you have single fed equipment in your rack that needs planning before it > can be shut down, do you not run a totally forseeable and preventable risk > then should that one feed trip? > > This is what ATS are for. > > Sam > > > > On Thursday, 10 August 2017, Shaun McGuane <mailto:sh...@rackcentral.com>> wrote: > HI Simon, > > Thank you for your input to the list. > > While you may have provided notifications well in advance, your schedule > provided has been changed multiple times and this creates confusion. > Without asking for further clarification last night I would never have > received the following updated schedule from Craig Armstrong today. > > Data Hall 2 – B feed (west/blue PDU side) Tuesday 15th Aug, A feed has been > pushed back to later date around November, you will receive official notice > once new date confirmed. > Data Hall 3 –A and B feed has been pushed back to later date around > October/November, you will receive official notice once new date confirmed. > Data Hall 4 –A and B feed has been pushed back to later date around > October/November, you will receive official notice once new date confirmed. > > From the latest update today, It
Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance -, 15th August
As someone who has run colo facilities before: It should be made completely clear during customer onboarding that the facility operator can temporarily shut down a power feed at any time. Advance warning should be desirable but optional. If there is risk involved in doing that, it’s your job to mitigate it. The facility operator doesn’t know which bits of equipment in your tenancy are critical, and they’ve already told you to dual-feed where possible and use a rack-mount ATS for single-corded equipment. Power work should be done during business hours, because it’s almost impossible to get emergency support or source replacement equipment out of hours. If it isn’t safe to take a power feed offline during business hours, then you (the customer) have a design problem to solve. - mark > On Aug 10, 2017, at 6:56 AM, Nathan Brookfield > wrote: > > Chad, > > That's all well and good but when you're paying a premium price for services > of this fashion you expect a certain level of service. There is a risk no > matter what when switching from power supplies taking extra load they would > not usually take as well as swing load issues with PDU's. > > I completely agree with your sentiment but the risk is not to be ignored > especially during those times. > > Kindest Regards, > Nathan Brookfield (VK2NAB) > > -Original Message- > From: AusNOG [mailto:ausnog-boun...@lists.ausnog.net] On Behalf Of Chad Kelly > Sent: Thursday, August 10, 2017 2:54 PM > To: ausnog@lists.ausnog.net; ausnog-requ...@lists.ausnog.net > Subject: Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance -, 15th > August > > > > On 8/10/2017 10:13 AM, ausnog-requ...@lists.ausnog.net wrote: >> From the latest update today, It appears that most of the works are >> being postponed for the time being >> >> Not all devices within racks support 2 feeds and planning is involved >> with these devices, which is why it is crucial to receive accurate >> information about any pending outages or upgrades to the NextDC DataCentres >> which affect services. > If these services are mission critical then you really should have duel PSU > units, so that when one feed gets taken offline the equipment automatically > switches to the other feed. They won't just disconnect both feeds at once > because that would be stupid and if the entire DC was offline for too much > time then that would put the owners in a rather awkward situation legally, as > after say 8 or 10 hours of downtime it wouldn't be good for the owners lets > put it that way. > If the single PSU units are a part of a customers co-located equipment then > really your terms of service agreement should exclude liability under your > maintenance clauses. > I don't understand why anyone would be using single PSU equipment in a DC > environment now a days when you can buy refurbished servers that come with > two PSU as standard even when you buy them without raid. > Also for anything that is really really mission critical you should have it > hosted in multiple datacentres anyway so if something stupid does happen that > you can't control you at least still have services online as the load > balanced services would just switch. > Regards Chad. > > -- > Chad Kelly > Manager > CPK Web Services > Phone 03 5273 0246 > Web www.cpkws.com.au > > ___ > AusNOG mailing list > AusNOG@lists.ausnog.net > http://lists.ausnog.net/mailman/listinfo/ausnog > ___ > AusNOG mailing list > AusNOG@lists.ausnog.net > http://lists.ausnog.net/mailman/listinfo/ausnog ___ AusNOG mailing list AusNOG@lists.ausnog.net http://lists.ausnog.net/mailman/listinfo/ausnog
Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - 15th August
We have a tech on site tomorrow morning in Brisbane to do live works on a major DC panel, they need a look out with a torch, insulating matting and a few other things but it's legal. James On Thu, 10 Aug 2017, at 16:04, Sam Silvester wrote: > I also am unaware of such a law. Simon, can you advise? > > I'm told in QLD that live works are not permitted, but I am in SA so I > have not really bothered too much to check if that is hearsay or true.> > On Thursday, 10 August 2017, Jared Hirst > wrote:>> >> Hi Simon, >> >> Maybe it could be helpful to the Ausnog list to point us to that law >> you refer too?>> >> As I personally have never heard or seen this done in any DC in >> Australia, or the world in the past 15 years I have been housing gear >> in Data Centres.>> >> I agree that gear should have 2N, and it doesn’t affect me, but there >> are people that have equipment that have single fed devices, and I >> believe you don’t allow self installed STS devices to be installed? I >> could be wrong.>> >> In any case, it would be interesting to see the law the requires you >> to shut down boards.>> >> Regards, >> >> Jared Hirst >> Servers Australia Pty Ltd >> Phone: +61 2 8115 8801 >> Email: jared.hi...@serversaustralia.com.au >> >> *From:* AusNOG on behalf of Simon >> Cooper *Sent:* Thursday, August 10, 2017 8:39:13 AM >> *To:* ausnog@lists.ausnog.net *Subject:* Re: [AusNOG] NextDC >> Melbourne - Scheduled Power Maintenance - 15th August>> >> Thanks guys, appreciate the feedback. >> >> At NEXTDC we work very hard to keep critical infrastructure >> maintenance that impacts racks or the environment within the data >> hall to an absolute minimum.>> >> However, some works are required to happen from time to time by law >> and one of those activities is a de-energisation and inspection of >> each of our major switchboards. This is all about ensuring that the >> electrical system is safe, and is an unavoidable piece of work. >> Rightly so.>> >> Every rack in a NEXTDC data centre has 2N power feeds offered to it, >> and we highly recommend that they are used for every device in the >> rack. This occasional maintenance is one of the many reasons we >> provide this capability. Any device using the 2N supplies (aka A & B >> feeds) will simply see its power swing from one feed to the other. >> Any rack that is drawing no more that its contracted power level will >> have no issue when all devices move from A to B or vice versa.>> >> Our notifications were made well in advance, as we want to give >> customers time to consider the management of these works and we don't >> assume that every rack is perfectly deployed: We are here 24/7 to >> assist customers with rack inspections or specific circuit down tests >> or maybe a controlled move prior to the day (e.g. for devices that >> are single fed).>> >> Also, as we work though those discussions with customers we >> understand the timing in relation to their businesses, and we work >> very hard to coordinate schedules despite each switch board >> supporting many different customers and customer instances across the >> data centre. Occasionally that means we have to make a difficult >> decisions which may result in schedule changes. When that does >> happen, we do not compromise our notification periods.>> >> I'll be happy to discuss these works with anyone - probably best >> offline or on the phone - but trust me when I say we are doing our >> absolute best to keep your data centre operating safely and reliably >> for many years to come.>> >> Thanks, >> Simon >> COO, NEXTDC >> >>> -Original Message- >>> *From:* nat...@nightsys.net >>> *Sent:* Thu, 10 Aug 2017 05:39:02 +1000 >>> *To:* sh...@rackcentral.com >>> *Subject:* Re: [AusNOG] NextDC Melbourne - Scheduled Power >>> Maintenance - 15th August>>> >>> This seems reasonable? As long as no single Data Hall has both A and >>> B feeds removed simultaneously, that seems normal. Doing B on Hall 2 >>> and A on Hall 3 on the same day does seem slightly adventurous, but >>> not entirely unreasonable (mostly in terms of if something goes bad >>> in both, staff get stretched thin remediating issues).>>> >>> A and B feeds are designed to provide redundancy to equipment, >>> allowing one feed to fail and systems to continue on the other. >>> Anything mission critical should
Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance -, 15th August
Yeah bit of a dammed if you do, dammed if you don't type situation. On 8/10/2017 4:11 PM, Peter Tiggerdine wrote: disagree. Outside of business hours costs more with limited staff around to assist. They're doing you a favour by doing this because if your PSU fails on server, you'll have time raise tickets with vendor and get same day resolution. Regards, Peter Tiggerdine GPG Fingerprint: 2A3F EA19 F6C2 93C1 411D 5AB2 D5A8 E8A8 0E74 6127 On Thu, Aug 10, 2017 at 3:14 PM, Chad Kelly wrote: Hmm yes actually deciding to do this during business hours does appear to be an odd choice, even with two PSU in the server, they would be better off doing this out of business hours I would of thought. Regards Chad. On 8/10/2017 2:56 PM, Nathan Brookfield wrote: Chad, That's all well and good but when you're paying a premium price for services of this fashion you expect a certain level of service. There is a risk no matter what when switching from power supplies taking extra load they would not usually take as well as swing load issues with PDU's. I completely agree with your sentiment but the risk is not to be ignored especially during those times. Kindest Regards, Nathan Brookfield (VK2NAB) -Original Message- From: AusNOG [mailto:ausnog-boun...@lists.ausnog.net] On Behalf Of Chad Kelly Sent: Thursday, August 10, 2017 2:54 PM To: ausnog@lists.ausnog.net; ausnog-requ...@lists.ausnog.net Subject: Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance -, 15th August On 8/10/2017 10:13 AM, ausnog-requ...@lists.ausnog.net wrote: From the latest update today, It appears that most of the works are being postponed for the time being Not all devices within racks support 2 feeds and planning is involved with these devices, which is why it is crucial to receive accurate information about any pending outages or upgrades to the NextDC DataCentres which affect services. If these services are mission critical then you really should have duel PSU units, so that when one feed gets taken offline the equipment automatically switches to the other feed. They won't just disconnect both feeds at once because that would be stupid and if the entire DC was offline for too much time then that would put the owners in a rather awkward situation legally, as after say 8 or 10 hours of downtime it wouldn't be good for the owners lets put it that way. If the single PSU units are a part of a customers co-located equipment then really your terms of service agreement should exclude liability under your maintenance clauses. I don't understand why anyone would be using single PSU equipment in a DC environment now a days when you can buy refurbished servers that come with two PSU as standard even when you buy them without raid. Also for anything that is really really mission critical you should have it hosted in multiple datacentres anyway so if something stupid does happen that you can't control you at least still have services online as the load balanced services would just switch. Regards Chad. -- Chad Kelly Manager CPK Web Services Phone 03 5273 0246 Web www.cpkws.com.au ___ AusNOG mailing list AusNOG@lists.ausnog.net http://lists.ausnog.net/mailman/listinfo/ausnog -- Chad Kelly Manager CPK Web Services Phone 03 5273 0246 Web www.cpkws.com.au ___ AusNOG mailing list AusNOG@lists.ausnog.net http://lists.ausnog.net/mailman/listinfo/ausnog -- Chad Kelly Manager CPK Web Services Phone 03 5273 0246 Web www.cpkws.com.au ___ AusNOG mailing list AusNOG@lists.ausnog.net http://lists.ausnog.net/mailman/listinfo/ausnog
Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance -, 15th August
disagree. Outside of business hours costs more with limited staff around to assist. They're doing you a favour by doing this because if your PSU fails on server, you'll have time raise tickets with vendor and get same day resolution. Regards, Peter Tiggerdine GPG Fingerprint: 2A3F EA19 F6C2 93C1 411D 5AB2 D5A8 E8A8 0E74 6127 On Thu, Aug 10, 2017 at 3:14 PM, Chad Kelly wrote: > > Hmm yes actually deciding to do this during business hours does appear to be > an odd choice, even with two PSU in the server, they would be better off > doing this out of business hours I would of thought. > Regards Chad. > > > On 8/10/2017 2:56 PM, Nathan Brookfield wrote: >> >> Chad, >> >> That's all well and good but when you're paying a premium price for >> services of this fashion you expect a certain level of service. There is a >> risk no matter what when switching from power supplies taking extra load >> they would not usually take as well as swing load issues with PDU's. >> >> I completely agree with your sentiment but the risk is not to be ignored >> especially during those times. >> >> Kindest Regards, >> Nathan Brookfield (VK2NAB) >> >> -Original Message- >> From: AusNOG [mailto:ausnog-boun...@lists.ausnog.net] On Behalf Of Chad >> Kelly >> Sent: Thursday, August 10, 2017 2:54 PM >> To: ausnog@lists.ausnog.net; ausnog-requ...@lists.ausnog.net >> Subject: Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance -, >> 15th August >> >> >> >> On 8/10/2017 10:13 AM, ausnog-requ...@lists.ausnog.net wrote: >>> >>> From the latest update today, It appears that most of the works are >>> being postponed for the time being >>> >>> Not all devices within racks support 2 feeds and planning is involved >>> with these devices, which is why it is crucial to receive accurate >>> information about any pending outages or upgrades to the NextDC DataCentres >>> which affect services. >> >> If these services are mission critical then you really should have duel >> PSU units, so that when one feed gets taken offline the equipment >> automatically switches to the other feed. They won't just disconnect both >> feeds at once because that would be stupid and if the entire DC was offline >> for too much time then that would put the owners in a rather awkward >> situation legally, as after say 8 or 10 hours of downtime it wouldn't be >> good for the owners lets put it that way. >> If the single PSU units are a part of a customers co-located equipment >> then really your terms of service agreement should exclude liability under >> your maintenance clauses. >> I don't understand why anyone would be using single PSU equipment in a DC >> environment now a days when you can buy refurbished servers that come with >> two PSU as standard even when you buy them without raid. >> Also for anything that is really really mission critical you should have >> it hosted in multiple datacentres anyway so if something stupid does happen >> that you can't control you at least still have services online as the load >> balanced services would just switch. >> Regards Chad. >> >> -- >> Chad Kelly >> Manager >> CPK Web Services >> Phone 03 5273 0246 >> Web www.cpkws.com.au >> >> ___ >> AusNOG mailing list >> AusNOG@lists.ausnog.net >> http://lists.ausnog.net/mailman/listinfo/ausnog > > > -- > Chad Kelly > Manager > CPK Web Services > Phone 03 5273 0246 > Web www.cpkws.com.au > > ___ > AusNOG mailing list > AusNOG@lists.ausnog.net > http://lists.ausnog.net/mailman/listinfo/ausnog ___ AusNOG mailing list AusNOG@lists.ausnog.net http://lists.ausnog.net/mailman/listinfo/ausnog
Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - 15th August
Hi James, A quick Google tells me APC ATS are break before make, so that is certainly not the defining feature of an ATS vs. STS. For cost effective provision of a 'C feed' in racks to catch those pesky single corded devices you just can't live without I see no reason at all to go to the expense of typically larger and more expensive STS, happy to learn more though. Sam On Thursday, 10 August 2017, James Braunegg wrote: > Dear All > > > > Anyone with single power supply devices please do not look at getting an > ATS, get a STS !!! > > > > *Short version* > > > > ATS (Automatic Transfer Switch) will typically break power before it > makes, thus the connected device could reboot !! > > > > STS (Static Transfer Switch) will make power before it breaks, providing > no break to the power ! > > > > An example of a recommended device is below > > > > https://www.vertivco.com/en-asia/products-catalog/ > critical-power/power-transfer-switches/liebert-lts-63-to-400a/ > > > > Kindest Regards, > > > > *James Braunegg* > > [image: cid:image001.png@01D280A4.01865B60] > > 1300 769 972 / 0488 997 207 <1300%20769%20972> > > *ja...@micron21.com * > > www.micron21.com/ > > [image: cid:image002.png@01D280A4.01865B60] <http://www.micron21.com/> > > [image: cid:image003.png@01D280A4.01865B60] > <https://www.facebook.com/micron21/> > > [image: cid:image004.png@01D280A4.01865B60] <https://twitter.com/micron21> > > Follow us on Twitter <https://twitter.com/micron21> for important service > and system updates. > > This message is intended for the addressee named above. It may contain > privileged or confidential information. If you are not the intended > recipient of this message you must not use, copy, distribute or disclose it > to anyone other than the addressee. If you have received this message in > error please return the message to the sender by replying to it and then > delete the message from your computer. > > > > > > *From:* AusNOG [mailto:ausnog-boun...@lists.ausnog.net > ] *On > Behalf Of *Matthew Smee > *Sent:* Thursday, 10 August 2017 12:00 PM > *To:* ausnog@lists.ausnog.net > > *Subject:* Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - > 15th August > > > > +1 > > Every DC agreement I’ve seen (3) have mentioned that you are responsible > for supplying it with power and they aren’t responsible if it loses power > (i.e. use an ATS). > > > > *From:* AusNOG [mailto:ausnog-boun...@lists.ausnog.net > ] *On > Behalf Of *Sam Silvester > *Sent:* Thursday, 10 August 2017 10:14 AM > *To:* Shaun McGuane > > *Cc:* ausnog@lists.ausnog.net > > *Subject:* Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - > 15th August > > > > If you have single fed equipment in your rack that needs planning before > it can be shut down, do you not run a totally forseeable and preventable > risk then should that one feed trip? > > > > This is what ATS are for. > > > > Sam > > > > > > On Thursday, 10 August 2017, Shaun McGuane > wrote: > > HI Simon, > > > > Thank you for your input to the list. > > > > While you may have provided notifications well in advance, your schedule > provided has been changed multiple times and this creates confusion. > > Without asking for further clarification last night I would never have > received the following updated schedule from Craig Armstrong today. > > > > Data Hall 2 – B feed (west/blue PDU side) Tuesday 15th Aug, A feed has > been pushed back to later date around November, you will receive official > notice once new date confirmed. > > Data Hall 3 –A and B feed has been pushed back to later date around > October/November, you will receive official notice once new date confirmed. > > Data Hall 4 –A and B feed has been pushed back to later date around > October/November, you will receive official notice once new date confirmed. > > > > From the latest update today, It appears that most of the works are being > postponed for the time being > > > > Not all devices within racks support 2 feeds and planning is involved with > these devices, which is why it is crucial to receive accurate information > about any pending outages or upgrades > to the NextDC DataCentres which affect services. > > > > Additionally, I have not received these updates via the normal NextDC > E-Mail communication method, so I am sure other customers will be wondering > whats happening too. > > > > Happy to have a conversation offline about this feel free to give me a > ca
Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - 15th August
Yes but the wording was; “However, some works are required to happen from time to time by law and one of those activities is a de-energisation and inspection of each of our major switchboards” I have never heard of a law that requires de-energisation of a board for inspection. Our electricians (Schneider) do this live, with Flir Heat mapping equipment and many other cool tools. Regards, Jared Hirst Servers Australia Pty Ltd Phone: +61 2 8115 8801 Email: jared.hi...@serversaustralia.com.au From: Sam Silvester Sent: Thursday, August 10, 2017 4:04:29 PM To: Jared Hirst Cc: Simon Cooper; ausnog@lists.ausnog.net Subject: Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - 15th August I also am unaware of such a law. Simon, can you advise? I'm told in QLD that live works are not permitted, but I am in SA so I have not really bothered too much to check if that is hearsay or true. On Thursday, 10 August 2017, Jared Hirst mailto:jared.hi...@serversaustralia.com.au>> wrote: Hi Simon, Maybe it could be helpful to the Ausnog list to point us to that law you refer too? As I personally have never heard or seen this done in any DC in Australia, or the world in the past 15 years I have been housing gear in Data Centres. I agree that gear should have 2N, and it doesn’t affect me, but there are people that have equipment that have single fed devices, and I believe you don’t allow self installed STS devices to be installed? I could be wrong. In any case, it would be interesting to see the law the requires you to shut down boards. Regards, Jared Hirst Servers Australia Pty Ltd Phone: +61 2 8115 8801 Email: jared.hi...@serversaustralia.com.au From: AusNOG on behalf of Simon Cooper Sent: Thursday, August 10, 2017 8:39:13 AM To: ausnog@lists.ausnog.net Subject: Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - 15th August Thanks guys, appreciate the feedback. At NEXTDC we work very hard to keep critical infrastructure maintenance that impacts racks or the environment within the data hall to an absolute minimum. However, some works are required to happen from time to time by law and one of those activities is a de-energisation and inspection of each of our major switchboards. This is all about ensuring that the electrical system is safe, and is an unavoidable piece of work. Rightly so. Every rack in a NEXTDC data centre has 2N power feeds offered to it, and we highly recommend that they are used for every device in the rack. This occasional maintenance is one of the many reasons we provide this capability. Any device using the 2N supplies (aka A & B feeds) will simply see its power swing from one feed to the other. Any rack that is drawing no more that its contracted power level will have no issue when all devices move from A to B or vice versa. Our notifications were made well in advance, as we want to give customers time to consider the management of these works and we don't assume that every rack is perfectly deployed: We are here 24/7 to assist customers with rack inspections or specific circuit down tests or maybe a controlled move prior to the day (e.g. for devices that are single fed). Also, as we work though those discussions with customers we understand the timing in relation to their businesses, and we work very hard to coordinate schedules despite each switch board supporting many different customers and customer instances across the data centre. Occasionally that means we have to make a difficult decisions which may result in schedule changes. When that does happen, we do not compromise our notification periods. I'll be happy to discuss these works with anyone - probably best offline or on the phone - but trust me when I say we are doing our absolute best to keep your data centre operating safely and reliably for many years to come. Thanks, Simon COO, NEXTDC -Original Message- From: nat...@nightsys.net Sent: Thu, 10 Aug 2017 05:39:02 +1000 To: sh...@rackcentral.com Subject: Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - 15th August This seems reasonable? As long as no single Data Hall has both A and B feeds removed simultaneously, that seems normal. Doing B on Hall 2 and A on Hall 3 on the same day does seem slightly adventurous, but not entirely unreasonable (mostly in terms of if something goes bad in both, staff get stretched thin remediating issues). A and B feeds are designed to provide redundancy to equipment, allowing one feed to fail and systems to continue on the other. Anything mission critical should be able to draw from either feed as required (dual PSU), and if there is a power deficit on one feed (causing circuits to trip), that would imply the circuits are incorrectly sized? In addition, anything mission critical with a single power supply would be on an ATS you would assume, or a p
Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - 15th August
I also am unaware of such a law. Simon, can you advise? I'm told in QLD that live works are not permitted, but I am in SA so I have not really bothered too much to check if that is hearsay or true. On Thursday, 10 August 2017, Jared Hirst < jared.hi...@serversaustralia.com.au> wrote: > Hi Simon, > > Maybe it could be helpful to the Ausnog list to point us to that law you > refer too? > > As I personally have never heard or seen this done in any DC in Australia, > or the world in the past 15 years I have been housing gear in Data Centres. > > I agree that gear should have 2N, and it doesn’t affect me, but there are > people that have equipment that have single fed devices, and I believe you > don’t allow self installed STS devices to be installed? I could be wrong. > > In any case, it would be interesting to see the law the requires you to > shut down boards. > > Regards, > > Jared Hirst > Servers Australia Pty Ltd > Phone: +61 2 8115 8801 > Email: jared.hi...@serversaustralia.com.au > > -- > *From:* AusNOG > on > behalf of Simon Cooper > > *Sent:* Thursday, August 10, 2017 8:39:13 AM > *To:* ausnog@lists.ausnog.net > > *Subject:* Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - > 15th August > > Thanks guys, appreciate the feedback. > > At NEXTDC we work very hard to keep critical infrastructure maintenance > that impacts racks or the environment within the data hall to an absolute > minimum. > > However, some works are required to happen from time to time by law and > one of those activities is a de-energisation and inspection of each of our > major switchboards. This is all about ensuring that the electrical system > is safe, and is an unavoidable piece of work. Rightly so. > > Every rack in a NEXTDC data centre has 2N power feeds offered to it, and > we highly recommend that they are used for every device in the rack. This > occasional maintenance is one of the many reasons we provide this > capability. Any device using the 2N supplies (aka A & B feeds) will simply > see its power swing from one feed to the other. Any rack that is drawing > no more that its contracted power level will have no issue when all devices > move from A to B or vice versa. > > Our notifications were made well in advance, as we want to give customers > time to consider the management of these works and we don't assume that > every rack is perfectly deployed: We are here 24/7 to assist customers > with rack inspections or specific circuit down tests or maybe a controlled > move prior to the day (e.g. for devices that are single fed). > > Also, as we work though those discussions with customers we understand the > timing in relation to their businesses, and we work very hard to coordinate > schedules despite each switch board supporting many different customers and > customer instances across the data centre. Occasionally that means we have > to make a difficult decisions which may result in schedule changes. When > that does happen, we do not compromise our notification periods. > > I'll be happy to discuss these works with anyone - probably best offline > or on the phone - but trust me when I say we are doing our absolute best to > keep your data centre operating safely and reliably for many years to come. > > Thanks, > Simon > COO, NEXTDC > > -Original Message- > *From:* nat...@nightsys.net > > *Sent:* Thu, 10 Aug 2017 05:39:02 +1000 > *To:* sh...@rackcentral.com > > *Subject:* Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - > 15th August > > This seems reasonable? As long as no single Data Hall has both A and B > feeds removed simultaneously, that seems normal. Doing B on Hall 2 and A on > Hall 3 on the same day does seem slightly adventurous, but not entirely > unreasonable (mostly in terms of if something goes bad in both, staff get > stretched thin remediating issues). > > A and B feeds are designed to provide redundancy to equipment, allowing > one feed to fail and systems to continue on the other. Anything mission > critical should be able to draw from either feed as required (dual PSU), > and if there is a power deficit on one feed (causing circuits to trip), > that would imply the circuits are incorrectly sized? > > In addition, anything mission critical with a single power supply would be > on an ATS you would assume, or a pair of equivalent devices installed with > one on each rail? > > Things break in datacentres, planned maintenance happens sometimes, better > than no maintenance at all :) The fact they are notifying you is better > than not, and it being scheduled is probably still better than unscheduled &
Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - 15th, August
On 8/10/2017 2:47 PM, ausnog-requ...@lists.ausnog.net wrote: Maybe it could be helpful to the Ausnog list to point us to that law you refer too? As I personally have never heard or seen this done in any DC in Australia, or the world in the past 15 years I have been housing gear in Data Centres. I agree that gear should have 2N, and it doesn?t affect me, but there are people that have equipment that have single fed devices, and I believe you don?t allow self installed STS devices to be installed? I could be wrong. In any case, it would be interesting to see the law the requires you to shut down boards. Given you own a few DC's in NSW it would pay to check the OHS laws in that state, but the Electrical safety stuff comes under those laws hear in Vic. http://www.ohsrep.org.au/faqs/ohs-reps-@-work-electrical-safety-/electrical-equipment-what-are-the-lawsguidelines So basically its more red tape from government. Not sure when they last did it but Micron21 have had to do similar work in the last few years as well. Regards Chad. -- Chad Kelly Manager CPK Web Services Phone 03 5273 0246 Web www.cpkws.com.au ___ AusNOG mailing list AusNOG@lists.ausnog.net http://lists.ausnog.net/mailman/listinfo/ausnog
Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance -, 15th August
Hmm yes actually deciding to do this during business hours does appear to be an odd choice, even with two PSU in the server, they would be better off doing this out of business hours I would of thought. Regards Chad. On 8/10/2017 2:56 PM, Nathan Brookfield wrote: Chad, That's all well and good but when you're paying a premium price for services of this fashion you expect a certain level of service. There is a risk no matter what when switching from power supplies taking extra load they would not usually take as well as swing load issues with PDU's. I completely agree with your sentiment but the risk is not to be ignored especially during those times. Kindest Regards, Nathan Brookfield (VK2NAB) -Original Message- From: AusNOG [mailto:ausnog-boun...@lists.ausnog.net] On Behalf Of Chad Kelly Sent: Thursday, August 10, 2017 2:54 PM To: ausnog@lists.ausnog.net; ausnog-requ...@lists.ausnog.net Subject: Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance -, 15th August On 8/10/2017 10:13 AM, ausnog-requ...@lists.ausnog.net wrote: From the latest update today, It appears that most of the works are being postponed for the time being Not all devices within racks support 2 feeds and planning is involved with these devices, which is why it is crucial to receive accurate information about any pending outages or upgrades to the NextDC DataCentres which affect services. If these services are mission critical then you really should have duel PSU units, so that when one feed gets taken offline the equipment automatically switches to the other feed. They won't just disconnect both feeds at once because that would be stupid and if the entire DC was offline for too much time then that would put the owners in a rather awkward situation legally, as after say 8 or 10 hours of downtime it wouldn't be good for the owners lets put it that way. If the single PSU units are a part of a customers co-located equipment then really your terms of service agreement should exclude liability under your maintenance clauses. I don't understand why anyone would be using single PSU equipment in a DC environment now a days when you can buy refurbished servers that come with two PSU as standard even when you buy them without raid. Also for anything that is really really mission critical you should have it hosted in multiple datacentres anyway so if something stupid does happen that you can't control you at least still have services online as the load balanced services would just switch. Regards Chad. -- Chad Kelly Manager CPK Web Services Phone 03 5273 0246 Web www.cpkws.com.au ___ AusNOG mailing list AusNOG@lists.ausnog.net http://lists.ausnog.net/mailman/listinfo/ausnog -- Chad Kelly Manager CPK Web Services Phone 03 5273 0246 Web www.cpkws.com.au ___ AusNOG mailing list AusNOG@lists.ausnog.net http://lists.ausnog.net/mailman/listinfo/ausnog
Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance -, 15th August
Chad, That's all well and good but when you're paying a premium price for services of this fashion you expect a certain level of service. There is a risk no matter what when switching from power supplies taking extra load they would not usually take as well as swing load issues with PDU's. I completely agree with your sentiment but the risk is not to be ignored especially during those times. Kindest Regards, Nathan Brookfield (VK2NAB) -Original Message- From: AusNOG [mailto:ausnog-boun...@lists.ausnog.net] On Behalf Of Chad Kelly Sent: Thursday, August 10, 2017 2:54 PM To: ausnog@lists.ausnog.net; ausnog-requ...@lists.ausnog.net Subject: Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance -, 15th August On 8/10/2017 10:13 AM, ausnog-requ...@lists.ausnog.net wrote: > From the latest update today, It appears that most of the works are > being postponed for the time being > > Not all devices within racks support 2 feeds and planning is involved > with these devices, which is why it is crucial to receive accurate > information about any pending outages or upgrades to the NextDC DataCentres > which affect services. If these services are mission critical then you really should have duel PSU units, so that when one feed gets taken offline the equipment automatically switches to the other feed. They won't just disconnect both feeds at once because that would be stupid and if the entire DC was offline for too much time then that would put the owners in a rather awkward situation legally, as after say 8 or 10 hours of downtime it wouldn't be good for the owners lets put it that way. If the single PSU units are a part of a customers co-located equipment then really your terms of service agreement should exclude liability under your maintenance clauses. I don't understand why anyone would be using single PSU equipment in a DC environment now a days when you can buy refurbished servers that come with two PSU as standard even when you buy them without raid. Also for anything that is really really mission critical you should have it hosted in multiple datacentres anyway so if something stupid does happen that you can't control you at least still have services online as the load balanced services would just switch. Regards Chad. -- Chad Kelly Manager CPK Web Services Phone 03 5273 0246 Web www.cpkws.com.au ___ AusNOG mailing list AusNOG@lists.ausnog.net http://lists.ausnog.net/mailman/listinfo/ausnog ___ AusNOG mailing list AusNOG@lists.ausnog.net http://lists.ausnog.net/mailman/listinfo/ausnog
Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance -, 15th August
On 8/10/2017 10:13 AM, ausnog-requ...@lists.ausnog.net wrote: From the latest update today, It appears that most of the works are being postponed for the time being Not all devices within racks support 2 feeds and planning is involved with these devices, which is why it is crucial to receive accurate information about any pending outages or upgrades to the NextDC DataCentres which affect services. If these services are mission critical then you really should have duel PSU units, so that when one feed gets taken offline the equipment automatically switches to the other feed. They won't just disconnect both feeds at once because that would be stupid and if the entire DC was offline for too much time then that would put the owners in a rather awkward situation legally, as after say 8 or 10 hours of downtime it wouldn't be good for the owners lets put it that way. If the single PSU units are a part of a customers co-located equipment then really your terms of service agreement should exclude liability under your maintenance clauses. I don't understand why anyone would be using single PSU equipment in a DC environment now a days when you can buy refurbished servers that come with two PSU as standard even when you buy them without raid. Also for anything that is really really mission critical you should have it hosted in multiple datacentres anyway so if something stupid does happen that you can't control you at least still have services online as the load balanced services would just switch. Regards Chad. -- Chad Kelly Manager CPK Web Services Phone 03 5273 0246 Web www.cpkws.com.au ___ AusNOG mailing list AusNOG@lists.ausnog.net http://lists.ausnog.net/mailman/listinfo/ausnog
Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - 15th August
Smells of them having to lift the supply neutral to the input of the UPS
stacks. This would require a shutdown of the entire eqipment if the
Natural earth bond needs to be split for whatever reason. (Although I
have done a temporary bond in DC's before to keep the UPS array going
but a lot of engineers get skittish about that especially if HV is
involved)
Matt.
On 10/8/17 1:22 pm, Jared Hirst wrote:
Hi Simon,
Maybe it could be helpful to the Ausnog list to point us to that law
you refer too?
As I personally have never heard or seen this done in any DC in
Australia, or the world in the past 15 years I have been housing gear
in Data Centres.
I agree that gear should have 2N, and it doesn’t affect me, but there
are people that have equipment that have single fed devices, and I
believe you don’t allow self installed STS devices to be installed? I
could be wrong.
In any case, it would be interesting to see the law the requires you
to shut down boards.
Regards,
Jared Hirst
Servers Australia Pty Ltd
Phone: +61 2 8115 8801
Email: jared.hi...@serversaustralia.com.au
<mailto:jared.hi...@serversaustralia.com.au>
*From:* AusNOG on behalf of Simon
Cooper
*Sent:* Thursday, August 10, 2017 8:39:13 AM
*To:* ausnog@lists.ausnog.net
*Subject:* Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance
- 15th August
Thanks guys, appreciate the feedback.
At NEXTDC we work very hard to keep critical infrastructure
maintenance that impacts racks or the environment within the data hall
to an absolute minimum.
However, some works are required to happen from time to time by law
and one of those activities is a de-energisation and inspection of
each of our major switchboards. This is all about ensuring that the
electrical system is safe, and is an unavoidable piece of work.
Rightly so.
Every rack in a NEXTDC data centre has 2N power feeds offered to it,
and we highly recommend that they are used for every device in the
rack. This occasional maintenance is one of the many reasons we
provide this capability. Any device using the 2N supplies (aka A & B
feeds) will simply see its power swing from one feed to the other.
Any rack that is drawing no more that its contracted power level will
have no issue when all devices move from A to B or vice versa.
Our notifications were made well in advance, as we want to give
customers time to consider the management of these works and we don't
assume that every rack is perfectly deployed: We are here 24/7 to
assist customers with rack inspections or specific circuit down tests
or maybe a controlled move prior to the day (e.g. for devices that are
single fed).
Also, as we work though those discussions with customers we understand
the timing in relation to their businesses, and we work very hard to
coordinate schedules despite each switch board supporting many
different customers and customer instances across the data centre.
Occasionally that means we have to make a difficult decisions which
may result in schedule changes. When that does happen, we do not
compromise our notification periods.
I'll be happy to discuss these works with anyone - probably best
offline or on the phone - but trust me when I say we are doing our
absolute best to keep your data centre operating safely and reliably
for many years to come.
Thanks,
Simon
COO, NEXTDC
-Original Message-
*From:* nat...@nightsys.net
*Sent:* Thu, 10 Aug 2017 05:39:02 +1000
*To:* sh...@rackcentral.com
*Subject:* Re: [AusNOG] NextDC Melbourne - Scheduled Power
Maintenance - 15th August
This seems reasonable? As long as no single Data Hall has both A
and B feeds removed simultaneously, that seems normal. Doing B on
Hall 2 and A on Hall 3 on the same day does seem slightly
adventurous, but not entirely unreasonable (mostly in terms of if
something goes bad in both, staff get stretched thin remediating
issues).
A and B feeds are designed to provide redundancy to equipment,
allowing one feed to fail and systems to continue on the other.
Anything mission critical should be able to draw from either feed
as required (dual PSU), and if there is a power deficit on one
feed (causing circuits to trip), that would imply the circuits are
incorrectly sized?
In addition, anything mission critical with a single power supply
would be on an ATS you would assume, or a pair of equivalent
devices installed with one on each rail?
Things break in datacentres, planned maintenance happens
sometimes, better than no maintenance at all :) The fact they are
notifying you is better than not, and it being scheduled is
probably still better than unscheduled :) (easier to ensure
sufficient staffing to keep a close eye on things)
Nathan.
On Wed, Aug 9, 2017 at 3:43 PM, Sh
Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - 15th August
Hi Simon, Maybe it could be helpful to the Ausnog list to point us to that law you refer too? As I personally have never heard or seen this done in any DC in Australia, or the world in the past 15 years I have been housing gear in Data Centres. I agree that gear should have 2N, and it doesn’t affect me, but there are people that have equipment that have single fed devices, and I believe you don’t allow self installed STS devices to be installed? I could be wrong. In any case, it would be interesting to see the law the requires you to shut down boards. Regards, Jared Hirst Servers Australia Pty Ltd Phone: +61 2 8115 8801 Email: jared.hi...@serversaustralia.com.au<mailto:jared.hi...@serversaustralia.com.au> From: AusNOG on behalf of Simon Cooper Sent: Thursday, August 10, 2017 8:39:13 AM To: ausnog@lists.ausnog.net Subject: Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - 15th August Thanks guys, appreciate the feedback. At NEXTDC we work very hard to keep critical infrastructure maintenance that impacts racks or the environment within the data hall to an absolute minimum. However, some works are required to happen from time to time by law and one of those activities is a de-energisation and inspection of each of our major switchboards. This is all about ensuring that the electrical system is safe, and is an unavoidable piece of work. Rightly so. Every rack in a NEXTDC data centre has 2N power feeds offered to it, and we highly recommend that they are used for every device in the rack. This occasional maintenance is one of the many reasons we provide this capability. Any device using the 2N supplies (aka A & B feeds) will simply see its power swing from one feed to the other. Any rack that is drawing no more that its contracted power level will have no issue when all devices move from A to B or vice versa. Our notifications were made well in advance, as we want to give customers time to consider the management of these works and we don't assume that every rack is perfectly deployed: We are here 24/7 to assist customers with rack inspections or specific circuit down tests or maybe a controlled move prior to the day (e.g. for devices that are single fed). Also, as we work though those discussions with customers we understand the timing in relation to their businesses, and we work very hard to coordinate schedules despite each switch board supporting many different customers and customer instances across the data centre. Occasionally that means we have to make a difficult decisions which may result in schedule changes. When that does happen, we do not compromise our notification periods. I'll be happy to discuss these works with anyone - probably best offline or on the phone - but trust me when I say we are doing our absolute best to keep your data centre operating safely and reliably for many years to come. Thanks, Simon COO, NEXTDC -Original Message- From: nat...@nightsys.net Sent: Thu, 10 Aug 2017 05:39:02 +1000 To: sh...@rackcentral.com Subject: Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - 15th August This seems reasonable? As long as no single Data Hall has both A and B feeds removed simultaneously, that seems normal. Doing B on Hall 2 and A on Hall 3 on the same day does seem slightly adventurous, but not entirely unreasonable (mostly in terms of if something goes bad in both, staff get stretched thin remediating issues). A and B feeds are designed to provide redundancy to equipment, allowing one feed to fail and systems to continue on the other. Anything mission critical should be able to draw from either feed as required (dual PSU), and if there is a power deficit on one feed (causing circuits to trip), that would imply the circuits are incorrectly sized? In addition, anything mission critical with a single power supply would be on an ATS you would assume, or a pair of equivalent devices installed with one on each rail? Things break in datacentres, planned maintenance happens sometimes, better than no maintenance at all :) The fact they are notifying you is better than not, and it being scheduled is probably still better than unscheduled :) (easier to ensure sufficient staffing to keep a close eye on things) Nathan. On Wed, Aug 9, 2017 at 3:43 PM, Shaun McGuane mailto:sh...@rackcentral.com>> wrote: Here is the entire scheduled maintenance windows for all the halls we occupy. DataHall 2 A Feed - Tuesday 8th August 2017 07:00 UTC +10 until 16:00 UTC +10. B Feed - Tuesday 15th August 2017 07:00 UTC +10 until 16:00 UTC +10. DataHall 3 A Feed - Tuesday 15th August 2017 07:00 UTC +10 until 16:00 UTC +10 B Feed - Monday 14th August 2017 07:00 UTC +10 until 16:00 UTC +10 DataHall 4 B Feed - Tuesday 15th August 2017 07:00 UTC +10 until 16:00 UTC +10. · So looks like no power on 3 data halls B feeds on the same day.
Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - 15th August
Dear All Anyone with single power supply devices please do not look at getting an ATS, get a STS !!! Short version ATS (Automatic Transfer Switch) will typically break power before it makes, thus the connected device could reboot !! STS (Static Transfer Switch) will make power before it breaks, providing no break to the power ! An example of a recommended device is below https://www.vertivco.com/en-asia/products-catalog/critical-power/power-transfer-switches/liebert-lts-63-to-400a/ Kindest Regards, James Braunegg [cid:image001.png@01D280A4.01865B60] 1300 769 972 / 0488 997 207 ja...@micron21.com<mailto:ja...@micron21.com> www.micron21.com/<http://www.micron21.com/> [cid:image002.png@01D280A4.01865B60]<http://www.micron21.com/> [cid:image003.png@01D280A4.01865B60]<https://www.facebook.com/micron21/> [cid:image004.png@01D280A4.01865B60]<https://twitter.com/micron21> Follow us on Twitter<https://twitter.com/micron21> for important service and system updates. This message is intended for the addressee named above. It may contain privileged or confidential information. If you are not the intended recipient of this message you must not use, copy, distribute or disclose it to anyone other than the addressee. If you have received this message in error please return the message to the sender by replying to it and then delete the message from your computer. From: AusNOG [mailto:ausnog-boun...@lists.ausnog.net] On Behalf Of Matthew Smee Sent: Thursday, 10 August 2017 12:00 PM To: ausnog@lists.ausnog.net Subject: Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - 15th August +1 Every DC agreement I’ve seen (3) have mentioned that you are responsible for supplying it with power and they aren’t responsible if it loses power (i.e. use an ATS). From: AusNOG [mailto:ausnog-boun...@lists.ausnog.net] On Behalf Of Sam Silvester Sent: Thursday, 10 August 2017 10:14 AM To: Shaun McGuane mailto:sh...@rackcentral.com>> Cc: ausnog@lists.ausnog.net<mailto:ausnog@lists.ausnog.net> Subject: Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - 15th August If you have single fed equipment in your rack that needs planning before it can be shut down, do you not run a totally forseeable and preventable risk then should that one feed trip? This is what ATS are for. Sam On Thursday, 10 August 2017, Shaun McGuane mailto:sh...@rackcentral.com>> wrote: HI Simon, Thank you for your input to the list. While you may have provided notifications well in advance, your schedule provided has been changed multiple times and this creates confusion. Without asking for further clarification last night I would never have received the following updated schedule from Craig Armstrong today. Data Hall 2 – B feed (west/blue PDU side) Tuesday 15th Aug, A feed has been pushed back to later date around November, you will receive official notice once new date confirmed. Data Hall 3 –A and B feed has been pushed back to later date around October/November, you will receive official notice once new date confirmed. Data Hall 4 –A and B feed has been pushed back to later date around October/November, you will receive official notice once new date confirmed. From the latest update today, It appears that most of the works are being postponed for the time being Not all devices within racks support 2 feeds and planning is involved with these devices, which is why it is crucial to receive accurate information about any pending outages or upgrades to the NextDC DataCentres which affect services. Additionally, I have not received these updates via the normal NextDC E-Mail communication method, so I am sure other customers will be wondering whats happening too. Happy to have a conversation offline about this feel free to give me a call on my mobile. Regards Shaun From: AusNOG [mailto:ausnog-boun...@lists.ausnog.net] On Behalf Of Simon Cooper Sent: Thursday, 10 August 2017 8:39 AM To: ausnog@lists.ausnog.net Subject: Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - 15th August Thanks guys, appreciate the feedback. At NEXTDC we work very hard to keep critical infrastructure maintenance that impacts racks or the environment within the data hall to an absolute minimum. However, some works are required to happen from time to time by law and one of those activities is a de-energisation and inspection of each of our major switchboards. This is all about ensuring that the electrical system is safe, and is an unavoidable piece of work. Rightly so. Every rack in a NEXTDC data centre has 2N power feeds offered to it, and we highly recommend that they are used for every device in the rack. This occasional maintenance is one of the many reasons we provide this capability. Any device using the 2N supplies (aka A & B feeds) will simply see its power swing from one feed to the other. Any rack that is drawing n
Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - 15th August
+1 Every DC agreement I’ve seen (3) have mentioned that you are responsible for supplying it with power and they aren’t responsible if it loses power (i.e. use an ATS). From: AusNOG [mailto:ausnog-boun...@lists.ausnog.net] On Behalf Of Sam Silvester Sent: Thursday, 10 August 2017 10:14 AM To: Shaun McGuane Cc: ausnog@lists.ausnog.net Subject: Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - 15th August If you have single fed equipment in your rack that needs planning before it can be shut down, do you not run a totally forseeable and preventable risk then should that one feed trip? This is what ATS are for. Sam On Thursday, 10 August 2017, Shaun McGuane mailto:sh...@rackcentral.com>> wrote: HI Simon, Thank you for your input to the list. While you may have provided notifications well in advance, your schedule provided has been changed multiple times and this creates confusion. Without asking for further clarification last night I would never have received the following updated schedule from Craig Armstrong today. Data Hall 2 – B feed (west/blue PDU side) Tuesday 15th Aug, A feed has been pushed back to later date around November, you will receive official notice once new date confirmed. Data Hall 3 –A and B feed has been pushed back to later date around October/November, you will receive official notice once new date confirmed. Data Hall 4 –A and B feed has been pushed back to later date around October/November, you will receive official notice once new date confirmed. From the latest update today, It appears that most of the works are being postponed for the time being Not all devices within racks support 2 feeds and planning is involved with these devices, which is why it is crucial to receive accurate information about any pending outages or upgrades to the NextDC DataCentres which affect services. Additionally, I have not received these updates via the normal NextDC E-Mail communication method, so I am sure other customers will be wondering whats happening too. Happy to have a conversation offline about this feel free to give me a call on my mobile. Regards Shaun From: AusNOG [mailto:ausnog-boun...@lists.ausnog.net] On Behalf Of Simon Cooper Sent: Thursday, 10 August 2017 8:39 AM To: ausnog@lists.ausnog.net Subject: Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - 15th August Thanks guys, appreciate the feedback. At NEXTDC we work very hard to keep critical infrastructure maintenance that impacts racks or the environment within the data hall to an absolute minimum. However, some works are required to happen from time to time by law and one of those activities is a de-energisation and inspection of each of our major switchboards. This is all about ensuring that the electrical system is safe, and is an unavoidable piece of work. Rightly so. Every rack in a NEXTDC data centre has 2N power feeds offered to it, and we highly recommend that they are used for every device in the rack. This occasional maintenance is one of the many reasons we provide this capability. Any device using the 2N supplies (aka A & B feeds) will simply see its power swing from one feed to the other. Any rack that is drawing no more that its contracted power level will have no issue when all devices move from A to B or vice versa. Our notifications were made well in advance, as we want to give customers time to consider the management of these works and we don't assume that every rack is perfectly deployed: We are here 24/7 to assist customers with rack inspections or specific circuit down tests or maybe a controlled move prior to the day (e.g. for devices that are single fed). Also, as we work though those discussions with customers we understand the timing in relation to their businesses, and we work very hard to coordinate schedules despite each switch board supporting many different customers and customer instances across the data centre. Occasionally that means we have to make a difficult decisions which may result in schedule changes. When that does happen, we do not compromise our notification periods. I'll be happy to discuss these works with anyone - probably best offline or on the phone - but trust me when I say we are doing our absolute best to keep your data centre operating safely and reliably for many years to come. Thanks, Simon COO, NEXTDC -Original Message- From: nat...@nightsys.net Sent: Thu, 10 Aug 2017 05:39:02 +1000 To: sh...@rackcentral.com Subject: Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - 15th August This seems reasonable? As long as no single Data Hall has both A and B feeds removed simultaneously, that seems normal. Doing B on Hall 2 and A on Hall 3 on the same day does seem slightly adventurous, but not entirely unreasonable (mostly in terms of if something goes bad in both, staff get stretched thin remediating issues). A and B feeds are designed to p
Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - 15th August
If you have single fed equipment in your rack that needs planning before it can be shut down, do you not run a totally forseeable and preventable risk then should that one feed trip? This is what ATS are for. Sam On Thursday, 10 August 2017, Shaun McGuane wrote: > HI Simon, > > > > Thank you for your input to the list. > > > > While you may have provided notifications well in advance, your schedule > provided has been changed multiple times and this creates confusion. > > Without asking for further clarification last night I would never have > received the following updated schedule from Craig Armstrong today. > > > > Data Hall 2 – B feed (west/blue PDU side) Tuesday 15th Aug, A feed has > been pushed back to later date around November, you will receive official > notice once new date confirmed. > > Data Hall 3 –A and B feed has been pushed back to later date around > October/November, you will receive official notice once new date confirmed. > > Data Hall 4 –A and B feed has been pushed back to later date around > October/November, you will receive official notice once new date confirmed. > > > > From the latest update today, It appears that most of the works are being > postponed for the time being > > > > Not all devices within racks support 2 feeds and planning is involved with > these devices, which is why it is crucial to receive accurate information > about any pending outages or upgrades > to the NextDC DataCentres which affect services. > > > > Additionally, I have not received these updates via the normal NextDC > E-Mail communication method, so I am sure other customers will be wondering > whats happening too. > > > > Happy to have a conversation offline about this feel free to give me a > call on my mobile. > > > > Regards > > Shaun > > > > > > > > *From:* AusNOG [mailto:ausnog-boun...@lists.ausnog.net > ] *On > Behalf Of *Simon Cooper > *Sent:* Thursday, 10 August 2017 8:39 AM > *To:* ausnog@lists.ausnog.net > > *Subject:* Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - > 15th August > > > > Thanks guys, appreciate the feedback. > > > > At NEXTDC we work very hard to keep critical infrastructure maintenance > that impacts racks or the environment within the data hall to an absolute > minimum. > > > > However, some works are required to happen from time to time by law and > one of those activities is a de-energisation and inspection of each of our > major switchboards. This is all about ensuring that the electrical system > is safe, and is an unavoidable piece of work. Rightly so. > > > > Every rack in a NEXTDC data centre has 2N power feeds offered to it, and > we highly recommend that they are used for every device in the rack. This > occasional maintenance is one of the many reasons we provide this > capability. Any device using the 2N supplies (aka A & B feeds) will simply > see its power swing from one feed to the other. Any rack that is drawing > no more that its contracted power level will have no issue when all devices > move from A to B or vice versa. > > > > Our notifications were made well in advance, as we want to give customers > time to consider the management of these works and we don't assume that > every rack is perfectly deployed: We are here 24/7 to assist customers > with rack inspections or specific circuit down tests or maybe a controlled > move prior to the day (e.g. for devices that are single fed). > > > > Also, as we work though those discussions with customers we understand the > timing in relation to their businesses, and we work very hard to coordinate > schedules despite each switch board supporting many different customers and > customer instances across the data centre. Occasionally that means we have > to make a difficult decisions which may result in schedule changes. When > that does happen, we do not compromise our notification periods. > > > > I'll be happy to discuss these works with anyone - probably best offline > or on the phone - but trust me when I say we are doing our absolute best to > keep your data centre operating safely and reliably for many years to come. > > > > Thanks, > > Simon > > COO, NEXTDC > > > > -Original Message- > *From:* nat...@nightsys.net > > *Sent:* Thu, 10 Aug 2017 05:39:02 +1000 > *To:* sh...@rackcentral.com > > *Subject:* Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - > 15th August > > This seems reasonable? As long as no single Data Hall has both A and B > feeds removed simultaneously, that seems normal. Doing B on Hall 2 and A on > Hall 3 o
Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - 15th August
HI Simon, Thank you for your input to the list. While you may have provided notifications well in advance, your schedule provided has been changed multiple times and this creates confusion. Without asking for further clarification last night I would never have received the following updated schedule from Craig Armstrong today. Data Hall 2 – B feed (west/blue PDU side) Tuesday 15th Aug, A feed has been pushed back to later date around November, you will receive official notice once new date confirmed. Data Hall 3 –A and B feed has been pushed back to later date around October/November, you will receive official notice once new date confirmed. Data Hall 4 –A and B feed has been pushed back to later date around October/November, you will receive official notice once new date confirmed. From the latest update today, It appears that most of the works are being postponed for the time being Not all devices within racks support 2 feeds and planning is involved with these devices, which is why it is crucial to receive accurate information about any pending outages or upgrades to the NextDC DataCentres which affect services. Additionally, I have not received these updates via the normal NextDC E-Mail communication method, so I am sure other customers will be wondering whats happening too. Happy to have a conversation offline about this feel free to give me a call on my mobile. Regards Shaun From: AusNOG [mailto:ausnog-boun...@lists.ausnog.net] On Behalf Of Simon Cooper Sent: Thursday, 10 August 2017 8:39 AM To: ausnog@lists.ausnog.net Subject: Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - 15th August Thanks guys, appreciate the feedback. At NEXTDC we work very hard to keep critical infrastructure maintenance that impacts racks or the environment within the data hall to an absolute minimum. However, some works are required to happen from time to time by law and one of those activities is a de-energisation and inspection of each of our major switchboards. This is all about ensuring that the electrical system is safe, and is an unavoidable piece of work. Rightly so. Every rack in a NEXTDC data centre has 2N power feeds offered to it, and we highly recommend that they are used for every device in the rack. This occasional maintenance is one of the many reasons we provide this capability. Any device using the 2N supplies (aka A & B feeds) will simply see its power swing from one feed to the other. Any rack that is drawing no more that its contracted power level will have no issue when all devices move from A to B or vice versa. Our notifications were made well in advance, as we want to give customers time to consider the management of these works and we don't assume that every rack is perfectly deployed: We are here 24/7 to assist customers with rack inspections or specific circuit down tests or maybe a controlled move prior to the day (e.g. for devices that are single fed). Also, as we work though those discussions with customers we understand the timing in relation to their businesses, and we work very hard to coordinate schedules despite each switch board supporting many different customers and customer instances across the data centre. Occasionally that means we have to make a difficult decisions which may result in schedule changes. When that does happen, we do not compromise our notification periods. I'll be happy to discuss these works with anyone - probably best offline or on the phone - but trust me when I say we are doing our absolute best to keep your data centre operating safely and reliably for many years to come. Thanks, Simon COO, NEXTDC -Original Message- From: nat...@nightsys.net<mailto:nat...@nightsys.net> Sent: Thu, 10 Aug 2017 05:39:02 +1000 To: sh...@rackcentral.com<mailto:sh...@rackcentral.com> Subject: Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - 15th August This seems reasonable? As long as no single Data Hall has both A and B feeds removed simultaneously, that seems normal. Doing B on Hall 2 and A on Hall 3 on the same day does seem slightly adventurous, but not entirely unreasonable (mostly in terms of if something goes bad in both, staff get stretched thin remediating issues). A and B feeds are designed to provide redundancy to equipment, allowing one feed to fail and systems to continue on the other. Anything mission critical should be able to draw from either feed as required (dual PSU), and if there is a power deficit on one feed (causing circuits to trip), that would imply the circuits are incorrectly sized? In addition, anything mission critical with a single power supply would be on an ATS you would assume, or a pair of equivalent devices installed with one on each rail? Things break in datacentres, planned maintenance happens sometimes, better than no maintenance at all :) The fact they are notifying you is better than not, and it being schedule
Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - 15th August
An off-the-cuff observation with little real thought put into it: offloading an A feed in one hall and a B feed in the other (if at the same time) seems a reasonable method - intentional or not - of keeping the cumulative data centre load even across feeds. They should be fine standalone anyway, but high current loads have a way of finding any weakness in the circuit path. As mentioned, use redundant power/ATS whatever to ensure your critical kit up, and have faith in your choice of DC. Karl > On 10/08/2017, at 10:39 AM, Simon Cooper wrote: > > Thanks guys, appreciate the feedback. > > At NEXTDC we work very hard to keep critical infrastructure maintenance that > impacts racks or the environment within the data hall to an absolute minimum. > > However, some works are required to happen from time to time by law and one > of those activities is a de-energisation and inspection of each of our major > switchboards. This is all about ensuring that the electrical system is safe, > and is an unavoidable piece of work. Rightly so. > > Every rack in a NEXTDC data centre has 2N power feeds offered to it, and we > highly recommend that they are used for every device in the rack. This > occasional maintenance is one of the many reasons we provide this capability. > Any device using the 2N supplies (aka A & B feeds) will simply see its power > swing from one feed to the other. Any rack that is drawing no more that its > contracted power level will have no issue when all devices move from A to B > or vice versa. > > Our notifications were made well in advance, as we want to give customers > time to consider the management of these works and we don't assume that every > rack is perfectly deployed: We are here 24/7 to assist customers with rack > inspections or specific circuit down tests or maybe a controlled move prior > to the day (e.g. for devices that are single fed). > > Also, as we work though those discussions with customers we understand the > timing in relation to their businesses, and we work very hard to coordinate > schedules despite each switch board supporting many different customers and > customer instances across the data centre. Occasionally that means we have > to make a difficult decisions which may result in schedule changes. When > that does happen, we do not compromise our notification periods. > > I'll be happy to discuss these works with anyone - probably best offline or > on the phone - but trust me when I say we are doing our absolute best to keep > your data centre operating safely and reliably for many years to come. > > Thanks, > Simon > COO, NEXTDC > > -Original Message----- > From: nat...@nightsys.net > Sent: Thu, 10 Aug 2017 05:39:02 +1000 > To: sh...@rackcentral.com > Subject: Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - 15th > August > > This seems reasonable? As long as no single Data Hall has both A and B feeds > removed simultaneously, that seems normal. Doing B on Hall 2 and A on Hall 3 > on the same day does seem slightly adventurous, but not entirely unreasonable > (mostly in terms of if something goes bad in both, staff get stretched thin > remediating issues). > > A and B feeds are designed to provide redundancy to equipment, allowing one > feed to fail and systems to continue on the other. Anything mission critical > should be able to draw from either feed as required (dual PSU), and if there > is a power deficit on one feed (causing circuits to trip), that would imply > the circuits are incorrectly sized? > > In addition, anything mission critical with a single power supply would be on > an ATS you would assume, or a pair of equivalent devices installed with one > on each rail? > > Things break in datacentres, planned maintenance happens sometimes, better > than no maintenance at all :) The fact they are notifying you is better than > not, and it being scheduled is probably still better than unscheduled :) > (easier to ensure sufficient staffing to keep a close eye on things) > > Nathan. > > On Wed, Aug 9, 2017 at 3:43 PM, Shaun McGuane <mailto:sh...@rackcentral.com>> wrote: > Here is the entire scheduled maintenance windows for all the halls we occupy. > > > > DataHall 2 > > A Feed - Tuesday 8th August 2017 07:00 UTC +10 until 16:00 UTC +10. > B Feed - Tuesday 15th August 2017 07:00 UTC +10 until 16:00 UTC +10. > > > > DataHall 3 > > A Feed - Tuesday 15th August 2017 07:00 UTC +10 until 16:00 UTC +10 > B Feed - Monday 14th August 2017 07:00 UTC +10 until 16:00 UTC +10 > > > > DataHall 4 > > B Feed - Tuesday 15th August 2017 07:00 UTC +10 until 16:00 UTC +10. > >
Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - 15th August
Thanks guys, appreciate the feedback.At NEXTDC we work very hard to keep critical infrastructure maintenance that impacts racks or the environment within the data hall to an absolute minimum.However, some works are required to happen from time to time by law and one of those activities is a de-energisation and inspection of each of our major switchboards. This is all about ensuring that the electrical system is safe, and is an unavoidable piece of work. Rightly so.Every rack in a NEXTDC data centre has 2N power feeds offered to it, and we highly recommend that they are used for every device in the rack. This occasional maintenance is one of the many reasons we provide this capability. Any device using the 2N supplies (aka A & B feeds) will simply see its power swing from one feed to the other. Any rack that is drawing no more that its contracted power level will have no issue when all devices move from A to B or vice versa.Our notifications were made well in advance, as we want to give customers time to consider the management of these works and we don't assume that every rack is perfectly deployed: We are here 24/7 to assist customers with rack inspections or specific circuit down tests or maybe a controlled move prior to the day (e.g. for devices that are single fed).Also, as we work though those discussions with customers we understand the timing in relation to their businesses, and we work very hard to coordinate schedules despite each switch board supporting many different customers and customer instances across the data centre. Occasionally that means we have to make a difficult decisions which may result in schedule changes. When that does happen, we do not compromise our notification periods.I'll be happy to discuss these works with anyone - probably best offline or on the phone - but trust me when I say we are doing our absolute best to keep your data centre operating safely and reliably for many years to come.Thanks,SimonCOO, NEXTDC-Original Message-From: nat...@nightsys.netSent: Thu, 10 Aug 2017 05:39:02 +1000To: sh...@rackcentral.comSubject: Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - 15th AugustThis seems reasonable? As long as no single Data Hall has both A and B feeds removed simultaneously, that seems normal. Doing B on Hall 2 and A on Hall 3 on the same day does seem slightly adventurous, but not entirely unreasonable (mostly in terms of if something goes bad in both, staff get stretched thin remediating issues).A and B feeds are designed to provide redundancy to equipment, allowing one feed to fail and systems to continue on the other. Anything mission critical should be able to draw from either feed as required (dual PSU), and if there is a power deficit on one feed (causing circuits to trip), that would imply the circuits are incorrectly sized?In addition, anything mission critical with a single power supply would be on an ATS you would assume, or a pair of equivalent devices installed with one on each rail?Things break in datacentres, planned maintenance happens sometimes, better than no maintenance at all :) The fact they are notifying you is better than not, and it being scheduled is probably still better than unscheduled :) (easier to ensure sufficient staffing to keep a close eye on things)Nathan.On Wed, Aug 9, 2017 at 3:43 PM, Shaun McGuane <sh...@rackcentral.com> wrote: Here is the entire scheduled maintenance windows for all the halls we occupy. DataHall 2 A Feed - Tuesday 8th August 2017 07:00 UTC +10 until 16:00 UTC +10. B Feed - Tuesday 15th August 2017 07:00 UTC +10 until 16:00 UTC +10. DataHall 3 A Feed - Tuesday 15th August 2017 07:00 UTC +10 until 16:00 UTC +10 B Feed - Monday 14th August 2017 07:00 UTC +10 until 16:00 UTC +10 DataHall 4 B Feed - Tuesday 15th August 2017 07:00 UTC +10 until 16:00 UTC +10. · So looks like no power on 3 data halls B feeds on the same day. · Data Hall 2 was scheduled for A rail on the 8th of August but has been re-scheduled with no new date of works. · Data Hall 3 was scheduled for A rail on the Problem is that I have 3x separate dates on 3 separate e-mails for Data Hall 3 and I have requested a revised clarification Just now on the above as there has already been re-schedules for Data Hall 2 and 3. This feels like it’s going sideways and it has not even started. Regards Shaun From: AusNOG [mailto:ausnog-bounces@lists.ausnog.net] On Behalf Of Murat Sener Sent: Wednesday, 9 August 2017 3:20 PM To: Matthew VK3EVL <hit...@itglowz.com>; ausnog@lists.ausnog.net Subject: Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - 15th August We have been told only Feed B in Data hall 2 will be effected as per original schedule and Feed A is yet to be rescheduled. Murat Sener Datacentre Manager PREMIER Technology Solutions P. 1300 76 76 48 F. 1300 76 76 49 M. 0450 604 350 How am I
Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - 15th August
This seems reasonable? As long as no single Data Hall has both A and B feeds removed simultaneously, that seems normal. Doing B on Hall 2 and A on Hall 3 on the same day does seem slightly adventurous, but not entirely unreasonable (mostly in terms of if something goes bad in both, staff get stretched thin remediating issues). A and B feeds are designed to provide redundancy to equipment, allowing one feed to fail and systems to continue on the other. Anything mission critical should be able to draw from either feed as required (dual PSU), and if there is a power deficit on one feed (causing circuits to trip), that would imply the circuits are incorrectly sized? In addition, anything mission critical with a single power supply would be on an ATS you would assume, or a pair of equivalent devices installed with one on each rail? Things break in datacentres, planned maintenance happens sometimes, better than no maintenance at all :) The fact they are notifying you is better than not, and it being scheduled is probably still better than unscheduled :) (easier to ensure sufficient staffing to keep a close eye on things) Nathan. On Wed, Aug 9, 2017 at 3:43 PM, Shaun McGuane wrote: > Here is the entire scheduled maintenance windows for all the halls we > occupy. > > > > DataHall 2 > > A Feed - Tuesday 8th August 2017 07:00 UTC +10 until 16:00 UTC +10. > B Feed - Tuesday 15th August 2017 07:00 UTC +10 until 16:00 UTC +10. > > > > DataHall 3 > > A Feed - Tuesday 15th August 2017 07:00 UTC +10 until 16:00 UTC +10 > B Feed - Monday 14th August 2017 07:00 UTC +10 until 16:00 UTC +10 > > > > DataHall 4 > > B Feed - Tuesday 15th August 2017 07:00 UTC +10 until 16:00 UTC +10. > > > > · So looks like no power on 3 data halls B feeds on the same day. > > · Data Hall 2 was scheduled for A rail on the 8th of August but > has been re-scheduled with no new date of works. > > · Data Hall 3 was scheduled for A rail on the > > > > Problem is that I have 3x separate dates on 3 separate e-mails for Data > Hall 3 and I have requested a revised clarification > > Just now on the above as there has already been re-schedules for Data Hall > 2 and 3. > > > > This feels like it’s going sideways and it has not even started. > > > > Regards > > Shaun > > > > > > *From:* AusNOG [mailto:ausnog-boun...@lists.ausnog.net] *On Behalf Of *Murat > Sener > *Sent:* Wednesday, 9 August 2017 3:20 PM > *To:* Matthew VK3EVL ; ausnog@lists.ausnog.net > > *Subject:* Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - > 15th August > > > > We have been told only Feed B in Data hall 2 will be effected as per > original schedule and Feed A is yet to be rescheduled. > > > > > > > > *Murat Sener* Datacentre Manager > > *PREMIER* Technology Solutions > *P. *1300 76 76 48*F. *1300 76 76 49*M. *0450 604 350 > > > > *How am I doing? Let us know!* > SIMPLY CLICK ON A FACE TO GIVE FEEDBACK > > *GREAT* > > *AVERAGE* > > *BAD* > > > <https://www.crewhu.com/survey.html?crewHuID=qm0Hxbzstp&employeeID=rLeIz2SkIa&type=signat&rating=5> > > > <https://www.crewhu.com/survey.html?crewHuID=qm0Hxbzstp&employeeID=rLeIz2SkIa&type=signat&rating=0> > > > <https://www.crewhu.com/survey.html?crewHuID=qm0Hxbzstp&employeeID=rLeIz2SkIa&type=signat&rating=-5> > > > > *From:* AusNOG [mailto:ausnog-boun...@lists.ausnog.net > ] *On Behalf Of *Matthew VK3EVL > *Sent:* Wednesday, 9 August 2017 3:13 PM > *To:* ausnog@lists.ausnog.net > *Subject:* Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - > 15th August > > > > What about both feeds happening on the same day at the same time? > > > > On 9/08/2017 2:55 PM, Shaun McGuane wrote: > > HI Damien, > > > > My apologies that’s correct – but isn’t anyone concerned about the works > being completed during business hours? > > What about increased loading of the active rail once one of them is > switched off for these works? > > > > Regards > > Shaun > > > > > > *From:* Damien Gardner Jnr [mailto:rend...@rendrag.net > ] > *Sent:* Wednesday, 9 August 2017 2:39 PM > *To:* > ; Shaun McGuane > > *Subject:* Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - > 15th August > > > > It says 7am -> 4pm in what you quoted? (UTC+10 is AEST) > > > > On Wed, 9 Aug 2017 at 2:36 pm, Shaun McGuane > wrote: > > HI Noggers, > > > > Has anyone seen this scheduled maintenance notification happening next > week? > > They maybe upgrading feeds or boards throughou
Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - 15th August
Here is the entire scheduled maintenance windows for all the halls we occupy. DataHall 2 A Feed - Tuesday 8th August 2017 07:00 UTC +10 until 16:00 UTC +10. B Feed - Tuesday 15th August 2017 07:00 UTC +10 until 16:00 UTC +10. DataHall 3 A Feed - Tuesday 15th August 2017 07:00 UTC +10 until 16:00 UTC +10 B Feed - Monday 14th August 2017 07:00 UTC +10 until 16:00 UTC +10 DataHall 4 B Feed - Tuesday 15th August 2017 07:00 UTC +10 until 16:00 UTC +10. · So looks like no power on 3 data halls B feeds on the same day. · Data Hall 2 was scheduled for A rail on the 8th of August but has been re-scheduled with no new date of works. · Data Hall 3 was scheduled for A rail on the Problem is that I have 3x separate dates on 3 separate e-mails for Data Hall 3 and I have requested a revised clarification Just now on the above as there has already been re-schedules for Data Hall 2 and 3. This feels like it’s going sideways and it has not even started. Regards Shaun From: AusNOG [mailto:ausnog-boun...@lists.ausnog.net] On Behalf Of Murat Sener Sent: Wednesday, 9 August 2017 3:20 PM To: Matthew VK3EVL ; ausnog@lists.ausnog.net Subject: Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - 15th August We have been told only Feed B in Data hall 2 will be effected as per original schedule and Feed A is yet to be rescheduled. [cid:image001.png@01D31125.F3826EB0] Murat Sener Datacentre Manager PREMIER Technology Solutions P. 1300 76 76 48F. 1300 76 76 49M. 0450 604 350 How am I doing? Let us know! SIMPLY CLICK ON A FACE TO GIVE FEEDBACK GREAT AVERAGE BAD [cid:image002.png@01D31125.F3826EB0]<https://www.crewhu.com/survey.html?crewHuID=qm0Hxbzstp&employeeID=rLeIz2SkIa&type=signat&rating=5> [cid:image003.png@01D31125.F3826EB0]<https://www.crewhu.com/survey.html?crewHuID=qm0Hxbzstp&employeeID=rLeIz2SkIa&type=signat&rating=0> [cid:image004.png@01D31125.F3826EB0]<https://www.crewhu.com/survey.html?crewHuID=qm0Hxbzstp&employeeID=rLeIz2SkIa&type=signat&rating=-5> From: AusNOG [mailto:ausnog-boun...@lists.ausnog.net] On Behalf Of Matthew VK3EVL Sent: Wednesday, 9 August 2017 3:13 PM To: ausnog@lists.ausnog.net<mailto:ausnog@lists.ausnog.net> Subject: Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - 15th August What about both feeds happening on the same day at the same time? On 9/08/2017 2:55 PM, Shaun McGuane wrote: HI Damien, My apologies that’s correct – but isn’t anyone concerned about the works being completed during business hours? What about increased loading of the active rail once one of them is switched off for these works? Regards Shaun From: Damien Gardner Jnr [mailto:rend...@rendrag.net] Sent: Wednesday, 9 August 2017 2:39 PM To: <mailto:ausnog@lists.ausnog.net> <mailto:ausnog@lists.ausnog.net>; Shaun McGuane <mailto:sh...@rackcentral.com> Subject: Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - 15th August It says 7am -> 4pm in what you quoted? (UTC+10 is AEST) On Wed, 9 Aug 2017 at 2:36 pm, Shaun McGuane mailto:sh...@rackcentral.com>> wrote: HI Noggers, Has anyone seen this scheduled maintenance notification happening next week? They maybe upgrading feeds or boards throughout the datacentre – has everyone seen this notification of works? It appears to be happening starting 5PM through to 2AM AEST for all Datahalls on the same date. WHAT: NEXTDC M1 Melbourne data centre, with the assistance of specialist contractors, will conduct offline preventative electrical maintenance work on high-voltage and low-voltage main isolators. This will affect A and B feeds to the racks in Data Hall 2/3/4 on the 15th of August. WHEN: A Feed - Tuesday 15th August 2017 07:00 UTC +10 until 16:00 UTC +10. B Feed - Tuesday 15th August 2017 07:00 UTC +10 until 16:00 UTC +10. HOW AM I AFFECTED? Due to the nature of the work a single feed will be removed as per the dates and times above. We recommend that customers balance the power between both power rails to minimise impact during this period. If you have single feed devices we recommend you: Regards Shaun ___ AusNOG mailing list AusNOG@lists.ausnog.net<mailto:AusNOG@lists.ausnog.net> http://lists.ausnog.net/mailman/listinfo/ausnog -- Damien Gardner Jnr VK2TDG. Dip EE. GradIEAust rend...@rendrag.net<mailto:rend...@rendrag.net> - http://www.rendrag.net/ -- We rode on the winds of the rising storm, We ran to the sounds of thunder. We danced among the lightning bolts, and tore the world asunder ___ AusNOG mailing list AusNOG@lists.ausnog.net<mailto:AusNOG@lists.ausnog.net> http://lists.ausnog.net/mailman/listinfo/ausnog MESSAGE PROTECTED BY PREMIER TECHNOLOGY SOLUTIONS<http://www.premiertech.com.au> - POWERED BY MAILGUARD<http://www.mailguard
Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - 15th August
We have been told only Feed B in Data hall 2 will be effected as per original schedule and Feed A is yet to be rescheduled. [cid:image001.png@01D31122.E6282FF0] Murat Sener Datacentre Manager PREMIER Technology Solutions P. 1300 76 76 48F. 1300 76 76 49M. 0450 604 350 How am I doing? Let us know! SIMPLY CLICK ON A FACE TO GIVE FEEDBACK GREAT AVERAGE BAD [cid:image002.png@01D31122.E6282FF0]<https://www.crewhu.com/survey.html?crewHuID=qm0Hxbzstp&employeeID=rLeIz2SkIa&type=signat&rating=5> [cid:image003.png@01D31122.E6282FF0]<https://www.crewhu.com/survey.html?crewHuID=qm0Hxbzstp&employeeID=rLeIz2SkIa&type=signat&rating=0> [cid:image004.png@01D31122.E6282FF0]<https://www.crewhu.com/survey.html?crewHuID=qm0Hxbzstp&employeeID=rLeIz2SkIa&type=signat&rating=-5> From: AusNOG [mailto:ausnog-boun...@lists.ausnog.net] On Behalf Of Matthew VK3EVL Sent: Wednesday, 9 August 2017 3:13 PM To: ausnog@lists.ausnog.net Subject: Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - 15th August What about both feeds happening on the same day at the same time? On 9/08/2017 2:55 PM, Shaun McGuane wrote: HI Damien, My apologies that’s correct – but isn’t anyone concerned about the works being completed during business hours? What about increased loading of the active rail once one of them is switched off for these works? Regards Shaun From: Damien Gardner Jnr [mailto:rend...@rendrag.net] Sent: Wednesday, 9 August 2017 2:39 PM To: <mailto:ausnog@lists.ausnog.net> <mailto:ausnog@lists.ausnog.net>; Shaun McGuane <mailto:sh...@rackcentral.com> Subject: Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - 15th August It says 7am -> 4pm in what you quoted? (UTC+10 is AEST) On Wed, 9 Aug 2017 at 2:36 pm, Shaun McGuane mailto:sh...@rackcentral.com>> wrote: HI Noggers, Has anyone seen this scheduled maintenance notification happening next week? They maybe upgrading feeds or boards throughout the datacentre – has everyone seen this notification of works? It appears to be happening starting 5PM through to 2AM AEST for all Datahalls on the same date. WHAT: NEXTDC M1 Melbourne data centre, with the assistance of specialist contractors, will conduct offline preventative electrical maintenance work on high-voltage and low-voltage main isolators. This will affect A and B feeds to the racks in Data Hall 2/3/4 on the 15th of August. WHEN: A Feed - Tuesday 15th August 2017 07:00 UTC +10 until 16:00 UTC +10. B Feed - Tuesday 15th August 2017 07:00 UTC +10 until 16:00 UTC +10. HOW AM I AFFECTED? Due to the nature of the work a single feed will be removed as per the dates and times above. We recommend that customers balance the power between both power rails to minimise impact during this period. If you have single feed devices we recommend you: Regards Shaun ___ AusNOG mailing list AusNOG@lists.ausnog.net<mailto:AusNOG@lists.ausnog.net> http://lists.ausnog.net/mailman/listinfo/ausnog -- Damien Gardner Jnr VK2TDG. Dip EE. GradIEAust rend...@rendrag.net<mailto:rend...@rendrag.net> - http://www.rendrag.net/ -- We rode on the winds of the rising storm, We ran to the sounds of thunder. We danced among the lightning bolts, and tore the world asunder ___ AusNOG mailing list AusNOG@lists.ausnog.net<mailto:AusNOG@lists.ausnog.net> http://lists.ausnog.net/mailman/listinfo/ausnog MESSAGE PROTECTED BY PREMIER TECHNOLOGY SOLUTIONS<http://www.premiertech.com.au> - POWERED BY MAILGUARD<http://www.mailguard.com.au/mg>. Report this message as spam<https://console.mailguard.com.au/ras/1RqQHQIE5J/6DWUZjiMDnlts7JYyCLNB3/0> -- MESSAGE PROTECTED BY PREMIER TECHNOLOGY SOLUTIONS - POWERED BY MAILGUARD. ___ AusNOG mailing list AusNOG@lists.ausnog.net http://lists.ausnog.net/mailman/listinfo/ausnog
Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - 15th August
What about both feeds happening on the same day at the same time? On 9/08/2017 2:55 PM, Shaun McGuane wrote: HI Damien, My apologies that’s correct – but isn’t anyone concerned about the works being completed during business hours? What about increased loading of the active rail once one of them is switched off for these works? Regards Shaun *From:*Damien Gardner Jnr [mailto:rend...@rendrag.net] *Sent:* Wednesday, 9 August 2017 2:39 PM *To:* ; Shaun McGuane *Subject:* Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - 15th August It says 7am -> 4pm in what you quoted? (UTC+10 is AEST) On Wed, 9 Aug 2017 at 2:36 pm, Shaun McGuane <mailto:sh...@rackcentral.com>> wrote: HI Noggers, Has anyone seen this scheduled maintenance notification happening next week? They maybe upgrading feeds or boards throughout the datacentre – has everyone seen this notification of works? It appears to be happening starting 5PM through to 2AM AEST for all Datahalls on the same date. *WHAT:* NEXTDC M1 Melbourne data centre, with the assistance of specialist contractors, will conduct offline preventative electrical maintenance work on high-voltage and low-voltage main isolators. This will affect A and B feeds to the racks in Data Hall 2/3/4 on the 15th of August. *WHEN:* A Feed - Tuesday 15th August 2017 07:00 UTC +10 until 16:00 UTC +10. B Feed - Tuesday 15th August 2017 07:00 UTC +10 until 16:00 UTC +10. *HOW AM I AFFECTED?* Due to the nature of the work a single feed will be removed as per the dates and times above. We recommend that customers balance the power between both power rails to minimise impact during this period. If you have single feed devices we recommend you: Regards Shaun ___ AusNOG mailing list AusNOG@lists.ausnog.net <mailto:AusNOG@lists.ausnog.net> http://lists.ausnog.net/mailman/listinfo/ausnog -- Damien Gardner Jnr VK2TDG. Dip EE. GradIEAust rend...@rendrag.net <mailto:rend...@rendrag.net> - http://www.rendrag.net/_ _-- We rode on the winds of the rising storm, We ran to the sounds of thunder. We danced among the lightning bolts, and tore the world asunder ___ AusNOG mailing list AusNOG@lists.ausnog.net http://lists.ausnog.net/mailman/listinfo/ausnog ___ AusNOG mailing list AusNOG@lists.ausnog.net http://lists.ausnog.net/mailman/listinfo/ausnog
Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - 15th August
HI Damien, My apologies that’s correct – but isn’t anyone concerned about the works being completed during business hours? What about increased loading of the active rail once one of them is switched off for these works? Regards Shaun From: Damien Gardner Jnr [mailto:rend...@rendrag.net] Sent: Wednesday, 9 August 2017 2:39 PM To: ; Shaun McGuane Subject: Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - 15th August It says 7am -> 4pm in what you quoted? (UTC+10 is AEST) On Wed, 9 Aug 2017 at 2:36 pm, Shaun McGuane mailto:sh...@rackcentral.com>> wrote: HI Noggers, Has anyone seen this scheduled maintenance notification happening next week? They maybe upgrading feeds or boards throughout the datacentre – has everyone seen this notification of works? It appears to be happening starting 5PM through to 2AM AEST for all Datahalls on the same date. WHAT: NEXTDC M1 Melbourne data centre, with the assistance of specialist contractors, will conduct offline preventative electrical maintenance work on high-voltage and low-voltage main isolators. This will affect A and B feeds to the racks in Data Hall 2/3/4 on the 15th of August. WHEN: A Feed - Tuesday 15th August 2017 07:00 UTC +10 until 16:00 UTC +10. B Feed - Tuesday 15th August 2017 07:00 UTC +10 until 16:00 UTC +10. HOW AM I AFFECTED? Due to the nature of the work a single feed will be removed as per the dates and times above. We recommend that customers balance the power between both power rails to minimise impact during this period. If you have single feed devices we recommend you: Regards Shaun ___ AusNOG mailing list AusNOG@lists.ausnog.net<mailto:AusNOG@lists.ausnog.net> http://lists.ausnog.net/mailman/listinfo/ausnog -- Damien Gardner Jnr VK2TDG. Dip EE. GradIEAust rend...@rendrag.net<mailto:rend...@rendrag.net> - http://www.rendrag.net/ -- We rode on the winds of the rising storm, We ran to the sounds of thunder. We danced among the lightning bolts, and tore the world asunder ___ AusNOG mailing list AusNOG@lists.ausnog.net http://lists.ausnog.net/mailman/listinfo/ausnog
Re: [AusNOG] NextDC Melbourne - Scheduled Power Maintenance - 15th August
It says 7am -> 4pm in what you quoted? (UTC+10 is AEST) On Wed, 9 Aug 2017 at 2:36 pm, Shaun McGuane wrote: > HI Noggers, > > > > Has anyone seen this scheduled maintenance notification happening next > week? > > They maybe upgrading feeds or boards throughout the datacentre – has > everyone seen this notification of works? > > It appears to be happening starting 5PM through to 2AM AEST for all > Datahalls on the same date. > > > > > > *WHAT:* > NEXTDC M1 Melbourne data centre, with the assistance of specialist > contractors, will conduct offline preventative electrical maintenance work > on high-voltage and low-voltage main isolators. This will affect A and B > feeds to the racks in Data Hall 2/3/4 on the 15th of August. > > *WHEN:* > A Feed - Tuesday 15th August 2017 07:00 UTC +10 until 16:00 UTC +10. > B Feed - Tuesday 15th August 2017 07:00 UTC +10 until 16:00 UTC +10. > > *HOW AM I AFFECTED?* > Due to the nature of the work a single feed will be removed as per the > dates and times above. We recommend that customers balance the power > between both power rails to minimise impact during this period. If you have > single feed devices we recommend you: > > > > Regards > > Shaun > > > > > > > ___ > AusNOG mailing list > AusNOG@lists.ausnog.net > http://lists.ausnog.net/mailman/listinfo/ausnog > -- Damien Gardner Jnr VK2TDG. Dip EE. GradIEAust rend...@rendrag.net - http://www.rendrag.net/ -- We rode on the winds of the rising storm, We ran to the sounds of thunder. We danced among the lightning bolts, and tore the world asunder ___ AusNOG mailing list AusNOG@lists.ausnog.net http://lists.ausnog.net/mailman/listinfo/ausnog
