Re: jenkins.impala.io downtime

2023-08-05 Thread Laszlo Gaal
Hi,

Jenkins is up and running again.
As usual, please let me know if you experience any problems.

Thanks,

  - LaszloG

On Sat, Aug 5, 2023 at 6:50 PM Laszlo Gaal  wrote:

> Hi,
>
> The Impala public Jenkins service will be taken offline shortly for
> maintenance and upgrades.
> Expected length of the outage is ~3 hours; mail will be sent when it is
> available again.
>
> Thank you for your patience,
>
>   - LaszloG
>


jenkins.impala.io downtime

2023-08-05 Thread Laszlo Gaal
Hi,

The Impala public Jenkins service will be taken offline shortly for
maintenance and upgrades.
Expected length of the outage is ~3 hours; mail will be sent when it is
available again.

Thank you for your patience,

  - LaszloG


Re: jenkins.impala.io downtime

2023-03-11 Thread Laszlo Gaal
The service is available again.

Thank you for your patience,

  - LaszloG

On Sat, Mar 11, 2023 at 3:16 PM Laszlo Gaal 
wrote:

> Hi,
>
> The public Impala Jenkins instance will be taken offline shortly for
> upgrades and maintenance. The outage will take about 4 hours, i.e. it will
> end at 18:00 UTC (19:00 BUD, 10:00 Pacific).
> Mail will be sent when the service is available again.
>
> Thank you for your understanding,
>
>   - LaszloG
>


jenkins.impala.io downtime

2023-03-11 Thread Laszlo Gaal
Hi,

The public Impala Jenkins instance will be taken offline shortly for
upgrades and maintenance. The outage will take about 4 hours, i.e. it will
end at 18:00 UTC (19:00 BUD, 10:00 Pacific).
Mail will be sent when the service is available again.

Thank you for your understanding,

  - LaszloG


Re: jenkins.impala.io downtime

2023-02-15 Thread Laszlo Gaal
The public Jenkins service is available again.

Thank you for your patience,

  - LaszloG

On Wed, Feb 15, 2023 at 2:47 PM Laszlo Gaal 
wrote:

> Hi,
>
> I am taking the public Jenkins server offline for a short upgrade; it
> should be back in ~15 minutes.
> I'll send mail when the service is available again.
>
> Thank you for your understanding,
>
>  - LaszloG
>


jenkins.impala.io downtime

2023-02-15 Thread Laszlo Gaal
Hi,

I am taking the public Jenkins server offline for a short upgrade; it
should be back in ~15 minutes.
I'll send mail when the service is available again.

Thank you for your understanding,

 - LaszloG


Re: jenkins.impala.io downtime

2022-09-10 Thread Laszlo Gaal
The server is available again.

Thank you for your patience,

  - LaszloG

On Sat, Sep 10, 2022 at 1:38 PM Laszlo Gaal 
wrote:

> Hi,
>
> The Impala upstream Jenkins service will shortly be taken offline for
> maintenance and upgrades.
> Mail will be sent when the service is available again.
>
> Thank you for your understanding,
>
>   - LaszloG
>


jenkins.impala.io downtime

2022-09-10 Thread Laszlo Gaal
Hi,

The Impala upstream Jenkins service will shortly be taken offline for
maintenance and upgrades.
Mail will be sent when the service is available again.

Thank you for your understanding,

  - LaszloG


Re: jenkins.impala.io downtime

2021-08-16 Thread Quanlong Huang
No worries. Thanks for handling this, Laszlo!

Quanlong

On Tue, Aug 17, 2021 at 3:01 AM Laszlo Gaal 
wrote:

> Hi,
>
> The maintenance is over, the service is up and running again.
>
> My apologies for the longer than usual outage,
>
>   - LaszloG
>
> On Mon, Aug 16, 2021 at 3:05 PM Laszlo Gaal 
> wrote:
>
> > Hi,
> >
> > The Impala public Jenkins instance will be taken down for maintenance and
> > upgrades.
> > Planned duration is about 3 hours; mail will be sent when the service is
> > available again.
> >
> > Thank you for your patience,
> >
> >   - LaszloG
> >
>


Re: jenkins.impala.io downtime

2021-08-16 Thread Laszlo Gaal
Hi,

The maintenance is over, the service is up and running again.

My apologies for the longer than usual outage,

  - LaszloG

On Mon, Aug 16, 2021 at 3:05 PM Laszlo Gaal 
wrote:

> Hi,
>
> The Impala public Jenkins instance will be taken down for maintenance and
> upgrades.
> Planned duration is about 3 hours; mail will be sent when the service is
> available again.
>
> Thank you for your patience,
>
>   - LaszloG
>


jenkins.impala.io downtime

2021-08-16 Thread Laszlo Gaal
Hi,

The Impala public Jenkins instance will be taken down for maintenance and
upgrades.
Planned duration is about 3 hours; mail will be sent when the service is
available again.

Thank you for your patience,

  - LaszloG


Re: jenkins.impala.io downtime

2021-04-14 Thread Laszlo Gaal
I forgot to add that I also restarted three GVDs that were interrupted by
the outage:
- https://gerrit.cloudera.org/#/c/17314 (originally started by Joe for John
Sherman)
- https://gerrit.cloudera.org/#/c/17252 (originally started by Joe for
Qifan)
- https://gerrit.cloudera.org/#/c/17289 (originally started by Quanlong for
Qifan)

These are now running.

Thanks,

 - LaszloG

On Wed, Apr 14, 2021 at 1:25 PM Riza Suminto 
wrote:

> Thank you, Laszlo, for bringing jenkins.impala.io back up!
>
> On Wed, Apr 14, 2021, 1:36 AM Laszlo Gaal 
> wrote:
>
> > I have restarted the server, but the current version seems a bit
> unstable.
> > I will monitor the server more closely, but expect the server to fail,
> and
> > do not
> > hesitate to point out to any issues you see.
> >
> > Failure analysis:
> > The Jenkins server process was terminated by the OOM-killer at about
> 01:15
> > UTC.
> > The memory shortage was triggered by an anomaly: the OOM-killer's log
> > suggests that
> > a build job was started on the Jenkins master instance instead of a newly
> > allocated worker VM.
> > This quickly exhausted all the available memory on the master, which
> caused
> > the Jenkin server
> > to be killed along with the errant build process.
> >
> > This is a failure that happened earlier; occurrences seem to be specific
> to
> > Jenkins server
> > and plugin versions. If it happens again, the server will be  upgraded
> to a
> > new version
> > (if one with a fix is available), or rolled back to an earlier, known
> good
> > version.
> >
> > Thank you for your patience while this issue is being ironed out;
> > please don't hesitate to call attention to any problems you experience
> > with jenkins.impala.io
> >
> >   - LaszloG
> >
> > On Wed, Apr 14, 2021 at 9:52 AM Laszlo Gaal 
> > wrote:
> >
> > > Thanks for raising the issue; I'm checking.
> > >
> > > - LaszloG
> > >
> > > On Wed, Apr 14, 2021 at 6:09 AM fucun chu  wrote:
> > >
> > >> [image: image.png]The Impala public Jenkins server is unavailable!
> > >>
> > >> Quanlong Huang  于2021年4月11日周日 上午8:51写道:
> > >>
> > >>> Thanks Laszlo for handling this!
> > >>>
> > >>> On Sun, Apr 11, 2021 at 2:14 AM Laszlo Gaal <
> [email protected]>
> > >>> wrote:
> > >>>
> > >>> > The service is available again.
> > >>> >
> > >>> > Thank you for your patience,
> > >>> >
> > >>> >   - LaszloG
> > >>> >
> > >>> > On Sat, Apr 10, 2021 at 7:15 PM Laszlo Gaal <
> > [email protected]>
> > >>> > wrote:
> > >>> >
> > >>> > > Hi,
> > >>> > >
> > >>> > > The Impala public Jenkins server is undergoing upgrade and
> > >>> maintenance,
> > >>> > > during which it will be restarted multiple times.
> > >>> > > Please do not submit jobs even if the server seems to be
> available;
> > >>> it
> > >>> > may
> > >>> > > still get restarted unexpectedly.
> > >>> > >
> > >>> > > I'll send out the "all clear" signal when the maintenance period
> is
> > >>> over.
> > >>> > >
> > >>> > > Thank you,
> > >>> > >
> > >>> > >   - LaszloG
> > >>> > >
> > >>> >
> > >>>
> > >>
> >
>


Re: jenkins.impala.io downtime

2021-04-14 Thread Riza Suminto
Thank you, Laszlo, for bringing jenkins.impala.io back up!

On Wed, Apr 14, 2021, 1:36 AM Laszlo Gaal  wrote:

> I have restarted the server, but the current version seems a bit unstable.
> I will monitor the server more closely, but expect the server to fail, and
> do not
> hesitate to point out to any issues you see.
>
> Failure analysis:
> The Jenkins server process was terminated by the OOM-killer at about 01:15
> UTC.
> The memory shortage was triggered by an anomaly: the OOM-killer's log
> suggests that
> a build job was started on the Jenkins master instance instead of a newly
> allocated worker VM.
> This quickly exhausted all the available memory on the master, which caused
> the Jenkin server
> to be killed along with the errant build process.
>
> This is a failure that happened earlier; occurrences seem to be specific to
> Jenkins server
> and plugin versions. If it happens again, the server will be  upgraded to a
> new version
> (if one with a fix is available), or rolled back to an earlier, known good
> version.
>
> Thank you for your patience while this issue is being ironed out;
> please don't hesitate to call attention to any problems you experience
> with jenkins.impala.io
>
>   - LaszloG
>
> On Wed, Apr 14, 2021 at 9:52 AM Laszlo Gaal 
> wrote:
>
> > Thanks for raising the issue; I'm checking.
> >
> > - LaszloG
> >
> > On Wed, Apr 14, 2021 at 6:09 AM fucun chu  wrote:
> >
> >> [image: image.png]The Impala public Jenkins server is unavailable!
> >>
> >> Quanlong Huang  于2021年4月11日周日 上午8:51写道:
> >>
> >>> Thanks Laszlo for handling this!
> >>>
> >>> On Sun, Apr 11, 2021 at 2:14 AM Laszlo Gaal 
> >>> wrote:
> >>>
> >>> > The service is available again.
> >>> >
> >>> > Thank you for your patience,
> >>> >
> >>> >   - LaszloG
> >>> >
> >>> > On Sat, Apr 10, 2021 at 7:15 PM Laszlo Gaal <
> [email protected]>
> >>> > wrote:
> >>> >
> >>> > > Hi,
> >>> > >
> >>> > > The Impala public Jenkins server is undergoing upgrade and
> >>> maintenance,
> >>> > > during which it will be restarted multiple times.
> >>> > > Please do not submit jobs even if the server seems to be available;
> >>> it
> >>> > may
> >>> > > still get restarted unexpectedly.
> >>> > >
> >>> > > I'll send out the "all clear" signal when the maintenance period is
> >>> over.
> >>> > >
> >>> > > Thank you,
> >>> > >
> >>> > >   - LaszloG
> >>> > >
> >>> >
> >>>
> >>
>


Re: jenkins.impala.io downtime

2021-04-14 Thread Laszlo Gaal
I have restarted the server, but the current version seems a bit unstable.
I will monitor the server more closely, but expect the server to fail, and
do not
hesitate to point out to any issues you see.

Failure analysis:
The Jenkins server process was terminated by the OOM-killer at about 01:15
UTC.
The memory shortage was triggered by an anomaly: the OOM-killer's log
suggests that
a build job was started on the Jenkins master instance instead of a newly
allocated worker VM.
This quickly exhausted all the available memory on the master, which caused
the Jenkin server
to be killed along with the errant build process.

This is a failure that happened earlier; occurrences seem to be specific to
Jenkins server
and plugin versions. If it happens again, the server will be  upgraded to a
new version
(if one with a fix is available), or rolled back to an earlier, known good
version.

Thank you for your patience while this issue is being ironed out;
please don't hesitate to call attention to any problems you experience
with jenkins.impala.io

  - LaszloG

On Wed, Apr 14, 2021 at 9:52 AM Laszlo Gaal 
wrote:

> Thanks for raising the issue; I'm checking.
>
> - LaszloG
>
> On Wed, Apr 14, 2021 at 6:09 AM fucun chu  wrote:
>
>> [image: image.png]The Impala public Jenkins server is unavailable!
>>
>> Quanlong Huang  于2021年4月11日周日 上午8:51写道:
>>
>>> Thanks Laszlo for handling this!
>>>
>>> On Sun, Apr 11, 2021 at 2:14 AM Laszlo Gaal 
>>> wrote:
>>>
>>> > The service is available again.
>>> >
>>> > Thank you for your patience,
>>> >
>>> >   - LaszloG
>>> >
>>> > On Sat, Apr 10, 2021 at 7:15 PM Laszlo Gaal 
>>> > wrote:
>>> >
>>> > > Hi,
>>> > >
>>> > > The Impala public Jenkins server is undergoing upgrade and
>>> maintenance,
>>> > > during which it will be restarted multiple times.
>>> > > Please do not submit jobs even if the server seems to be available;
>>> it
>>> > may
>>> > > still get restarted unexpectedly.
>>> > >
>>> > > I'll send out the "all clear" signal when the maintenance period is
>>> over.
>>> > >
>>> > > Thank you,
>>> > >
>>> > >   - LaszloG
>>> > >
>>> >
>>>
>>


Re: jenkins.impala.io downtime

2021-04-14 Thread Laszlo Gaal
Thanks for raising the issue; I'm checking.

- LaszloG

On Wed, Apr 14, 2021 at 6:09 AM fucun chu  wrote:

> [image: image.png]The Impala public Jenkins server is unavailable!
>
> Quanlong Huang  于2021年4月11日周日 上午8:51写道:
>
>> Thanks Laszlo for handling this!
>>
>> On Sun, Apr 11, 2021 at 2:14 AM Laszlo Gaal 
>> wrote:
>>
>> > The service is available again.
>> >
>> > Thank you for your patience,
>> >
>> >   - LaszloG
>> >
>> > On Sat, Apr 10, 2021 at 7:15 PM Laszlo Gaal 
>> > wrote:
>> >
>> > > Hi,
>> > >
>> > > The Impala public Jenkins server is undergoing upgrade and
>> maintenance,
>> > > during which it will be restarted multiple times.
>> > > Please do not submit jobs even if the server seems to be available; it
>> > may
>> > > still get restarted unexpectedly.
>> > >
>> > > I'll send out the "all clear" signal when the maintenance period is
>> over.
>> > >
>> > > Thank you,
>> > >
>> > >   - LaszloG
>> > >
>> >
>>
>


Re: jenkins.impala.io downtime

2021-04-13 Thread fucun chu
[image: image.png]The Impala public Jenkins server is unavailable!

Quanlong Huang  于2021年4月11日周日 上午8:51写道:

> Thanks Laszlo for handling this!
>
> On Sun, Apr 11, 2021 at 2:14 AM Laszlo Gaal 
> wrote:
>
> > The service is available again.
> >
> > Thank you for your patience,
> >
> >   - LaszloG
> >
> > On Sat, Apr 10, 2021 at 7:15 PM Laszlo Gaal 
> > wrote:
> >
> > > Hi,
> > >
> > > The Impala public Jenkins server is undergoing upgrade and maintenance,
> > > during which it will be restarted multiple times.
> > > Please do not submit jobs even if the server seems to be available; it
> > may
> > > still get restarted unexpectedly.
> > >
> > > I'll send out the "all clear" signal when the maintenance period is
> over.
> > >
> > > Thank you,
> > >
> > >   - LaszloG
> > >
> >
>


Re: jenkins.impala.io downtime

2021-04-10 Thread Quanlong Huang
Thanks Laszlo for handling this!

On Sun, Apr 11, 2021 at 2:14 AM Laszlo Gaal 
wrote:

> The service is available again.
>
> Thank you for your patience,
>
>   - LaszloG
>
> On Sat, Apr 10, 2021 at 7:15 PM Laszlo Gaal 
> wrote:
>
> > Hi,
> >
> > The Impala public Jenkins server is undergoing upgrade and maintenance,
> > during which it will be restarted multiple times.
> > Please do not submit jobs even if the server seems to be available; it
> may
> > still get restarted unexpectedly.
> >
> > I'll send out the "all clear" signal when the maintenance period is over.
> >
> > Thank you,
> >
> >   - LaszloG
> >
>


Re: jenkins.impala.io downtime

2021-04-10 Thread Laszlo Gaal
The service is available again.

Thank you for your patience,

  - LaszloG

On Sat, Apr 10, 2021 at 7:15 PM Laszlo Gaal 
wrote:

> Hi,
>
> The Impala public Jenkins server is undergoing upgrade and maintenance,
> during which it will be restarted multiple times.
> Please do not submit jobs even if the server seems to be available; it may
> still get restarted unexpectedly.
>
> I'll send out the "all clear" signal when the maintenance period is over.
>
> Thank you,
>
>   - LaszloG
>


jenkins.impala.io downtime

2021-04-10 Thread Laszlo Gaal
Hi,

The Impala public Jenkins server is undergoing upgrade and maintenance,
during which it will be restarted multiple times.
Please do not submit jobs even if the server seems to be available; it may
still get restarted unexpectedly.

I'll send out the "all clear" signal when the maintenance period is over.

Thank you,

  - LaszloG


Re: jenkins.impala.io downtime

2020-08-01 Thread Tim Armstrong
Thanks for taking care of this!

On Sat, Aug 1, 2020 at 11:45 AM Laszlo Gaal 
wrote:

> The service is back up and running,
>
> Thank you,
>
>   - LaszloG
>
> On Sat, Aug 1, 2020 at 6:33 PM Laszlo Gaal 
> wrote:
>
> > The Impala public Jenkins instance will be taken offline for scheduled
> > backup and maintenance. The service will return at about 11:30am Pacific
> > time, which is 6:30pm UTC.
> >
> > Thank you for your patience,
> >
> >   - LaszloG
> >
>


Re: jenkins.impala.io downtime

2020-08-01 Thread Laszlo Gaal
The service is back up and running,

Thank you,

  - LaszloG

On Sat, Aug 1, 2020 at 6:33 PM Laszlo Gaal  wrote:

> The Impala public Jenkins instance will be taken offline for scheduled
> backup and maintenance. The service will return at about 11:30am Pacific
> time, which is 6:30pm UTC.
>
> Thank you for your patience,
>
>   - LaszloG
>


jenkins.impala.io downtime

2020-08-01 Thread Laszlo Gaal
The Impala public Jenkins instance will be taken offline for scheduled
backup and maintenance. The service will return at about 11:30am Pacific
time, which is 6:30pm UTC.

Thank you for your patience,

  - LaszloG


Re: jenkins.impala.io downtime

2020-03-11 Thread Laszlo Gaal
Thank you for taking care of this, David!

- LaszloG

On Wed, Mar 11, 2020 at 5:09 AM David Rorke  wrote:

> The jenkins.impala.io upgrade is complete and the server is back online.
>
> On Tue, Mar 10, 2020 at 6:22 PM David Rorke  wrote:
>
> > The public Impala Jenkins server will be going down for maintenance
> > shortly.   Another email will be sent when it becomes available again.
> >
>


Re: jenkins.impala.io downtime

2020-03-10 Thread David Rorke
The jenkins.impala.io upgrade is complete and the server is back online.

On Tue, Mar 10, 2020 at 6:22 PM David Rorke  wrote:

> The public Impala Jenkins server will be going down for maintenance
> shortly.   Another email will be sent when it becomes available again.
>


jenkins.impala.io downtime

2020-03-10 Thread David Rorke
The public Impala Jenkins server will be going down for maintenance
shortly.   Another email will be sent when it becomes available again.


Re: jenkins.impala.io downtime

2020-02-15 Thread Quanlong Huang
Thank Laszlo for handling this!

Quanlong

On Sun, Feb 16, 2020 at 1:24 AM Laszlo Gaal 
wrote:

> The service is back online.
>
> Thank you for your patience,
>
>- LaszloG
>
> On Sat, Feb 15, 2020 at 4:25 PM Laszlo Gaal 
> wrote:
>
> > The public Impala Jenkins server will shortly go down for a short
> > maintenance window.
> > The server is currently quiet; mail will be sent when it becomes
> available
> > again.
> >
> > Thank you,
> >
> >   - LaszloG
> >
>


Re: jenkins.impala.io downtime

2020-02-15 Thread Laszlo Gaal
The service is back online.

Thank you for your patience,

   - LaszloG

On Sat, Feb 15, 2020 at 4:25 PM Laszlo Gaal 
wrote:

> The public Impala Jenkins server will shortly go down for a short
> maintenance window.
> The server is currently quiet; mail will be sent when it becomes available
> again.
>
> Thank you,
>
>   - LaszloG
>


jenkins.impala.io downtime

2020-02-15 Thread Laszlo Gaal
The public Impala Jenkins server will shortly go down for a short
maintenance window.
The server is currently quiet; mail will be sent when it becomes available
again.

Thank you,

  - LaszloG