Re: CI woes pt.2
Hi all, Yes we have another CI outage this time due to disk space running out on the master server. This morning we have cleared some space and are re-triggering builds affected, but please check and make sure your PR has the 12 checks triggered. As a follow up, we will be looking into ways to improve monitoring and upkeep of the Jenkins master workspaces. We apologize for the inconvenience. Chance Bair On Mon, Mar 4, 2019 at 5:29 AM Sheng Zha wrote: > CI has been down again for several days now. Is there something I can help > with? > > -sz > > On 2019/02/27 14:35:05, Per da Silva wrote: > > Hi everyone, > > > > The PR temporarily disabling windows tests has been merged, so the > windows > > checks shouldn't block progress for the time being. Please retrigger any > > PRs you have open. We are still working hard on solving the windows > > instance issues. Once that is sorted out, we'll come back with more news. > > > > Cheers, > > > > Per > > >
Re: CI woes pt.2
CI has been down again for several days now. Is there something I can help with? -sz On 2019/02/27 14:35:05, Per da Silva wrote: > Hi everyone, > > The PR temporarily disabling windows tests has been merged, so the windows > checks shouldn't block progress for the time being. Please retrigger any > PRs you have open. We are still working hard on solving the windows > instance issues. Once that is sorted out, we'll come back with more news. > > Cheers, > > Per >
Re: CI woes pt.2
Gotcha! Thanks! On Wed, Feb 27, 2019 at 1:44 PM Gavin M. Bell wrote: > Per, Chance and team - Nice work! > > > On Wed, Feb 27, 2019 at 10:43 PM Per da Silva > wrote: > > > Hey Junru, > > > > > > Please rebase and try again. Although, I'm finding this a bit > > strangelet me know how it goes and tomorrow morning I'll follow it > up! > > > > Cheers, > > > > Per > > > > On Wed., 27 Feb. 2019, 10:40 pm Junru Shao, > > wrote: > > > > > Hey Per, > > > > > > CI for my PR still fails ( > > > > > > > > > http://jenkins.mxnet-ci.amazon-ml.com/blue/organizations/jenkins/mxnet-validation%2Fwindows-gpu/detail/PR-14217/13/pipeline > > > ), > > > saying "ERROR: Queue task was cancelled". Should I rebase? > > > > > > Thanks, > > > Junru > > > > > > On Wed, Feb 27, 2019 at 10:36 AM Junru Shao > > > wrote: > > > > > > > Finally! Thanks Per for the hard work! > > > > > > > > On Wed, Feb 27, 2019 at 6:35 AM Per da Silva > > > wrote: > > > > > > > >> Hi everyone, > > > >> > > > >> The PR temporarily disabling windows tests has been merged, so the > > > windows > > > >> checks shouldn't block progress for the time being. Please retrigger > > any > > > >> PRs you have open. We are still working hard on solving the windows > > > >> instance issues. Once that is sorted out, we'll come back with more > > > news. > > > >> > > > >> Cheers, > > > >> > > > >> Per > > > >> > > > > > > > > > > > > -- > Sincerely, > Gavin M. Bell > > "Never mistake a clear view for a short distance." > -Paul Saffo >
Re: CI woes pt.2
Per, Chance and team - Nice work! On Wed, Feb 27, 2019 at 10:43 PM Per da Silva wrote: > Hey Junru, > > > Please rebase and try again. Although, I'm finding this a bit > strangelet me know how it goes and tomorrow morning I'll follow it up! > > Cheers, > > Per > > On Wed., 27 Feb. 2019, 10:40 pm Junru Shao, > wrote: > > > Hey Per, > > > > CI for my PR still fails ( > > > > > http://jenkins.mxnet-ci.amazon-ml.com/blue/organizations/jenkins/mxnet-validation%2Fwindows-gpu/detail/PR-14217/13/pipeline > > ), > > saying "ERROR: Queue task was cancelled". Should I rebase? > > > > Thanks, > > Junru > > > > On Wed, Feb 27, 2019 at 10:36 AM Junru Shao > > wrote: > > > > > Finally! Thanks Per for the hard work! > > > > > > On Wed, Feb 27, 2019 at 6:35 AM Per da Silva > > wrote: > > > > > >> Hi everyone, > > >> > > >> The PR temporarily disabling windows tests has been merged, so the > > windows > > >> checks shouldn't block progress for the time being. Please retrigger > any > > >> PRs you have open. We are still working hard on solving the windows > > >> instance issues. Once that is sorted out, we'll come back with more > > news. > > >> > > >> Cheers, > > >> > > >> Per > > >> > > > > > > -- Sincerely, Gavin M. Bell "Never mistake a clear view for a short distance." -Paul Saffo
Re: CI woes pt.2
Hey Junru, Please rebase and try again. Although, I'm finding this a bit strangelet me know how it goes and tomorrow morning I'll follow it up! Cheers, Per On Wed., 27 Feb. 2019, 10:40 pm Junru Shao, wrote: > Hey Per, > > CI for my PR still fails ( > > http://jenkins.mxnet-ci.amazon-ml.com/blue/organizations/jenkins/mxnet-validation%2Fwindows-gpu/detail/PR-14217/13/pipeline > ), > saying "ERROR: Queue task was cancelled". Should I rebase? > > Thanks, > Junru > > On Wed, Feb 27, 2019 at 10:36 AM Junru Shao > wrote: > > > Finally! Thanks Per for the hard work! > > > > On Wed, Feb 27, 2019 at 6:35 AM Per da Silva > wrote: > > > >> Hi everyone, > >> > >> The PR temporarily disabling windows tests has been merged, so the > windows > >> checks shouldn't block progress for the time being. Please retrigger any > >> PRs you have open. We are still working hard on solving the windows > >> instance issues. Once that is sorted out, we'll come back with more > news. > >> > >> Cheers, > >> > >> Per > >> > > >
Re: CI woes pt.2
Hey Per, CI for my PR still fails ( http://jenkins.mxnet-ci.amazon-ml.com/blue/organizations/jenkins/mxnet-validation%2Fwindows-gpu/detail/PR-14217/13/pipeline), saying "ERROR: Queue task was cancelled". Should I rebase? Thanks, Junru On Wed, Feb 27, 2019 at 10:36 AM Junru Shao wrote: > Finally! Thanks Per for the hard work! > > On Wed, Feb 27, 2019 at 6:35 AM Per da Silva wrote: > >> Hi everyone, >> >> The PR temporarily disabling windows tests has been merged, so the windows >> checks shouldn't block progress for the time being. Please retrigger any >> PRs you have open. We are still working hard on solving the windows >> instance issues. Once that is sorted out, we'll come back with more news. >> >> Cheers, >> >> Per >> >
Re: CI woes pt.2
Finally! Thanks Per for the hard work! On Wed, Feb 27, 2019 at 6:35 AM Per da Silva wrote: > Hi everyone, > > The PR temporarily disabling windows tests has been merged, so the windows > checks shouldn't block progress for the time being. Please retrigger any > PRs you have open. We are still working hard on solving the windows > instance issues. Once that is sorted out, we'll come back with more news. > > Cheers, > > Per >
CI woes pt.2
Hi everyone, The PR temporarily disabling windows tests has been merged, so the windows checks shouldn't block progress for the time being. Please retrigger any PRs you have open. We are still working hard on solving the windows instance issues. Once that is sorted out, we'll come back with more news. Cheers, Per
