If we can lets increase, but if we can't let's not allow for false negatives
Op vr 1 mei 2015 om 19:39 schreef Rajani Karuturi <raj...@apache.org>: > -1 on increasing the time > As a reviewer, I would like an immediate response on a pull request. By the > time I review the code, if CI gives a +1(or -1) I can close the PR then and > there instead of coming back again to merge. > > I would suggest running all the jobs under 30 min and increasing the number > of parallel jobs as much as possible. we are running 10 jobs now. may be we > could increase this to 15(dont know if this is possible) > > we should aim to run only the smoke tests and not the entire regression > suite always. > > Making the jobs run on containers will speed them up. This needs some work > on removing the sudo dependency on the jobs (which is required to install > some additional packages and marvin). > > ~Rajani > > On Fri, May 1, 2015 at 8:25 AM, Abhinandan Prateek < > abhinandan.prat...@shapeblue.com> wrote: > > > +1 for increased timeouts. > > > > At the moment we get less than 24 commits per day on master. Only a > couple > > on other branches per day. > > We can increase the timeout to upto 70 minutes or more. Will try to > ensure > > that in general a single run does not take more than an hour. > > > > A timeout window slightly higher will ensure that we do not see timeout > > failures. > > > > > On 30-Apr-2015, at 11:25 pm, Daan Hoogland <daan.hoogl...@gmail.com> > > wrote: > > > > > > Travis is starting to indue the, 'oh, a timeout again' - blindness in > > me. > > > Let's put a safe time on it. A result should mean something and those > > time > > > out are like the (decreasing) abundance of Jenkins failures. > > > > > > So +1 for increasing the time > > > > > > On Thu, 30 Apr 2015 18:46 Ian Duffy <i...@ianduffy.ie> wrote: > > > > > >>> Do we need to ask for an increase in run time? > > >> > > >> From my experience I wouldn't say its required however *it would be > very > > >> nice*. > > >> At the moment what we do is create new parallel jobs and balance the > > >> tests across them so each job is under 50mins. > > >> > > >> Anywho, just my 2c, see what others say/think. > > >> > > >> On 30 April 2015 at 17:34, David Nalley <da...@gnsa.us> wrote: > > >>> Do we need to ask for an increase in run time? > > >>> 50 minutes is the OSS default, but the ASF is a paying customer and > we > > >>> can ask for longer timeouts. > > >>> > > >>> --David > > >>> > > >>> On Thu, Apr 30, 2015 at 10:06 AM, Abhinandan Prateek > > >>> <abhinandan.prat...@shapeblue.com> wrote: > > >>>> One of the run did timeout. Will balance the runs. > > >>>> > > >>>>> On 30-Apr-2015, at 5:59 pm, Abhinandan Prateek < > > >> abhinandan.prat...@shapeblue.com> wrote: > > >>>>> > > >>>>> Yes, thanks for checking. I was worried that now some of them may > > >> start timing out. > > >>>>> I have another 10 suites tested, will add them once everything > seems > > >> fine. > > >>>>> > > >>>>> -abhi > > >>>>> > > >>>>> > > >>>>>> On 30-Apr-2015, at 5:32 pm, Rajani Karuturi <raj...@apache.org> > > >> wrote: > > >>>>>> > > >>>>>> after correcting the test file path, its working fine > > >>>>>> > > >>>>>> https://travis-ci.org/karuturi/cloudstack/jobs/60681263 > > >>>>>> > > >>>>>> > > >>>>>> > > >>>>>> ~Rajani > > >>>>>> > > >>>>>> On Thu, Apr 30, 2015 at 4:51 PM, Rajani Karuturi < > raj...@apache.org > > > > > >> wrote: > > >>>>>> > > >>>>>>> I think its due to this commit > > >>>>>>> > > >>>>>>> > > >> > > > https://github.com/apache/cloudstack/commit/b941480e0df0bfa3377e797126b96cf9b3fbee77 > > >>>>>>> > > >>>>>>> Here, test file name is changed from testname to > > >> [smoke,component]/testname > > >>>>>>> > > >>>>>>> But, while running each test file in the for loop, it prepends > the > > >> name > > >>>>>>> with smoke and hence, it cant find the file and none of the tests > > in > > >> the > > >>>>>>> file are run > > >>>>>>> > > >>>>>>> > > >>>>>>> > > >>>>>>> ~Rajani > > >>>>>>> > > >>>>>>> On Thu, Apr 30, 2015 at 4:37 PM, Abhinandan Prateek < > > >>>>>>> abhinandan.prat...@shapeblue.com> wrote: > > >>>>>>> > > >>>>>>>> It is possible, I will check. > > >>>>>>>> > > >>>>>>>>> On 30-Apr-2015, at 3:43 pm, Rajani Karuturi <raj...@apache.org > > > > >> wrote: > > >>>>>>>>> > > >>>>>>>>> Hey Abhi, > > >>>>>>>>> > > >>>>>>>>> In the recent travis runs, its not printing the test case in > > >> output ( > > >>>>>>>>> https://travis-ci.org/apache/cloudstack/jobs/60634577#L5443) > > >>>>>>>>> > > >>>>>>>>> It used to print the test case name and status ( > > >>>>>>>>> https://travis-ci.org/apache/cloudstack/jobs/59958134#L4205) > > >>>>>>>>> > > >>>>>>>>> Do you think it can be due to any recent changes? > > >>>>>>>>> > > >>>>>>>>> ~Rajani > > >>>>>>>>> > > >>>>>>>>> On Thu, Apr 30, 2015 at 10:32 AM, Abhinandan Prateek < > > >>>>>>>>> abhinandan.prat...@shapeblue.com> wrote: > > >>>>>>>>> > > >>>>>>>>>> > > >>>>>>>>>> There are more than 10 additional suites that can still be > > >> included > > >>>>>>>> to > > >>>>>>>>>> the travis-CI. > > >>>>>>>>>> Since the current set runs comfortably I will go ahead and add > > >> more. If > > >>>>>>>>>> the system gets overloaded, then we can balance the kind of > test > > >>>>>>>> suites and > > >>>>>>>>>> amount of test suits that run comfortably on travis. > > >>>>>>>>>> > > >>>>>>>>>> -abhi > > >>>>>>>>>> > > >>>>>>>>>> > > >>>>>>>>>> > > >>>>>>>>>> > > >>>>>>>>>> Find out more about ShapeBlue and our range of CloudStack > > related > > >>>>>>>> services > > >>>>>>>>>> > > >>>>>>>>>> IaaS Cloud Design & Build< > > >>>>>>>>>> http://shapeblue.com/iaas-cloud-design-and-build//> > > >>>>>>>>>> CSForge – rapid IaaS deployment framework< > > >>>>>>>> http://shapeblue.com/csforge/> > > >>>>>>>>>> CloudStack Consulting< > > >> http://shapeblue.com/cloudstack-consultancy/> > > >>>>>>>>>> CloudStack Software Engineering< > > >>>>>>>>>> http://shapeblue.com/cloudstack-software-engineering/> > > >>>>>>>>>> CloudStack Infrastructure Support< > > >>>>>>>>>> http://shapeblue.com/cloudstack-infrastructure-support/> > > >>>>>>>>>> CloudStack Bootcamp Training Courses< > > >>>>>>>>>> http://shapeblue.com/cloudstack-training/> > > >>>>>>>>>> > > >>>>>>>>>> This email and any attachments to it may be confidential and > are > > >>>>>>>> intended > > >>>>>>>>>> solely for the use of the individual to whom it is addressed. > > Any > > >>>>>>>> views or > > >>>>>>>>>> opinions expressed are solely those of the author and do not > > >>>>>>>> necessarily > > >>>>>>>>>> represent those of Shape Blue Ltd or related companies. If you > > >> are not > > >>>>>>>> the > > >>>>>>>>>> intended recipient of this email, you must neither take any > > action > > >>>>>>>> based > > >>>>>>>>>> upon its contents, nor copy or show it to anyone. Please > contact > > >> the > > >>>>>>>> sender > > >>>>>>>>>> if you believe you have received this email in error. Shape > Blue > > >> Ltd > > >>>>>>>> is a > > >>>>>>>>>> company incorporated in England & Wales. ShapeBlue Services > > India > > >> LLP > > >>>>>>>> is a > > >>>>>>>>>> company incorporated in India and is operated under license > from > > >> Shape > > >>>>>>>> Blue > > >>>>>>>>>> Ltd. Shape Blue Brasil Consultoria Ltda is a company > > incorporated > > >> in > > >>>>>>>> Brasil > > >>>>>>>>>> and is operated under license from Shape Blue Ltd. ShapeBlue > SA > > >> Pty > > >>>>>>>> Ltd is > > >>>>>>>>>> a company registered by The Republic of South Africa and is > > traded > > >>>>>>>> under > > >>>>>>>>>> license from Shape Blue Ltd. ShapeBlue is a registered > > trademark. > > >>>>>>>>>> > > >>>>>>>> > > >>>>>>>> Find out more about ShapeBlue and our range of CloudStack > related > > >> services > > >>>>>>>> > > >>>>>>>> IaaS Cloud Design & Build< > > >>>>>>>> http://shapeblue.com/iaas-cloud-design-and-build//> > > >>>>>>>> CSForge – rapid IaaS deployment framework< > > >> http://shapeblue.com/csforge/> > > >>>>>>>> CloudStack Consulting< > > http://shapeblue.com/cloudstack-consultancy/> > > >>>>>>>> CloudStack Software Engineering< > > >>>>>>>> http://shapeblue.com/cloudstack-software-engineering/> > > >>>>>>>> CloudStack Infrastructure Support< > > >>>>>>>> http://shapeblue.com/cloudstack-infrastructure-support/> > > >>>>>>>> CloudStack Bootcamp Training Courses< > > >>>>>>>> http://shapeblue.com/cloudstack-training/> > > >>>>>>>> > > >>>>>>>> This email and any attachments to it may be confidential and are > > >> intended > > >>>>>>>> solely for the use of the individual to whom it is addressed. > Any > > >> views or > > >>>>>>>> opinions expressed are solely those of the author and do not > > >> necessarily > > >>>>>>>> represent those of Shape Blue Ltd or related companies. If you > are > > >> not the > > >>>>>>>> intended recipient of this email, you must neither take any > action > > >> based > > >>>>>>>> upon its contents, nor copy or show it to anyone. Please contact > > >> the sender > > >>>>>>>> if you believe you have received this email in error. Shape Blue > > >> Ltd is a > > >>>>>>>> company incorporated in England & Wales. ShapeBlue Services > India > > >> LLP is a > > >>>>>>>> company incorporated in India and is operated under license from > > >> Shape Blue > > >>>>>>>> Ltd. Shape Blue Brasil Consultoria Ltda is a company > incorporated > > >> in Brasil > > >>>>>>>> and is operated under license from Shape Blue Ltd. ShapeBlue SA > > Pty > > >> Ltd is > > >>>>>>>> a company registered by The Republic of South Africa and is > traded > > >> under > > >>>>>>>> license from Shape Blue Ltd. ShapeBlue is a registered > trademark. > > >>>>>>>> > > >>>>>>> > > >>>>>>> > > >>>>> > > >>>>> Find out more about ShapeBlue and our range of CloudStack related > > >> services > > >>>>> > > >>>>> IaaS Cloud Design & Build< > > >> http://shapeblue.com/iaas-cloud-design-and-build//> > > >>>>> CSForge – rapid IaaS deployment framework< > > >> http://shapeblue.com/csforge/> > > >>>>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/ > > > > >>>>> CloudStack Software Engineering< > > >> http://shapeblue.com/cloudstack-software-engineering/> > > >>>>> CloudStack Infrastructure Support< > > >> http://shapeblue.com/cloudstack-infrastructure-support/> > > >>>>> CloudStack Bootcamp Training Courses< > > >> http://shapeblue.com/cloudstack-training/> > > >>>>> > > >>>>> This email and any attachments to it may be confidential and are > > >> intended solely for the use of the individual to whom it is addressed. > > Any > > >> views or opinions expressed are solely those of the author and do not > > >> necessarily represent those of Shape Blue Ltd or related companies. If > > you > > >> are not the intended recipient of this email, you must neither take > any > > >> action based upon its contents, nor copy or show it to anyone. Please > > >> contact the sender if you believe you have received this email in > error. > > >> Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue > > >> Services India LLP is a company incorporated in India and is operated > > under > > >> license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a > > >> company incorporated in Brasil and is operated under license from > Shape > > >> Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic > > of > > >> South Africa and is traded under license from Shape Blue Ltd. > ShapeBlue > > is > > >> a registered trademark. > > >>>> > > >>>> Find out more about ShapeBlue and our range of CloudStack related > > >> services > > >>>> > > >>>> IaaS Cloud Design & Build< > > >> http://shapeblue.com/iaas-cloud-design-and-build//> > > >>>> CSForge – rapid IaaS deployment framework< > > http://shapeblue.com/csforge/ > > >>> > > >>>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/> > > >>>> CloudStack Software Engineering< > > >> http://shapeblue.com/cloudstack-software-engineering/> > > >>>> CloudStack Infrastructure Support< > > >> http://shapeblue.com/cloudstack-infrastructure-support/> > > >>>> CloudStack Bootcamp Training Courses< > > >> http://shapeblue.com/cloudstack-training/> > > >>>> > > >>>> This email and any attachments to it may be confidential and are > > >> intended solely for the use of the individual to whom it is addressed. > > Any > > >> views or opinions expressed are solely those of the author and do not > > >> necessarily represent those of Shape Blue Ltd or related companies. If > > you > > >> are not the intended recipient of this email, you must neither take > any > > >> action based upon its contents, nor copy or show it to anyone. Please > > >> contact the sender if you believe you have received this email in > error. > > >> Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue > > >> Services India LLP is a company incorporated in India and is operated > > under > > >> license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a > > >> company incorporated in Brasil and is operated under license from > Shape > > >> Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic > > of > > >> South Africa and is traded under license from Shape Blue Ltd. > ShapeBlue > > is > > >> a registered trademark. > > >> > > > > Find out more about ShapeBlue and our range of CloudStack related > services > > > > IaaS Cloud Design & Build< > > http://shapeblue.com/iaas-cloud-design-and-build//> > > CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/> > > CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/> > > CloudStack Software Engineering< > > http://shapeblue.com/cloudstack-software-engineering/> > > CloudStack Infrastructure Support< > > http://shapeblue.com/cloudstack-infrastructure-support/> > > CloudStack Bootcamp Training Courses< > > http://shapeblue.com/cloudstack-training/> > > > > This email and any attachments to it may be confidential and are intended > > solely for the use of the individual to whom it is addressed. Any views > or > > opinions expressed are solely those of the author and do not necessarily > > represent those of Shape Blue Ltd or related companies. If you are not > the > > intended recipient of this email, you must neither take any action based > > upon its contents, nor copy or show it to anyone. Please contact the > sender > > if you believe you have received this email in error. Shape Blue Ltd is a > > company incorporated in England & Wales. ShapeBlue Services India LLP is > a > > company incorporated in India and is operated under license from Shape > Blue > > Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in > Brasil > > and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd > is > > a company registered by The Republic of South Africa and is traded under > > license from Shape Blue Ltd. ShapeBlue is a registered trademark. > > >
