Re: [us...@bb.net] Query related to getting buildbot object instance

2016-06-14 Thread Pierre Tardy
Hi Nilay, I am not sure exactly what is your request. Usually, when you need customization that is not possible by just configuring the buildbot object, you might want to just subclass that object. In this case, you would mailnotifier do not have much option to customize the subject of the

Re: [us...@bb.net] buildbot retains memory of an earlier location of a buildslave?

2016-06-14 Thread Pierre Tardy
Hi, Looks indeed like an interresting problem. Did you try to reboot the master? The master might indeed store the workdir, but I would expect it to be reset when the work is reconnecting. Which version of buildbot is that? Also thing to check is svn. could svn cache something? Regards Pierre

Re: [us...@bb.net] Disable read-only www view

2016-05-28 Thread Pierre Tardy
Hi Daniel UserPasswordAuth is actually to configure authorizations for any actions on the buildbot. There is no mechanism to prevent read right now. You can setup basic auth on nginx though http://nginx.org/en/docs/http/ngx_http_auth_basic_module.html I feel this should fit your need. let us

Re: [us...@bb.net] Disable read-only www view

2016-05-29 Thread Pierre Tardy
Glad to help! Le dim. 29 mai 2016 à 08:31, Daniel Collin <dan...@collin.com> a écrit : > Hi Pierre, > > I have set this up now and it works just the way I want it. > > Thanks for the help! > > Cheers > > On 28 May 2016, at 22:52, Pierre Tardy <ta

Re: [us...@bb.net] buildbot retains memory of an earlier location of a buildslave?

2016-06-16 Thread Pierre Tardy
1 Webster St. > Monterey, CA 93940 > (831) 582-4907 <%28831%29%20582-4907> > g...@nwra.com > > Original message > From: Pierre Tardy <tar...@gmail.com> <tar...@gmail.com> > Date: 6/14/16 1:12 PM (GMT-08:00) > To: Greg Bullock <g...@nwra.com>

Re: [us...@bb.net] Splitting master folder into config and log folders

2016-02-04 Thread Pierre Tardy
Hi Francesco. You can specify the master's basedir in the buildbot.tac file. HTH Pierre Le jeu. 4 févr. 2016 à 14:59, Francesco Di Mizio a écrit : > Is there any way to do this? > > In a context where the master is dockerized, being able to tell buildbot > to use a

Re: [us...@bb.net] build.complete always false?

2016-02-04 Thread Pierre Tardy
for build in builds > > $log.debug('build: ', build) > > $log.debug('build.complete: ', build.complete) > > > > if build.state_string == 'finished' > > continue > >

Re: [us...@bb.net] Splitting master folder into config and log folders

2016-02-04 Thread Pierre Tardy
t; what I meant was more about having a folder with the config (i.e. > master.cfg) and one with the stuff generated at runtime by the master > itself. > > Chhers, > Francesco > > On Thu, Feb 4, 2016 at 7:44 PM, Pierre Tardy <tar...@gmail.com> wrote: > >> Hi

Re: [us...@bb.net] BuildBot versus Jenkins

2016-02-02 Thread Pierre Tardy
Hi Greg, Thanks for the fine answer. It is hard for us the devs/maintainers to answer that kind of question, as we are a little bit biased. This is nevertheless a very good summary of the pros and cons of the two tools, and can only agree to all of that. Pierre Le mar. 2 févr. 2016 à 22:32, Greg

[us...@bb.net] Buildbot-0.9.0b6

2016-01-21 Thread Pierre Tardy
I am very happy to announce the release of buildbot 0.9.0 beta 6, available right now from your local cheeseshop! The release notes are at http://docs.buildbot.net/latest/relnotes/0.9.0b6.html Highlight is the landing of the buildbot-data module in the UI, which sets a long term api for your

Re: [us...@bb.net] Buildbot on Mac OS X

2016-01-26 Thread Pierre Tardy
I use osx for all my buildbot development, so I can say master and slave work well on osx. For osx like for linux, we heavily recommend to use virtualenv+pip instead of trying to install using "native" package managers. My own experience with "modern" osx is that I get a much better experience

[us...@bb.net] Buildbot 0.9.0b7

2016-02-15 Thread Pierre Tardy
Hello, I am very happy to announce the release of buildbot 0.9.0 beta 7. As we continue the stabilisation for the release of buildbot nine, this beta contains several bug fixes for the UI, and a bunch of patches increasing compatibility with recent versions of mysql and postgresql databases.

Re: [us...@bb.net] Splitting master folder into config and log folders

2016-02-19 Thread Pierre Tardy
;> >> those above are what my builders are named. >> >> >> >> On Sun, Feb 7, 2016 at 6:15 PM, Dustin J. Mitchell <dus...@v.igoro.us> >> >> wrote: >> >>> >> >>> Can you give some more context for that error? >> >>> >> >>> On

Re: [us...@bb.net] Gathering and displaying build time statistics on buildbot?

2016-03-15 Thread Pierre Tardy
Hi Dan, We have started last year interesting project in gsoc to connect buildbot to a stats processing database like influxdb. http://docs.buildbot.net/latest/developer/stats-service.html http://docs.buildbot.net/latest/manual/cfg-global.html#cfg-stats-service Yes.. its built for nine. For

Re: [us...@bb.net] Using Buildbot to track machine learning tasks?

2016-03-15 Thread Pierre Tardy
Hi Joe, Indeed, buildbot is designed to be a pretty generic task runner framework. It does not have to be triggered by source code change. The features you'll probably need are: authentication plugins: http://docs.buildbot.net/latest/manual/cfg-www.html#web-authentication Forcescheduler:

Re: [us...@bb.net] Force button disappears when I change the buildername

2016-03-15 Thread Pierre Tardy
Indeed, this is a known issue: http://trac.buildbot.net/ticket/2237 schedulers mostly dont work with reconfig on nine (yet). It is not a very hard thing to do, it just that nobody did the work yet. Pierre Le lun. 14 mars 2016 à 17:15, Ed Singleton a écrit : > Using

Re: [us...@bb.net] Gathering and displaying build time statistics on buildbot?

2016-03-15 Thread Pierre Tardy
Le mar. 15 mars 2016 à 14:32, Dan Kegel <d...@kegel.com> a écrit : > On Tue, Mar 15, 2016 at 6:24 AM, Pierre Tardy <tar...@gmail.com> wrote: > > We have started last year interesting project in gsoc to connect > buildbot > > to a stats processing da

Re: [us...@bb.net] Using buildbot's DecodeRC

2016-03-16 Thread Pierre Tardy
Le mar. 15 mars 2016 à 22:35, honas grael a écrit : > Hi reading the docs I came across > > *decodeRC**This is a dictionary that decodes exit codes into results > value. For example, {0:SUCCESS,1:FAILURE,2:WARNINGS}, will treat the exit > code 2 as WARNINGS. The default

Re: [us...@bb.net] make prebuilt_frontend

2016-03-29 Thread Pierre Tardy
Hi Georges, The prebuilt_frontend make target was made for the time before the first beta was released, in order to allow people to test nine before it is actually release without the hassle of installing a recent version of npm. We barely monitor the result of the generation of this packages, so

[us...@bb.net] buildbot 0.9.0 beta 8

2016-04-11 Thread Pierre Tardy
Hello, I am very happy to announce the release of buildbot 0.9.0 beta 8. During the last 2 months since the release of beta7, we are delighted to see more and more people giving feedback, contributing fixes, or forward porting. Please continue this great move and adopt buildbot nine!

Re: [us...@bb.net] Migrating to Nine and our capability system

2016-03-23 Thread Pierre Tardy
Le mar. 22 mars 2016 à 22:07, Georges Racinet a écrit : > Hi there, > > After a long time during which we couldn't do much more than maintaining > our instances, we (Anybox) are considering migrating our buildbots to Nine. > This is good news! > > Among the many things

Re: [us...@bb.net] lost force schedules

2016-04-01 Thread Pierre Tardy
Hi Greg and Honas, I am using buildbot nine, on several environments, and I have never seen lost builds. It is possible that the web UI gets a lost indeed sometime, and you just have to reload the web page in order to get a proper reconnection. There is notably this bug, which could probably

Re: [us...@bb.net] HOWTO pull build logic from project

2016-04-29 Thread Pierre Tardy
Hi Stefan, buildbot_travis is not dead, actually I use it for ~20 internal projects. Its maintained here, and work with buildbot nine: https://github.com/tardyp/buildbot_travis Here is the step that takes care of dynamically creating the steps according to the config:

Re: [us...@bb.net] Collating test results using buildbot

2016-05-20 Thread Pierre Tardy
Le ven. 20 mai 2016 à 16:22, honas grael a écrit : > Hi everyone, > I'm using Windows and Buildbot 0.9.4b, > First thing is to do: pip install -U 'buildbot[bundle]==0.9.0b9' please dont use old betas.. :) > I have managed to create a build and run tests. But now I

Re: [us...@bb.net] [de...@bb.net] Weekly Meeting Notes

2016-05-20 Thread Pierre Tardy
Hi guys, Sorry I was not able to attend. > > Bug 2340 Update (djmitche, 16:37:19) > Turning on protected branches in Github (djmitche, 16:39:24) > > https://github.com/blog/2051-protected-branches-and-required-status-checks > (djmitche, 16:39:46) > proposal is to protect the

[us...@bb.net] Buildbot 0.9.0 beta 9

2016-05-10 Thread Pierre Tardy
Hello, I am very happy to announce the release of buildbot 0.9.0 beta 9. Another month, another beta! Right.. last time, I said the next release will be a rc. Unfortunately, we did not have the chance to fix all remaining bugs

Re: [us...@bb.net] buildbot-www b9 can not be found

2016-05-11 Thread Pierre Tardy
Indeed, for some reason my release script silently failed to upload buildbot_www. This is now resolved. Sorry for the trouble, and thanks for reporting. Le mer. 11 mai 2016 à 12:32, Francesco Di Mizio a écrit : > Hello guys, > > wanted to mess around with b9 but I

Re: [us...@bb.net] Triggered builds getting skipped

2016-04-14 Thread Pierre Tardy
Hi Ed, I would suggest to upgrade to beta8 It contains this fix: https://github.com/buildbot/buildbot/pull/2069 Which can lead to exceptions is nextWorker callback to be completely ignored, and buildrequests not claimed. If the problem persists, I would suggest to create a trac, and append the

Re: [us...@bb.net] Triggered builds getting skipped

2016-04-18 Thread Pierre Tardy
at False should be the default for this setting as it > only appears to be a performance enhancement. I'd also suggest that it > should check whether the properties of the builds are the same before > collapsing them. > > Thanks for all your help with this. > > Ed > > On Fri, Apr 15

Re: [us...@bb.net] Triggered builds getting skipped

2016-04-18 Thread Pierre Tardy
Please have a look at this PR, which is trying to clarify the build request collapser. https://github.com/buildbot/buildbot/pull/2128 I agree that we should default to False, and I will bring up the topic in the next weekly meeting for a decision. Le lun. 18 avr. 2016 à 12:45, Pierre Tardy

Re: [us...@bb.net] retrieving build properties

2016-07-26 Thread Pierre Tardy
Please have a look at the documentation for REST api: http://docs.buildbot.net/latest/developer/rest.html#build there is a paragraph on how to add properties to the result Regards Le mar. 26 juil. 2016 à 23:30, Dimitri Naydich a écrit : > Hi, > > I wonder if there is

Re: [us...@bb.net] Same workdir for two builders

2016-07-29 Thread Pierre Tardy
Hi Ryan, What we usually recommend in order to implement builders that have a share directory is just to use ../ in your command. for example, if you need a shared virtualenv for all your builders you would say in your shell commands: SANDBOX=$WORDIR/../sandbox virtualenv $SANDBOX .

Re: [us...@bb.net] buildbot CPU usage

2016-08-02 Thread Pierre Tardy
Hi, Pollers are usually indeed not scaling as they, hmm, poll. What you are describing here is hints that the twisted reactor thread is always busy, which should not happen if you only start 10 builds. You might have some custom steps which are doing something heavily cpu bound in the main

Re: [us...@bb.net] buildbot CPU usage

2016-08-02 Thread Pierre Tardy
t; polled was under 50 or so. >> What really helped was not using pollers anymore, and switching to >> gitlab's webhooks. >> We're at 190 now, of which 57 are still using gitpoller, and it's >> almost ok. (I really have >> to move the last 57 onto gitlab. Or, well, si

Re: [us...@bb.net] filter 0.9.0rc1 waterfall by tags?

2016-07-20 Thread Pierre Tardy
Unfortunately this feature is not present in current version of waterfall plugin. It's only present in the regular builder page. Regards Le mer. 20 juil. 2016 20:45, Dave Vitek a écrit : > Hi all, > > We have recently upgraded from an older buildbot version to 0.9.0rc1.

[us...@bb.net] Buildbot 0.9.0 rc1

2016-07-07 Thread Pierre Tardy
Hello, I am very happy to announce the release of buildbot 0.9.0 rc1. That's it! The release gating bug count has reached zero! This month was pretty calm, with mostly small bug fixes, even though some cool features managed to sneak in: - new HipchatStatusPush to report build results to

Re: [us...@bb.net] Hide builds from Buildbot Home & Waterfall View

2016-07-04 Thread Pierre Tardy
Hi Markus, It is a good idea to indeed schedle maintainance tasks on the buildbot. There is no way to actually hide some builders apart from hcking the UI to hide them. What I usually do in my infra is to just have a separate buildbot for those high frequency jobs. Le lun. 4 juil. 2016 à

Re: [us...@bb.net] Buildbot not sending email status updates

2016-08-05 Thread Pierre Tardy
t I > was doing wrong and you did not spot anything obvious. I think that before > I pursue this further I should upgrade. > > Thanks, > hank > > > > From: Pierre Tardy [mailto:tar...@gmail.com] > Sent: Friday, August 05, 2016 11:03 AM > To: Barta, Hank <ha

Re: [us...@bb.net] SQLAlchemy and SQLAlchemy-Migrate versions?

2016-08-08 Thread Pierre Tardy
Hi Hank, It is highly recommended to use virtualenv to install buildbot. Messing up with distro python packages with such options as --force-reinstall will lead to incoherent state and maybe instability of other distro programs. http://trac.buildbot.net/wiki/RunningBuildbotWithVirtualEnv Le

Re: [us...@bb.net] SQLAlchemy and SQLAlchemy-Migrate versions?

2016-08-08 Thread Pierre Tardy
have this conflict with the older > stuff ( 0.8.8 on Ubuntu 14.04) but it did not send email notification > either. > > Thanks, > hank > > From: Pierre Tardy [mailto:tar...@gmail.com] > Sent: Monday, August 08, 2016 1:07 PM > To: Barta, Hank <hank.ba...@sandc.com>

Re: [us...@bb.net] Multi-master 0.9.3 anecdotes.

2017-02-03 Thread Pierre Tardy
Hi Neil, The timer starts when the worker is first configured. but only if notify_on_missing is configured. that may be a reason why you do not see the bug for ancient workers Pierre Le ven. 3 févr. 2017 à 21:59, Neil Gilmore a écrit : > Hi Andrej, > > Thanks for the

Re: [us...@bb.net] 0.9.3, mostly finished, and another question.

2017-02-01 Thread Pierre Tardy
> > > Hi everyone. > > Thanks to everyone on this list, and Pierre's patches in particular, we > now have our masters running 0.9.3, with a couple, um, enhancements. In > particular, we're using Pierre's patches to enable reconfiguration in > the schedulers. My users thank you. > > I'm glad that

Re: [us...@bb.net] Need a Python 3 enabled builder for buildbot.test

2017-02-05 Thread Pierre Tardy
Le dim. 5 févr. 2017 à 06:52, Craig Rodrigues <rodr...@crodrigues.org> a écrit : > > > On Fri, Feb 3, 2017 at 2:32 AM, Pierre Tardy <tar...@gmail.com> wrote: > > Hi Craig, > > So it is not realistic to ask people to try python3 as well unless we have >

Re: [us...@bb.net] Need a Python 3 enabled builder for buildbot.test

2017-02-03 Thread Pierre Tardy
, Craig Rodrigues <rodr...@crodrigues.org> a écrit : > On Thu, Feb 2, 2017 at 8:37 PM, Craig Rodrigues <rodr...@crodrigues.org> > wrote: > > On Wed, Feb 1, 2017 at 4:03 AM, Pierre Tardy <tar...@gmail.com> wrote: > > > > I'd love to help more on py3, but I rea

Re: [us...@bb.net] buildbot CPU usage

2017-02-03 Thread Pierre Tardy
doing anything. > > Will give 9.3 but at this point I doubt it'll help. > > Thanks! > > > On Wed, Feb 1, 2017 at 4:56 PM, Pierre Tardy <tar...@gmail.com> wrote: > > > > Le lun. 30 janv. 2017 à 17:49, Francesco Di Mizio < > francescodimi...@gmail.com&

Re: [us...@bb.net] [de...@bb.net] Buildbot Weekly Summary

2017-01-24 Thread Pierre Tardy
Here are the logs for the weekly meeting Meeting started by tardyp at 17:00:32 UTC (full logs ). Meeting summary 1. *introduction* (tardyp

Re: [us...@bb.net] Allowing anonymous read-only access to www view

2017-02-22 Thread Pierre Tardy
Hi Elliot, Here with util.AnyEndpointMatcher(role="JuliaLang") You got every action that is locked to your github group. What you need is just to add more detailled configuration to only restrict endpoints that need restrictions: util.StopBuildEndpointMatcher(role="JuliaLang"),

Re: [us...@bb.net] Customizing the builder template

2017-02-24 Thread Pierre Tardy
Hi Chris. There is a custom_templates_dir option described in https://docs.buildbot.net/latest/manual/cfg-www.html#web-server The documentation is actually quite sparse, and we could use a more detailled guide on how to use it :-/ In order to achieve all the real-time features, the angularJS has

Re: [us...@bb.net] Cannot Stop: you need to have role 'admins'

2017-02-24 Thread Pierre Tardy
Hi Chris, Did you resolve this issue? I am not sure if email property is populated by default if you are using solely RemoteUserAuth. You might need to implement or use an existing user info provider. http://docs.buildbot.net/latest/manual/cfg-www.html#user-information Perhaps using

Re: [us...@bb.net] Cannot Stop: you need to have role 'admins'

2017-02-24 Thread Pierre Tardy
myusername > > Presumably, it's blocking me because my config has an email address, but > it's effectively checking with a username. > > I'll try the RolesFromUsername class. > > > On Fri, Feb 24, 2017 at 7:23 AM, Pierre Tardy <tar...@gmail.com> wrote: > >

Re: [us...@bb.net] Programmatically triggering forced schedulers

2017-02-12 Thread Pierre Tardy
Hi Eliot, Buildbot uses cookies to authorize a REST api request if the authentication scheme is Oauth2. There is at the moment no other way to authenticate. Probably this would be handy to have access token generation for us with scripts. With Buildbot 0.9.4 there is a new JWT implementation

Re: [us...@bb.net] Html Status ImportError

2017-02-15 Thread Pierre Tardy
, > )) > > > On Wed, Jan 11, 2017 at 6:24 AM, Chris Spencer <chriss...@gmail.com> > wrote: > > Thanks. > > On Wed, Jan 11, 2017 at 3:10 AM, Pierre Tardy <tar...@gmail.com> wrote: > > Hi Chris, > Please see this section of the upgrade manual > &

Re: [us...@bb.net] MailNotifier unable to send

2017-02-16 Thread Pierre Tardy
Hi, in buildbot nine, there are two way of supporting encrypted connection. useTls=True This will actually connect over TCP, and then switch to encrypted after the SMTP command STARTTLS useSmtps=True This will use the smtps protocol, which just use SMTP over standard TLS connection If useTls

Re: [us...@bb.net] How to view build step output?

2017-02-15 Thread Pierre Tardy
Hi, Please see https://nine.buildbot.net/#/builders/2/builds/109734 for example of a working UI. >From what you are describing, it looks like you have REST api issues of websocket issues. Please have a look in the chrome developer console, and tell us if you see any errors in it. Pierre Le

[us...@bb.net] Buildbot 0.9.4

2017-02-11 Thread Pierre Tardy
install 'buildbot[bundle]==0.9.4' Please continue the great move and adopt Buildbot Nine! Here is the list of contributors for Buildbot 0.9.4, big thanks to all of you! % git shortlog — no-merges -s -n -e v0.9.4…v0.9.3 227 Craig Rodrigues 184 Vladimir Rutsky 70 Pierre Tardy 17 Tom Prince 3

Re: [us...@bb.net] Buildbot-worker 0.9.3 fails to start on Windows

2017-01-16 Thread Pierre Tardy
Hi, Buildbot at the moment only works with python 2. We are working at the python3 port but it is not quite ready (I'm hoping we can have worker support for 0.9.4 thanks to the great work from Craig) As per the Windows support, we are supporting windows by running unit test suite and integration

Re: [us...@bb.net] buildbot CPU usage

2016-08-19 Thread Pierre Tardy
Hi Francesco, Your described setup looks sane to me. The problems we are trying to catch are cpu spikes, as far as I understand, which does not happen for very long, but are very annoying for users, as it is blocking the reactor. This problem is not easy to see in the profile you sent, as this

Re: [us...@bb.net] Restrict user access to /json and other magic urls

2016-08-19 Thread Pierre Tardy
Hi Narunas, The security schemes implemented in buildbot was mainly done to prevent users to do some restricted actions on the bot. I was not aware of the view restriction functionality in buildbot eight. Indeed it looks like to very well implemented if the json api is not accounting for this

Re: [us...@bb.net] buildbot CPU usage

2016-08-19 Thread Pierre Tardy
usage was too high and see which functions were executed. > > Thanks, > Vasily > 19 авг. 2016 г. 11:57 пользователь "Pierre Tardy" <tar...@gmail.com> > написал: > > Hi Francesco, >> >> Your described setup looks sane to me. >> >> The proble

Re: [us...@bb.net] "could not rebuild: build still not finished"

2016-08-19 Thread Pierre Tardy
I can't find a big reason for that. You can try to remove the check and see what that does. Pierre Le ven. 19 août 2016 à 21:50, Dan Kegel a écrit : > On v0.8.11-pre-275-g1e72918... > > grr. I wanted to spam all my builders with identical repeats of a try > build (to verify

Re: [us...@bb.net] URL filtering parameters?

2017-02-28 Thread Pierre Tardy
Hi Chris, This is a feature that has not yet been ported, this feature is related to the other feature you requested about displaying the branch in the list of builds. Once you can display it, its trivial to filter it with angularjs template. Pierre On Mon, Feb 27, 2017 at 10:36 PM Chris

Re: [us...@bb.net] Using SSH keys with GitPoller and Git step?

2017-03-02 Thread Pierre Tardy
Hi Chris What I usually do is to put the credentials into the ~/.gitconfig of the worker. You can use the insteadOf directive of the gitconfig so that you buildbot looks like git://myserver_id/repo Then you gitconfig has something like: [url "ssh://bot:passw...@myserver.mycompany.com/"]

Re: [us...@bb.net] 0.9.0rc1/2, multi-master, and schedulers.

2016-08-25 Thread Pierre Tardy
Hi Neil Le mer. 24 août 2016 à 22:14, Neil Gilmore a écrit : > Hi everyone, > > Thanks for the advice previously. It's helped a lot. I'll be restarting > our master tomorrow with bits of new code. In particular the new log code, > a UI fix that came from rc2 (and ended

Re: [us...@bb.net] buildbot 0.9.0 rc3

2016-09-15 Thread Pierre Tardy
be very difficult to implement as there are already many gitlab components in buildbot. Le jeu. 15 sept. 2016 00:14, Dan Kegel <d...@kegel.com> a écrit : > On Wed, Sep 14, 2016 at 2:36 PM, Pierre Tardy <tar...@gmail.com> wrote: > > buildbot travis is an experimental buildb

Re: [us...@bb.net] buildbot 0.9.0 rc3

2016-09-20 Thread Pierre Tardy
> > > For the record, I'm working these days with a team that started using > Gitlab CI yesterday ! This is a mild disapointment, because I've been > mentioning buildbot for a while to them (well and CI in general). I didn't > get a demo yet, but I can take the opportunity to look at it. > > So

Re: [us...@bb.net] buildbot 0.9.0 rc3

2016-09-20 Thread Pierre Tardy
Le mar. 20 sept. 2016 à 06:23, Ryan Schmidt <build...@ryandesign.com> a écrit : > > > On Sep 14, 2016, at 4:36 PM, Pierre Tardy <tar...@gmail.com> wrote: > > > > Hi Ryan > > > > nine.buildbot.net has indeed been a mess as we weren't really using i

Re: [us...@bb.net] Using buildbot 0.9rc3 in production

2016-09-23 Thread Pierre Tardy
Le ven. 23 sept. 2016 à 21:30, Elliot Saba a écrit : > Hello there, > Hi Elliot, Glad to hear you are working on the upgrade! > The first question is, my buildbot worker instance seems to be > disconnecting immediately as soon as a build starts. You can see this by >

Re: [us...@bb.net] buildbot 0.9.0 rc3

2016-09-20 Thread Pierre Tardy
Le mar. 20 sept. 2016 à 14:23, Georges Racinet <graci...@anybox.fr> a écrit : > On 09/20/2016 02:17 PM, Pierre Tardy wrote: > > Georges, > Anonymous login does not work on that host. > > Just retested, it works for me, supplying "anonymous" as login, and a >

Re: [us...@bb.net] 0.9.0rc1/2, multi-master, and schedulers.

2016-08-25 Thread Pierre Tardy
> > > I'm not a database guy, per se, but wouldn't any database you'd want to > run multi-master on be able to notify the other masters? Postgres, for > example, has NOTIFY and LISTEN. I'm not much of a SQLAlchemy guy, either, > but a cursory search shows an Event API. > Indeed, modern databases

Re: [us...@bb.net] buildbot CPU usage

2016-08-26 Thread Pierre Tardy
ed it, waited 1 min and saw the spike, then stopped after a few > secs. Attached the json. > Awesome tool btw, work wonders! > > On Thu, Aug 25, 2016 at 1:14 PM, Pierre Tardy <tar...@gmail.com> wrote: > >> You can try to hit the button in the morning with a two hours gather

Re: [us...@bb.net] buildbot CPU usage

2016-08-26 Thread Pierre Tardy
ded as > additional logs. > > On Fri, Aug 26, 2016 at 11:51 AM, Pierre Tardy <tar...@gmail.com> wrote: > >> Cool! >> I can indeed see 3 spikes. >> >> Looks related to logs and logs compression. >> >> What is the HW spec of your master machine? >> Ho

Re: [us...@bb.net] Buildbot 0.8 GitHub authentication

2016-09-28 Thread Pierre Tardy
Hi Ryan, Oauth2 is not supported in eight. I think the easiest way to implement it in eight is by using a reverse proxy method I had very good results for protecting kibana using this project: https://github.com/bitly/oauth2_proxy Pierre Le jeu. 29 sept. 2016 à 03:31, Ryan Schmidt

Re: [us...@bb.net] Confusing documentation links "latest" and "current"

2016-09-28 Thread Pierre Tardy
Hi Ryan, There is actually documentation archive for each version e.g http://docs.buildbot.net/0.8.12/ There is also a big warning in the head of each page of the latest doc explaining the difference. We did that to try and remove some of the confusion. its not perfect. Regards Le jeu. 29

Re: [us...@bb.net] More anecdotes.

2016-09-29 Thread Pierre Tardy
Hi Neil, Good to know your multimaster setup is nearly done! Indeed scripted multimaster would be great! docker-compose setup or ansible playbook would be perfect I think For the other part of the annecdote I think we are still chasing the same bug right. At some point somehow, you got a worker

Re: [us...@bb.net] Using buildbot 0.9rc3 in production

2016-09-28 Thread Pierre Tardy
Le ven. 23 sept. 2016 à 22:45, Elliot Saba a écrit : > Hello Pierre, thank you for the very quick response! > Hi Eliot, thats why I try to answer quickly. If I dont, then I forgot to answer > > Using `ps -ef | grep python`, I can see that my buildbot-worker process >

Re: [us...@bb.net] Using buildbot 0.9rc3 in production

2016-10-03 Thread Pierre Tardy
> > 1) Is it possible to arrange the rows of the table views such as the > "Schedulers" view or the "Workers" view? They do not seem to be sorted in > any particular way, and it would be useful to either sort them > alphabetically, or even better allow sorting along arbitrary columns. >

Re: [us...@bb.net] Simultaneous nightly schedulers not working after change from 0.8.12 to 0.9.0

2016-10-26 Thread Pierre Tardy
Two guys with the same symptoms. Looks like we need a bug in Trac!  Le mer. 26 oct. 2016 18:40, Neil Gilmore a écrit : > Good morning everyone, > > We had a similar problem on our 0.9.0rc2 multi-master system. > > Someone changed their builder's schedule to do their

Re: [us...@bb.net] ForceScheduler trouble converting from 0.8.12 to 0.9.0

2016-10-18 Thread Pierre Tardy
Le mar. 18 oct. 2016 à 10:35, Tristram, Falk a écrit : > Hi Pierre, > > > > it would be great if you could add an API warning, when someone tries to > actually use this function. > We can try to make something like this indeed. I'll give it a try. > > > Could you give

Re: [us...@bb.net] ForceScheduler trouble converting from 0.8.12 to 0.9.0

2016-10-20 Thread Pierre Tardy
Hi, This is a good idea indeed. Instead of trying to play with sighup, why not calling the reconfig API, as you are already in the master? Here is an AnyBranchScheduler version that instead of creating new builds, will just reconfig the master: class

Re: [us...@bb.net] Buildbot doesn't run the pyflakes test

2016-10-24 Thread Pierre Tardy
Hi Timo >From what you describe you forgot to connect a worker to you bot.. Regards Le lun. 24 oct. 2016 14:17, Timo Reichl a écrit : > Hi there, > > I have a question about Buildbot v0.9.0.post1-py2. > Steps I have followed: > > - pip2 install buildbot > - buildbot

Re: [us...@bb.net] NestedParameter retrieval

2016-11-23 Thread Pierre Tardy
Hi Ricardo, You can see in the properties tab from the build what the properties are looking like. In your example, the nested parameters are compiled into a dictionnary. so you should write: buildFactory.addStep(steps.Git( doStepIf = lambda step: step.build.getProperty('options',

Re: [us...@bb.net] multi-master and workers connection 0.9.1

2016-11-24 Thread Pierre Tardy
Hi Mike, In an asymetric multimaster (one master per project), the only way to share workers between masters is to use a LatentWorker combined with another resource scheduler like Mesos, OpenStack or Docker Swarm. (OpenStack sees the prod for some our users, I did try mesos on a development

Re: [us...@bb.net] 0.9.0rc2, multi-master, and anecdotes on reconfig.

2016-11-04 Thread Pierre Tardy
Hi Neil and Pieter, This is a known problem in buildbot nine that schedulers are not reconfigurable. The need to implement the reconfigureService API, which they don't. This is not a big amount of work, but this has not been done yet. http://trac.buildbot.net/ticket/2237 The workaround is to

[us...@bb.net] Buildbot 0.9.1

2016-11-01 Thread Pierre Tardy
' Please continue the great move and adopt buildbot nine! Here is the list of contributors for buildbot 0.9.1, big thanks to all of you! 135 Pierre Tardy 50 Craig Rodrigues 30 Benoît Allard 21 Sean Kelly 19 Tom Prince 14 Valeria 10 Mikhail Sobolev 7 Scott Bragg

Re: [us...@bb.net] multi-master and MailNotifier.

2016-10-13 Thread Pierre Tardy
Hi Neil, thanks for the feedback, > But we also had one MailNotifier that just used builders=[]. The > > comments by it say that that MailNotifier is for worker-missing emails. > > That one got separated out yesterday. > looks good! > At present, every failure email sent has a URL beginning

Re: [us...@bb.net] Convert buildbot 0.8 sqlite database to postgresql

2016-10-17 Thread Pierre Tardy
Le lun. 17 oct. 2016 à 21:18, Ryan Schmidt <build...@ryandesign.com> a écrit : > > > On Oct 17, 2016, at 3:19 AM, Pierre Tardy <tar...@gmail.com> wrote: > > > > Hello. > > On buildbot eight, the database only store information of the build > requests befo

Re: [us...@bb.net] Anotheranecdote from the multi-master trenches.

2016-12-08 Thread Pierre Tardy
Hi Neil, Thanks for the detailed report. I see few chances that the symptoms you are describing could be explained by a failure of the multi-master messaging. If the data api showed the builders that means that the builders were seen to be attached to 0 masters. There is a "show old builders"

Re: [us...@bb.net] buildbot CPU usage

2016-12-12 Thread Pierre Tardy
course if you are fine with it)? > > I will def be looking at multimaster in the future, just have no time atm. > > Thanks again, > Francesco > > On Mon, Dec 12, 2016 at 11:18 AM, Pierre Tardy <tar...@gmail.com> wrote: > > Hi Francesco, > I finally got the t

Re: [us...@bb.net] buildbot CPU usage

2016-12-16 Thread Pierre Tardy
it. - > Greg > > > > *From:* users [mailto:users-boun...@buildbot.net] *On Behalf Of *Pierre > Tardy > *Sent:* Wednesday, December 14, 2016 10:48 AM > *To:* Francesco Di Mizio <francescodimi...@gmail.com> > *Cc:* Buildbot <users@buildbot.net> > *Subject:* Re: [us...@bb.n

Re: [us...@bb.net] buildbot CPU usage

2016-12-12 Thread Pierre Tardy
. So far, I've never seen an exception > relating to that. > > On the bright side, this seems to be the only worker whose builders are > stuck (some of the rest are waiting for locks, which this build has). > Usually, there's more. > > Neil Gilmore > grammatech.com > > >

Re: [us...@bb.net] Buildbot 0.9.2

2016-12-13 Thread Pierre Tardy
Le mar. 13 déc. 2016 à 17:05, Pierre Tardy <tar...@gmail.com> a écrit : > Hello, > > I am very happy to announce the release of buildbot 0.9.2. > > We are trying to stick to the one release per month, next should be in the > first days of 2017.. > > There is no

Re: [us...@bb.net] buildbot CPU usage

2016-12-14 Thread Pierre Tardy
t also happens with MySQL. Thanks, Francesco On Dec 13, 2016 12:40 AM, "Pierre Tardy" <tar...@gmail.com> wrote: Hi Francesco, I would say it is normal that the CPU goes to 100% while the log are being compressed. As soon as anything else is not blocked, for me this is fine. I can se

[us...@bb.net] Weekly meeting minutes

2017-01-10 Thread Pierre Tardy
#buildbot: weeklyMeeting started by tardyp at 17:01:20 UTC (full logs ). Meeting summary 1. *introduction* (tardyp

Re: [us...@bb.net] Html Status ImportError

2017-01-11 Thread Pierre Tardy
Hi Chris, Please see this section of the upgrade manual http://buildbot.readthedocs.io/en/latest/manual/installation/nine-upgrade.html#web-status Pierre Le mer. 11 janv. 2017 à 03:25, Chris Spencer a écrit : > I'm trying to test a Buildbot 0.8 config on the current

Re: [us...@bb.net] How to detect timeouts?

2016-12-02 Thread Pierre Tardy
Hi Will, The timeout is implemented in the worker side. There is no signal sent to the master telling that the command timedout. To my opinion, this is a shame, and I would expect that a timeout of a step should put the step in EXCEPTION (which is buildbot's equivalent to Jenkins unstable

Re: [us...@bb.net] Saving a build result log file

2016-12-02 Thread Pierre Tardy
Hi Alvaro, You can use the REST api to download the logs: http://docs.buildbot.net/latest/developer/rest.html?highlight=raw#raw-endpoints Regards Pierre Le jeu. 1 déc. 2016 à 20:40, Alvaro Erickson a écrit : > Hi Everyone, > > I am using Buildbot version 0.9.1. I

Re: [us...@bb.net] Problem with Try Scheduler

2017-01-04 Thread Pierre Tardy
Hi Katia, The try Scheduler indeed has some bottlenecks, one of them is that it does not integrate with codebase https://github.com/buildbot/buildbot/blob/master/master/buildbot/schedulers/trysched.py#L218 It will hardcoded the codebase to the default '' Also the patch application mechanism the

Re: [us...@bb.net] Accessing properties within an extract_fn

2017-01-03 Thread Pierre Tardy
m getting a DeferredList instead of a string. What do I need to > do to massage my interpolation results into a form that I can pass into > setProperty? > > On Tue, Jan 3, 2017 at 12:47 AM, Pierre Tardy <tar...@gmail.com> wrote: > > renderer looks good. > Maybe we need an e

Re: [us...@bb.net] Accessing properties within an extract_fn

2017-01-03 Thread Pierre Tardy
> > On Thu, Dec 29, 2016 at 6:15 AM, Pierre Tardy <tar...@gmail.com> wrote: > > Hi Elliot, > > Looking at the source code, it is not possible to get the properties from > extract_fn. > > https://github.com/buildbot/buildbot/blob/master/master/buildbot/steps/shell.

Re: [us...@bb.net] Accessing properties within an extract_fn

2016-12-29 Thread Pierre Tardy
ot;, "mySetPropertyFromCommand") Le mer. 28 déc. 2016 à 20:09, Elliot Saba <staticfl...@gmail.com> a écrit : > Hi Pierre, > > I mean the function that gets called to parse out the results of a > setPropertyFromCommand call. > > On Wed, Dec 28, 2016, 04:14 Pierre

  1   2   3   >