Dear Arsenij and Stefan, First of all: Thanks to you two for resolving this issue. I did not verify the outcome, but I trust you on this.
Furthermore, thanks Stefan, for your honesty concerning the necessity and non-necessity of your actions taken, and for your apologies, too. Dear developers, I have more words to say, and they might be interesting for all of you. Stefan wrote: > But afaik the issue was still not resolved on Monday [...] > but instead the Saros "Release Week" was started. The word "instead" conveys the impression that the two endeavors of resolving this issue and performing a release are mutually exclusive, which they are not: I was (and still am) considering you all to be intelligent persons that are cognitively able to handle with more than goal at once. Furthermore, the decision to start a release was made quite some time ago -- it was just "provisionally ineffective" since there weren't enough people to carry out the process. This changed recently and the release process roles were assigned 10 days ahead. The according communication was done during personal meetings with the involved developers in the university. Not propagating this via dpp-devel was clearly my fault. > Our project lead was informed about that issue. Since he was busy he > delegated the work to fix the issue. In case you wanted to protect my identity: There is absolutely no reason for this. Just say "Franz did" and "Franz said", and I'm fine with it. Also, I wasn't "busy", I was out of office because it was Sunday. Despite this, I answered Stefan's information mail (which, by the way, would have been of interest for all dpp-devel readers, too) as soon as I got it. In my answer I also asked Arsenij to have a look, because I thought he might have an idea how to tackle this. This general principle in the Saros project is simple: As long as you behave well and make use of some common sense you are, within certain boundaries, practically allowed to do anything. For instance, we take it easy with root access to our build server and other infrastructure elements. I trust you, and there is no need to ask for permission for each and every action. Just think about what you're going to do and make it visible to others that might be affected. The developers' mailing list is generally the best place to propagate this. Stefan's mail on Sunday was the first "signal" I got. I instantly split and threw this hot potato back to him and Arsenij, and didn't hear anything about this until Tuesday afternoon. If our system really stopped working durably starting on Sunday morning, this implies that quite a few people (*looking at the developers directly involved in the release process*) should have noticed "something". So there this is a message to anyone that may apply to: If you encounter some "strangeness" during your work as a Saros developer, and this strangeness is not a hot topic on the mailing list yet, you might consider making it one -- especially if it concerns the a central element as our build server. The worst thing that could happen is: You misinterpreted something and this misinterpretation will be set straight in matter of minutes. I need to follow this last advice myself, and I will. Best Regards, Franz -----Original Message----- From: Stefan Rossbach [mailto:srossb...@arcor.de] Sent: Tuesday, December 03, 2013 9:51 PM To: dpp-devel@lists.sourceforge.net Subject: Re: [DPP-Devel] Issues with Saros-Build Are you sure that Sunday 2. AM is Friday ? Just for clarification. We (still) have a malconfigured Jenkins Job that trashed over the past 6th month the hard disk space of our build server. Finally on Saturday we ran out of disk space. First service that crashed was ejabberd (XMPP). On Saturday morning I freed up some diskspace so that we could ensure that the XMPP service will work again. So far so good, now the worse story. Our project lead was informed about that issue. Since he was busy he delegated the work to fix the issue. But afaik the issue was still not resolved on Monday ( < 2% space left on our hard disk) but instead the Saros "Release Week" was started. Finally on Tuesday I decided to shutdown the Tomcat service (which was necessary) and the XMPP service (which was not necessary) but to put pressure on this issue. Unfortunately there was a communication issue so that the services got restarted and immediately shutdown again be me. So I want to apologize for the issues that this problem caused to our XMPP saros-con users and our Q/A staff that is currently verifying all changes that will be part of our next release. Best regards, Stefan Rossbach On 03.12.2013 19:34, Arsenij E Solovjev wrote: > Hello everybody, > > Since ca. Friday our services hosted on our build server were > unavailable (Gerrit, Jenkins and eJabberd). > Apparently this was due to a disk usage issue. > I have freed up some space, so all services should perform well. If you > find that that is not the case, > please don't hesitate to notify me. > > Best Regards > Arsenij > > ------------------------------------------------------------------------------ > Rapidly troubleshoot problems before they affect your business. Most IT > organizations don't have a clear picture of how application performance > affects their revenue. With AppDynamics, you get 100% visibility into your > Java,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics Pro! > http://pubads.g.doubleclick.net/gampad/clk?id=84349351&iu=/4140/ostg.clktrk > _______________________________________________ > DPP-Devel mailing list > DPP-Devel@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/dpp-devel ------------------------------------------------------------------------------ Sponsored by Intel(R) XDK Develop, test and display web and hybrid apps with a single code base. Download it for free now! http://pubads.g.doubleclick.net/gampad/clk?id=111408631&iu=/4140/ostg.clktrk _______________________________________________ DPP-Devel mailing list DPP-Devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dpp-devel ------------------------------------------------------------------------------ Sponsored by Intel(R) XDK Develop, test and display web and hybrid apps with a single code base. Download it for free now! http://pubads.g.doubleclick.net/gampad/clk?id=111408631&iu=/4140/ostg.clktrk _______________________________________________ DPP-Devel mailing list DPP-Devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dpp-devel
