Folks -- thanks for owning this. One concern -- this is the second deployment related problem in the last couple of months. I'm concerned that we need to investigate more resources in a testing environment as well as a deployment checklist. I'm also considering having EL added to Greg's deployment calendar (with the accompanying restrictions) since it's approaching being a core service.
Thoughts? -Toby On Wed, Jan 7, 2015 at 11:03 AM, Dan Andreescu <[email protected]> wrote: > I talked about this at Scrum of Scrums, and added this image to the notes > I just sent out. I said we're leaning towards not backfilling and are > willing to be convinced otherwise. We'll see what people say. > > On Wed, Jan 7, 2015 at 1:58 PM, Nuria Ruiz <[email protected]> wrote: > >> Team: >> >> Issues on event logging have been solved, outage of client side events >> (did not affected server side events) lasted about 12 hours. >> >> Please see: >> http://picpaste.com/Screen_Shot_2015-01-07_at_10.50.28_AM-NsMSPgHp.png >> >> >> Thanks, >> >> Nuria >> >> On Wed, Jan 7, 2015 at 3:57 AM, Christian Aistleitner < >> [email protected]> wrote: >> >>> [ Adding eventlogging-alerts to CC ] >>> >>> On Wed, Jan 07, 2015 at 12:15:09PM +0100, quelltextlich e.U. - Christian >>> Aistleitner wrote: >>> > Hi, >>> > >>> > just a quick heads up that since 2015-01-07 ~1:55 only <30% of the >>> > EventLogging events are getting written to the database. >>> > >>> > It seems a deployment went wrong and validation is no longer working >>> > as expected. Somewhere >70% of the messages no longer validate and >>> > hence do not get written to the database. >>> > >>> > The raw log files (pre-validation) are still getting written, so data >>> > is not lost, and backfilling is possible. >>> > >>> > >>> > Best regards, >>> > Christian >>> > >>> > >>> > -- >>> > ---- quelltextlich e.U. ---- \\ ---- Christian Aistleitner ---- >>> > Companies' registry: 360296y in Linz >>> > Christian Aistleitner >>> > Kefermarkterstrasze 6a/3 Email: [email protected] >>> > 4293 Gutau, Austria Phone: +43 7946 / 20 5 81 >>> > Fax: +43 7946 / 20 5 81 >>> > Homepage: http://quelltextlich.at/ >>> > --------------------------------------------------------------- >>> >>> -- >>> ---- quelltextlich e.U. ---- \\ ---- Christian Aistleitner ---- >>> Companies' registry: 360296y in Linz >>> Christian Aistleitner >>> Kefermarkterstrasze 6a/3 Email: [email protected] >>> 4293 Gutau, Austria Phone: +43 7946 / 20 5 81 >>> Fax: +43 7946 / 20 5 81 >>> Homepage: http://quelltextlich.at/ >>> --------------------------------------------------------------- >>> >>> _______________________________________________ >>> Analytics mailing list >>> [email protected] >>> https://lists.wikimedia.org/mailman/listinfo/analytics >>> >>> >> >> _______________________________________________ >> Analytics mailing list >> [email protected] >> https://lists.wikimedia.org/mailman/listinfo/analytics >> >> > > _______________________________________________ > Analytics mailing list > [email protected] > https://lists.wikimedia.org/mailman/listinfo/analytics > >
_______________________________________________ Analytics mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/analytics
