Lag is down to ~ 16 hours for log and ~ 6 hours for enwiki. I'm declaring victory. Should be good by morning.
On Tue, Jul 29, 2014 at 6:04 PM, Aaron Halfaker <[email protected]> wrote: > Looks like I was right. > > I had a query writing to a table. I thought it would finish last night, > but it ran for > 24 hours. I've killed it and changed the query so that it > will write to an output file instead. I restarted the query, but now lag > seems to be recovering. Lag is ~14 hours for enwiki and ~ 18 hours for > log. > > -Aaron > > > > > On Tue, Jul 29, 2014 at 5:56 PM, Aaron Halfaker <[email protected]> > wrote: > >> This might be me. Killing the query I'm worried about. I'll report >> back. >> >> >> On Tue, Jul 29, 2014 at 5:46 PM, Christian Aistleitner < >> [email protected]> wrote: >> >>> Hi, >>> >>> just a quick heads up that the replication lag on >>> analytics-store.eqiad.wmnet (aka “The one machine to rule them all”) >>> has risen to >12 hours for s1 replicas. Other replicas are fine. >>> >>> So on analytics-store.eqiad.wmnet: >>> * enwiki is affected. >>> * log (EventLogging) is affected. >>> >>> Other databases (like dewiki, eswiki, ...) on >>> analytics-store.eqiad.wmnet are /not/ affected. >>> >>> >>> >>> For queries that only rely on enwiki, or log, you can use >>> >>> s1-analytics-slave.eqiad.wmnet >>> >>> as drop in replacement. enwiki and log are not lagging there. >>> >>> I filed RT ticket 8032: >>> https://rt.wikimedia.org/Ticket/Display.html?id=8032 >>> >>> Best regards, >>> Christian >>> >>> >>> -- >>> ---- quelltextlich e.U. ---- \\ ---- Christian Aistleitner ---- >>> Companies' registry: 360296y in Linz >>> Christian Aistleitner >>> Kefermarkterstrasze 6a/3 Email: [email protected] >>> 4293 Gutau, Austria Phone: +43 7946 / 20 5 81 >>> Fax: +43 7946 / 20 5 81 >>> Homepage: http://quelltextlich.at/ >>> --------------------------------------------------------------- >>> >>> _______________________________________________ >>> Analytics mailing list >>> [email protected] >>> https://lists.wikimedia.org/mailman/listinfo/analytics >>> >>> >> >
_______________________________________________ Analytics mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/analytics
