Awesome; thanks :). Anything on the switchon time? (I appreciate it's only barely Monday ;p)
On 21 January 2016 at 11:36, Andrew Otto <[email protected]> wrote: > FYI, This has started. I have turned off the MySQL processes. No new data > will be inserted into MySQL until we turn them back on. > > On Wed, Jan 20, 2016 at 4:43 PM, Andrew Otto <[email protected]> wrote: >> >> (+Jaime) >> >> It’s hard to tell how long it will take, but I imagine for quite a while. >> I guess a day max, but probably much less. If Jaime let’s me know that he’s >> finished early, and I am close enough to a computer, I’ll turn the >> EventLogging MySQL processes back on asap. >> >> >> >> On Wed, Jan 20, 2016 at 4:12 PM, Oliver Keyes <[email protected]> >> wrote: >>> >>> Thanks Madhu! Awesome to see the transparency and announces around this >>> :D. >>> >>> Do you know how long the reimport should take on Monday? I want to >>> make sure I know when to expect we can safely launch all our scripts. >>> >>> On 20 January 2016 at 13:08, Madhumitha Viswanathan >>> <[email protected]> wrote: >>> > Hi all, >>> > >>> > In order to convert tables on db1046 to the TokuDB engine - we have to >>> > schedule some downtime on the Eventlogging databases between tomorrow, >>> > Thursday Jan 21, 2016 at 16:00 UTC to Monday Jan 25, 2016 16:00 UTC. >>> > >>> > What this means for EL users: >>> > >>> > 1. Eventlogging will still receive data and it will be available in >>> > Kafka. >>> > The data will continue to be imported into Hadoop and files. >>> > 2. The Mysql consumers of Eventlogging will be stopped, so no data will >>> > get >>> > imported into the master(db1046 or m4-master) and by extension to the >>> > analytics-store. >>> > 3. Querying existing data from analytics-store will still be available, >>> > but >>> > data for the next 4 days won't be available. >>> > 4. On Monday, after the maintenance window we'll restart the Mysql >>> > consumers, and all the data should get reimported from Kafka. >>> > >>> > Analytics and Ops(DBA) will work on this together. >>> > >>> > Feel free to reach out to us here or on #wikimedia-analytics if you >>> > have any >>> > concerns/questions. >>> > >>> > >>> > -- Madhu Viswanathan >>> > Software Engineer, Analytics >>> > >>> > _______________________________________________ >>> > Engineering mailing list >>> > [email protected] >>> > https://lists.wikimedia.org/mailman/listinfo/engineering >>> > >>> >>> >>> >>> -- >>> Oliver Keyes >>> Count Logula >>> Wikimedia Foundation >>> >>> _______________________________________________ >>> Engineering mailing list >>> [email protected] >>> https://lists.wikimedia.org/mailman/listinfo/engineering >> >> > -- Oliver Keyes Count Logula Wikimedia Foundation _______________________________________________ Analytics mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/analytics
