Neil, yeah, it is pre-computed, but for the sessions sunburst it's still a HUGE amount of data. Take a look at the TSV. It could be transformed into a much easier to read thing on the server. But I remember you saying nobody really uses that graph anyway, so we could also just remove it. Let's chat offline.
On Thu, Feb 11, 2016 at 2:17 PM, Neil P. Quinn <[email protected]> wrote: > Dan, > > When you say the huge amount of data is slowing the load, are you > referring to the size of the Edit event logs? That wouldn't make sense > since I thought the data is all pre-computed and loaded from the TSVs every > time you load the page. > > Anyway, as a heads-up to everyone, new data generation for that dashboard > has been disabled since those logs have gotten too big. We've already > reduced the volume of new Edit events to 20% of previous by increasing the > sampling, and the DBAs are going to randomly purge existing events ( > https://phabricator.wikimedia.org/T124676). Once that's done, we can turn > the computations back on (https://phabricator.wikimedia.org/T126058). > > On Wed, Feb 10, 2016 at 12:06 PM, Dan Andreescu <[email protected]> > wrote: > >> On Wed, Feb 10, 2016 at 12:08 PM, Dan Andreescu <[email protected] >>> > wrote: >>> >>>> What you're looking at now is the percent of edits that ended in an >>>> edit conflict since last April. >>>> >>> >>> So when it says the average edit conflict rate for VisualEditor on >>> 2015-10-07 was "0.01", does that mean 1% or 0.01%? I'm guessing 1%, but >>> just want to clarify since the labels are ambiguous. >>> >> >> The rate is the number of times there was an edit conflict divided by the >> number of times a save was attempted. So yes, 0.0104 times out of 1, there >> was an edit conflict, which means 1.04% of the time. >> >> >> The query for this, and the line you're interested in is here: >> >> >> https://github.com/wikimedia/analytics-limn-edit-data/blob/master/edit/failure_rates_by_type.sql#L21 >> >> Also, the raw data behind that specific graph is here: >> >> >> http://datasets.wikimedia.org/limn-public-data/metrics/failure_rates_by_type/visualeditor/all.tsv >> >> >> http://datasets.wikimedia.org/limn-public-data/metrics/failure_rates_by_type/wikitext/all.tsv >> >> _______________________________________________ >> Analytics mailing list >> [email protected] >> https://lists.wikimedia.org/mailman/listinfo/analytics >> >> > > > -- > Neil P. Quinn <https://meta.wikimedia.org/wiki/User:Neil_P._Quinn-WMF>, > product analyst > Wikimedia Foundation > > _______________________________________________ > Analytics mailing list > [email protected] > https://lists.wikimedia.org/mailman/listinfo/analytics > >
_______________________________________________ Analytics mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/analytics
