Re: [Wikimedia-search] Temporary dashboard data outage

2015-09-09 Thread Oliver Keyes
Hey all,

After a longer-than-expected deployment process to fix a couple of
bugs, I'm pleased to report all the backfilling is done and we have a
new version of the dashboard out. Amongst other things, this includes
a fix to a bug whereby the KPI infoboxes were displaying the wrong
values - thanks to Kevin for pointing it out - and a new feature
whereby you can select the range of time that KPI averages are
computed over. The next feature is smoothing, which will let you see
how the dashboard data averages out over a week, month or quarter.

Thanks,

On 7 September 2015 at 21:07, Oliver Keyes  wrote:
> Hey all,
>
> We currently have a data outage on our dashboards - they display, but
> we're missing the last few days.
>
> The good news is that we know exactly what happened here; as part of
> our work to (amusingly enough) make the data pipeline here more robust
> and standardised, we switched all of our data retrieval scripts over
> to a new project and repository (previously they'd lived in the repo
> for the dashboard they referred to, which doesn't scale). A bug in the
> shell script that tied them all together meant none of them ran - and
> of course we switched everything over immediately before a long
> weekend. Doh ;p.
>
> The original bug has a patchset in awaiting review, and as soon as
> it's +2d we're going to begin backfilling the datasets. You can follow
> our progress on that at https://phabricator.wikimedia.org/T111749
>
> Thanks,
>
> --
> Oliver Keyes
> Count Logula
> Wikimedia Foundation



-- 
Oliver Keyes
Count Logula
Wikimedia Foundation

___
Wikimedia-search mailing list
Wikimedia-search@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikimedia-search


[Wikimedia-search] Temporary dashboard data outage

2015-09-07 Thread Oliver Keyes
Hey all,

We currently have a data outage on our dashboards - they display, but
we're missing the last few days.

The good news is that we know exactly what happened here; as part of
our work to (amusingly enough) make the data pipeline here more robust
and standardised, we switched all of our data retrieval scripts over
to a new project and repository (previously they'd lived in the repo
for the dashboard they referred to, which doesn't scale). A bug in the
shell script that tied them all together meant none of them ran - and
of course we switched everything over immediately before a long
weekend. Doh ;p.

The original bug has a patchset in awaiting review, and as soon as
it's +2d we're going to begin backfilling the datasets. You can follow
our progress on that at https://phabricator.wikimedia.org/T111749

Thanks,

-- 
Oliver Keyes
Count Logula
Wikimedia Foundation

___
Wikimedia-search mailing list
Wikimedia-search@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikimedia-search