Re: [Analytics] When is the new pages API updated?

2018-10-11 Thread Joseph Allemandou
Data has been updated this morning (CEST). On Thu, Oct 11, 2018 at 5:13 AM Nuria Ruiz wrote: > >Wikistats 1 generates data on content pages with a delay of 10-15 days > after the end of the month > This is true for full snapshots (for the reasons we have discussed before > and that Dan has descr

Re: [Analytics] When is the new pages API updated?

2018-10-10 Thread Nuria Ruiz
>Wikistats 1 generates data on content pages with a delay of 10-15 days after the end of the month This is true for full snapshots (for the reasons we have discussed before and that Dan has described on this thread). You can expect data to be available on the API soon after the 10th, but it is unli

Re: [Analytics] When is the new pages API updated?

2018-10-10 Thread Dan Andreescu
It should be updated soon, the jobs are all done successfully. But currently we do expect this kind of lag, I'll explain why. When we started we were sqooping at the beginning of the month and the processing takes something like 4 days total, most of it sqooping. But this put too much load on th

[Analytics] When is the new pages API updated?

2018-10-10 Thread Neil Patel Quinn
Hey there! I just wrote a script that fetches data from the AQS new pages endpoint in order to prepare the our monthly health metrics (T199459