Hi Tony,

Indeed!  We noticed this on Friday too.  A couple of changes[1] were recently 
made to improve a few things with our webrequest processing, and it seems 
things have greatly slowed since then.  We’ll talk about this problem for the 
first time today.  I’m not sure when things will get better, but I believe they 
eventually will.

[1] 
https://github.com/wikimedia/analytics-refinery-source/commit/fd59a13c4a6efbad333f83d7f0c47759faf8c488
 
<https://github.com/wikimedia/analytics-refinery-source/commit/fd59a13c4a6efbad333f83d7f0c47759faf8c488>

Sorry for the delay!
-Andrew


> On Sep 18, 2015, at 04:23, Tony Ho <[email protected]> wrote:
> 
> Hi WikiMedia Analytics,
> 
> I'm a student who has been doing work with the page count files from 
> wikimedia.
> 
> During the last few days, it looks like the latest page count is being 
> published slower than before.
> 
> Usually, when I go to the following link:
> 
> http://dumps.wikimedia.org/other/pagecounts-all-sites/2015/2015-09/ 
> <http://dumps.wikimedia.org/other/pagecounts-all-sites/2015/2015-09/>.
> 
> I could see what happened an hour ago sometime within an hour or so after 
> that.
> 
> Is this property still going to be true? This seems to not be the case for 
> 9/16 and 9/17.
> 
> Also, pagecounts-20150916-090000.gz 
> <http://dumps.wikimedia.org/other/pagecounts-all-sites/2015/2015-09/pagecounts-20150916-090000.gz>
>  does not seem to be of correct size.
> 
> Thanks,
> 
> Tony Ho
> _______________________________________________
> Analytics mailing list
> [email protected]
> https://lists.wikimedia.org/mailman/listinfo/analytics

_______________________________________________
Analytics mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/analytics

Reply via email to