+1 Oliver - User agents tagged with WikimediaBot are tagged as bot - I do agree that our documentation on this can be approved, I'll update the Webrequest and Pageview tables docs to reflect this.
The backfilling jobs for May-July have been paused at the moment, the plan is to resume backfilling in 2-3 weeks. On Mon, Dec 14, 2015 at 3:45 PM, Oliver Keyes <[email protected]> wrote: > Hey Felix, > > To answer some questions in order: > > 1. Bots are automated systems with a Wikimedia specific tag > (WikimediaBot, iirc) in their user agent. We don't expect this to be > widely adopted yet because it hasn't been widely advertised. The > standard itself is very new, which is probably why you don't see any > traffic referring to it in August. > 2. The idea is to have traffic no earlier than May 2015 - because > that's when the new pageview definition was instrumented (and so the > earliest point we have data from) but that doesn't mean all the data > has been loaded in yet. > > On 14 December 2015 at 18:39, Felix J. Scholz > <[email protected]> wrote: > > Dear All: > > > > Maybe this question is a little bit too simple, but I did not immediately > > find the answer in the docs. > > > > How does the API differentiate between the two user agents spider and > bot? > > > > I'm asking because for some articles, there seems to be no bot traffic at > > all, including the main page in August: > > > https://wikimedia.org/api/rest_v1/metrics/pageviews/per-article/en.wikipedia/all-access/bot/Main_Page/daily/20150801/20150901 > > > > --- > > Another, unrelated question: > > By my recollection, I read somewhere that the data available via the API > > dates back to sometime in May of 2015. However, when doing queries today, > > the API only returned data starting on August 1, 2015. Is that correct? > > > > Best, > > Felix > > > > _______________________________________________ > > Analytics mailing list > > [email protected] > > https://lists.wikimedia.org/mailman/listinfo/analytics > > > > > > -- > Oliver Keyes > Count Logula > Wikimedia Foundation > > _______________________________________________ > Analytics mailing list > [email protected] > https://lists.wikimedia.org/mailman/listinfo/analytics > -- --Madhu :)
_______________________________________________ Analytics mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/analytics
