I've amended the Android patch to include the changes we talked about. I think it's ready to go now.
Since you asked about Android requests: Yes, the *first* request for a page has the same parameters you sent earlier (LeadSectionFetchTask): GET https://en.m.wikipedia.org/w/api.php?action=mobileview&format=json&page=Main+Page&prop=text%7Csections%7Cthumb%7Cimage%7Cid%7Crevision%7Cdescription%7Clastmodified%7Cnormalizedtitle%7Cdisplaytitle%7Cprotection%7Ceditable&onlyrequestedsections=1§ions=0§ionprop=toclevel%7Cline%7Canchor&noheadings=true&thumbsize=640 The *second* request for the remaining content looks like this (RestSectionsFetchTask): GET https://en.m.wikipedia.org/w/api.php?action=mobileview&format=json&page=Main+Page&prop=text%7Csections&onlyrequestedsections=1§ions=1-§ionprop=toclevel%7Cline%7Canchor&noheadings=true (You can probably ignore this one.) Then we have refreshing of *saved pages* (RefreshSavedPageTask): GET https://en.m.wikipedia.org/w/api.php?action=mobileview&format=json&page=Main+Page&prop=text%7Csections%7Clastmodified%7Cnormalizedtitle%7Cdisplaytitle%7Cprotection%7Ceditable&onlyrequestedsections=1§ions=all§ionprop=toclevel%7Cline%7Canchor&noheadings=true And finally also our *featured page* of the day request from our *widget* (should happen automatically 1-2 times a day; always the main page; WidgetProviderFeaturedPage): GET https://en.m.wikipedia.org/w/api.php?action=mobileview&format=json&page=Main+Page&prop=text%7Csections%7Clastmodified%7Cnormalizedtitle%7Cdisplaytitle%7Cprotection%7Ceditable&onlyrequestedsections=1§ions=all§ionprop=toclevel%7Cline%7Canchor&noheadings=true Future changes: Looking at the last one (for the widget) I think we might consider changing it so that it only requests the first section (sections=0), but the main page on most wikis only has one section anyways. Also in general, I think we should get rid of noheadings=true and change thumbsize to thumbwidth, like iOS has it. So I hope you don't use those for analysis. There will be a new link preview feature in upcoming sprints (not merged yet). The request code is in https://gerrit.wikimedia.org/r/#/c/202615/14/wikipedia/src/main/java/org/wikipedia/page/linkpreview/PreviewFetchTask.java . Thanks, Bernd On Wed, Apr 22, 2015 at 4:05 PM, Dan Garry <[email protected]> wrote: > Per Nuria's request, I made a task to track the work to update the uniques > and sessions reports: https://phabricator.wikimedia.org/T96926 > > Thanks everyone! > > Dan > > On 22 April 2015 at 14:57, Adam Baso <[email protected]> wrote: > >> (Bernd, question for you below) >> >> https://wikitech.wikimedia.org/wiki/X-Analytics#Keys has been uploaded >> >> https://gerrit.wikimedia.org/r/#/c/205980/ has been submitted - >> Analytics +1 is requested. >> >> Bernd is putting the finishing touches on >> https://gerrit.wikimedia.org/r/#/c/205976/ - Analytics +1 will be >> requested when it's ready. >> >> As I understand there was discussion on IRC to express the need for >> support for the old (appInstallID parameter in the request URL) and the new >> (wmfuuid in the X-Analytics field) in the uniques / pageview counting stuff. >> >> The latest format of the URL on iOS would like like so: >> >> >> http://en.m.wikipedia.org/w/api.php?action=mobileview&format=json&noheadings=true&page=SM%20U-66&prop=sections%7Ctext%7Clastmodified%7Clastmodifiedby%7Clanguagecount%7Cid%7Cprotection%7Ceditable%7Cdisplaytitle%7Cthumb%7Cdescription%7Cimage§ionprop=toclevel%7Cline%7Canchor%7Clevel%7Cnumber%7Cfromtitle%7Cindex§ions=all&thumbwidth=640 >> >> Bernd, would you please verify that the following is the latest URL >> format constituting a pageview on Android? >> >> >> http://en.m.wikipedia.org/w/api.php?action=mobileview&format=json&page=Main+Page&prop=text%7Csections%7Cthumb%7Cimage%7Cid%7Crevision%7Cdescription%7Clastmodified%7Cnormalizedtitle%7Cdisplaytitle%7Cprotection%7Ceditable&onlyrequestedsections=1§ions=0§ionprop=toclevel%7Cline%7Canchor&noheadings=true&thumbsize=640 >> >> If so, I believe that means the assumptions in >> https://github.com/wikimedia/analytics-refinery-source/blob/master/refinery-core/src/main/java/org/wikimedia/analytics/refinery/core/PageviewDefinition.java#L117-L139 >> haven't changed for pageviews, although best if Analytics double checks. >> >> Thanks! >> -Adam >> >> On Tue, Apr 21, 2015 at 9:56 AM, Oliver Keyes <[email protected]> >> wrote: >> >>> I'm out of the office? ;) >>> >>> On 21 April 2015 at 12:46, Nuria Ruiz <[email protected]> wrote: >>> > Adam: >>> > >>> > I think Oliver is OOTO, here is the pageview definition: >>> > https://meta.wikimedia.org/wiki/Research:Page_view >>> > >>> > On Tue, Apr 21, 2015 at 9:34 AM, Adam Baso <[email protected]> >>> wrote: >>> >> >>> >> Most definitely, agreed, before better than after :) >>> >> >>> >> Thanks! >>> >> -Adam >>> >> >>> >> On Tue, Apr 21, 2015 at 6:54 AM, Oliver Keyes <[email protected]> >>> >> wrote: >>> >>> >>> >>> >>> >>> >>> https://github.com/wikimedia/analytics-refinery-source/blob/master/refinery-core/src/main/java/org/wikimedia/analytics/refinery/core/PageviewDefinition.java#L117-L139 >>> >>> boop. >>> >>> >>> >>> For future iterations I'd rather we didn't have to do a >>> >>> compare-and-contrast and people just told Analytics when they'd done >>> >>> something that changed how pageviews appear, since what a pageview is >>> >>> conceptually is something I think everyone can agree on. >>> >>> >>> >>> On 21 April 2015 at 09:43, Adam Baso <[email protected]> wrote: >>> >>> > Ha, well if it isn't merged it really isn't going to be on the >>> servers, >>> >>> > right? ;) >>> >>> > >>> >>> > On Tue, Apr 21, 2015 at 6:38 AM, Andrew Otto <[email protected]> >>> >>> > wrote: >>> >>> >> >>> >>> >> The MobileFrontend changes have been merged, but the X-Analytics >>> >>> >> extension >>> >>> >> changes need to be reviewed, which I guess is waiting on Ori. Not >>> >>> >> sure who >>> >>> >> else should review those. >>> >>> >> >>> >>> >> https://gerrit.wikimedia.org/r/#/c/202799/ >>> >>> >> https://gerrit.wikimedia.org/r/#/c/202800/ >>> >>> >> https://gerrit.wikimedia.org/r/#/c/202801/ >>> >>> >> >>> >>> >> >>> >>> >> >>> >>> >> On Apr 21, 2015, at 09:12, Adam Baso <[email protected]> wrote: >>> >>> >> >>> >>> >> (Andrew Otto, question below) >>> >>> >> >>> >>> >> Oliver, you're talking about defining what constitutes a pageview >>> on >>> >>> >> each >>> >>> >> platform, right? Got links to the "definitions" files for each of >>> >>> >> Android >>> >>> >> and iOS for the current state of what constitutes a pageview? We >>> can >>> >>> >> then >>> >>> >> compare and contrast to see everything is still cool since last >>> >>> >> discussion. >>> >>> >> If there are backward looking definitions (e.g., if pageview >>> counts >>> >>> >> have to >>> >>> >> be computed piecewise to account for changes in definitions), >>> those >>> >>> >> would be >>> >>> >> good, too, if available. >>> >>> >> >>> >>> >> Andrew, for the page_id and namespace values, I infer it's >>> running on >>> >>> >> the >>> >>> >> BeforePageDisplay hook (regular pageviews are being tagged on >>> desktop >>> >>> >> and >>> >>> >> mobile web), but it seems it's not yet in the action=mobileview >>> (what >>> >>> >> apps >>> >>> >> and perhaps to a limited extent, some other consumers) responses >>> yet. >>> >>> >> Is >>> >>> >> that probably just due to date of merge for the API part and the >>> >>> >> deployment >>> >>> >> train? >>> >>> >> >>> >>> >> -Adam >>> >>> >> >>> >>> >> On Mon, Apr 20, 2015 at 10:37 PM, Oliver Keyes < >>> [email protected]> >>> >>> >> wrote: >>> >>> >>> >>> >>> >>> It would also be good to find out what the latest on "pageviews" >>> is, >>> >>> >>> with the iOS update and all. Ditto the provision of page_id and >>> >>> >>> namespace to x_analytics. >>> >>> >>> >>> >>> >>> On 20 April 2015 at 23:16, Adam Baso <[email protected]> >>> wrote: >>> >>> >>> > Thanks for the ping. We have a working meeting Wednesday to >>> write >>> >>> >>> > this >>> >>> >>> > up. >>> >>> >>> > >>> >>> >>> > -Adam >>> >>> >>> > >>> >>> >>> > >>> >>> >>> > On Mon, Apr 20, 2015 at 8:14 PM, Nuria Ruiz < >>> [email protected]> >>> >>> >>> > wrote: >>> >>> >>> >> >>> >>> >>> >> Ping ... >>> >>> >>> >> >>> >>> >>> >> On Fri, Apr 17, 2015 at 7:45 AM, Adam Baso < >>> [email protected]> >>> >>> >>> >> wrote: >>> >>> >>> >>> >>> >>> >>> >>> Sure thing. Dan and Bernd I'll sync up with you on this. >>> >>> >>> >>> >>> >>> >>> >>> On Fri, Apr 17, 2015 at 7:44 AM, Nuria Ruiz < >>> [email protected]> >>> >>> >>> >>> wrote: >>> >>> >>> >>>> >>> >>> >>> >>>> Team: >>> >>> >>> >>>> >>> >>> >>> >>>> Would you be so kind as to document the mobile apps info >>> that >>> >>> >>> >>>> should >>> >>> >>> >>>> be >>> >>> >>> >>>> present on X-analytics header for apps requests? >>> >>> >>> >>>> >>> >>> >>> >>>> https://wikitech.wikimedia.org/wiki/X-Analytics >>> >>> >>> >>>> >>> >>> >>> >>>> I thought the uuid that identifies a unique user of the app >>> was >>> >>> >>> >>>> "uuid" >>> >>> >>> >>>> but I also see a "wmfuuid" and I am not sure if these two >>> are >>> >>> >>> >>>> the >>> >>> >>> >>>> same. Need >>> >>> >>> >>>> to clarify this to be able to calculate mobile sessions. >>> >>> >>> >>>> >>> >>> >>> >>>> Many thanks, >>> >>> >>> >>>> >>> >>> >>> >>>> Nuria >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >> >>> >>> >>> > >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> -- >>> >>> >>> Oliver Keyes >>> >>> >>> Research Analyst >>> >>> >>> Wikimedia Foundation >>> >>> >> >>> >>> >> >>> >>> >> >>> >>> > >>> >>> >>> >>> >>> >>> >>> >>> -- >>> >>> Oliver Keyes >>> >>> Research Analyst >>> >>> Wikimedia Foundation >>> >> >>> >> >>> > >>> >>> >>> >>> -- >>> Oliver Keyes >>> Research Analyst >>> Wikimedia Foundation >>> >> >> > > > -- > Dan Garry > Product Manager, Search and Discovery > Wikimedia Foundation >
_______________________________________________ Analytics mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/analytics
