I don't see a privacy issue in creating a listing of common/frequent search terms. Obviously we don't need the data on who is making these searches, nor do we need the "long tail" of things only searched for by a small number of people. Aside from being clutter some of those search terms could well involve privacy violations.
But a list of frequently accessed redlinks, or indeed frequent null result searches, would be useful. In the past we have had lists of frequently occurring redlinks on English Wikipedia. Once such a list is created and published people will come forward to process it and create articles or redirects where it is sensible to do so. Regards Jonathan > On 19 Jan 2018, at 20:36, Dario Taraborelli <[email protected]> > wrote: > > Forwarding a reply from Joseph that somehow didn't go through. > > ---------- Forwarded message ---------- > From: Joseph Allemandou <[email protected]> > To: Research into Wikimedia content and communities <wiki-research-l@lists. > wikimedia.org>, [email protected] > > Hi Gerard, > Here are my two cents on your questions. > > About redlinks, you are correct in saying that the 3% of "other" link-type > are jumps from a page to another (using http-referer), while the hyperlink > from the origin to the target allowing for such a jump doesn't exist in the > origin page at the moment of computation. > From my exploration of the dataset, such "other" links happen with the > "manually-edited-with-error" url class (the "-" article has a lot of such > entering links for instance), as well as with links that I think have been > edited in the origin page (for instance in November 2017 dataset, there are > "other" links from page "Kevin Spacey" to "Dan Savage", > "hebephilia","pedophilia or "Harvey_Weinstein" - Those links are confirmed > as existing at some point in the page in November, but not anymore at the > beginning of December when the pages hyperlinks are snapshot). > > As for your question about what people are looking for and don't find, the > one way I can think of to get ideas is to use detailed session analysis > correlated with search results, in order to try to get a signal of pages > reached from search and not being visited for long. Even if I think we have > data we could use in that respect on the cluster, we can't publish such > details externally for privacy concerns, obviously. > > Please let me know if what I say makes sense :) > Many thanks > Joseph Allemandou > > >> Hoi, >> Do I understand well that the 3% of "other" links are the ones that have >> articles at *this *time but they did not exist at the time of the dump. So >> in effect they are not red links? >> >> Is there any way to find the articles people were seeking but could not >> find?? >> Thanks, >> GerardM >> >>> On 16 January 2018 at 20:21, Leila Zia <[email protected]> wrote: >>> >>> Hi all, >>> >>> For archive happiness: >>> >>> Clickstream dataset is now being generated on a monthly basis for 5 >>> Wikipedia languages (English, Russian, German, Spanish, and Japanese). >> You >>> can access the data at https://dumps.wikimedia.org/other/clickstream/ >> and >>> read more about the release and those who contributed to it at >>> https://blog.wikimedia.org/2018/01/16/wikipedia-rabbit-hole-clickstream/ >>> >>> Best, >>> Leila > _______________________________________________ > Wiki-research-l mailing list > [email protected] > https://lists.wikimedia.org/mailman/listinfo/wiki-research-l _______________________________________________ Wiki-research-l mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/wiki-research-l
