On Sat, Jan 23, 2016 at 12:06 PM, Dan Garry <[email protected]> wrote: > As many of you are aware, Discovery wants to run a QuickSurvey in Q3 to ask > users if they're satisfied with search results. A requirement of this is > that we can tie the survey responses to our search schema and satisfaction > metric, so that we can correlate responses with the data to figure out how > effective our metric actually is at measuring search satisfaction.
I hope that this isn't a metric in isolation. I would have thought that metrics like * immediate re-search (refinement) * no clicking / following of a search result (resignation) would be of more relevance. Asking such a question of someone who did NOT get a positive search result and didn't follow a link will have an obvious answer, so asking for their satisfaction would almost be self-evident. One might also think that a survey response from those who had a failed search is going to be more likely to occur (and in expected direction), rather than a response from someone who had success, and went to the link. So do we have information on the bias response in surveys in such circumstances? Now maybe we have a different interpretation of the word "satisfaction" but that all seems to be with regard to the warm inner glow of finding something, rather than any of the technical aspects. Also, we have to presume that in a "satisfaction" survey that we are able to differentiate between no satisfaction for zero results, when we are not having information on the subject, compared to when it is no result for where search failed to find something that we do have information. OR are you intentionally focusing on zero resulters, no followers, or on those disatisified with their landing page on a GO result (ie. the GO results, rather than a search result?) Where are you intending to run these surveys? Languages? Sisters? How will such results be compiled collectively? Or split through the wikis? Will these results be available to the communities? [snip] > > -- > Dan Garry > Lead Product Manager, Discovery > Wikimedia Foundation > -- billinghurst _______________________________________________ discovery mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/discovery
