Capt_Swing created this task.
Capt_Swing added projects: Research, Multimedia, Structured-Data-Commons, UploadWizard.
Herald added a project: Wikidata.

TASK DESCRIPTION

Description: Ask some clickworkers to read two different sets of instructions for adding captions and descriptions to images, and see whether there is a meaningful difference in the quality of the output based on the instructions given.

Goal: Help us decide which instructions to use for redesigned Upload Wizard; evaluate whether this is a viable replacement for remote user testing for other low-level UI evaluation tasks.

Timeline: April-June 2018

Subtasks:

Subtasks:

  • select image(s) to caption
  • design MTurk task and survey
  • deploy survey with one or more sets of Turkers (different demographic groups?)
  • evaluate which instructions, on average, yielded better captions and descriptions
  • write up results

Research project page: to come


TASK DETAIL
https://phabricator.wikimedia.org/T190428

EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Capt_Swing
Cc: Ramsey-WMF, Abit, PDrouin-WMF, Capt_Swing, Lahi, Gq86, E1presidente, Cparle, Sksvdbvd, SandraF_WMF, Youssefalli1, GoranSMilovanovic, QZanden, Tramullas, Acer, V4switch, LawExplorer, Avner, Susannaanas, Wong128hk, Aschroet, Jane023, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Bawolff, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Matanya, Mbch331
_______________________________________________
Wikidata-bugs mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

Reply via email to