Isaac added a comment.

  > Recoin I believe didn't exist at that point. It was also not integrated in 
the existing production systems. I don't think we ever did a proper analysis of 
what it's currently capable of and how good it is for judging Item quality.
  
  Thanks -- useful context. I'll see about evaluating it then and report back. 
I've been working on a prototype that essentially uses Recoin + additional 
rules for labels / references to generate a score. I'll then compare it against 
the labeled data from the original ORES campaign. You can see a super raw 
prototype here (scores at the very bottom of the notebook) but I'd wait a week 
or so until I can generate more interesting figures and actually fine-tune it: 
https://public.paws.wmcloud.org/User:Isaac_(WMF)/Annotation%20Gap/eval_wikidata_quality_model.ipynb

TASK DETAIL
  https://phabricator.wikimedia.org/T321224

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Isaac
Cc: Lydia_Pintscher, diego, Miriam, Isaac, Astuthiodit_1, karapayneWMDE, 
Invadibot, Ywats0ns, maantietaja, ItamarWMDE, Akuckartz, Nandana, Abdeaitali, 
Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Avner, _jensen, 
rosalieper, Scott_WUaS, Wikidata-bugs, aude, Capt_Swing, Mbch331
_______________________________________________
Wikidata-bugs mailing list -- [email protected]
To unsubscribe send an email to [email protected]

Reply via email to