[Wikidata-bugs] [Maniphest] [Changed Subscribers] T166427: Measure maturity/quality of Wikidata items in a way it can be queried

[Halfak]

Halfak added a subscriber: Smalyshev. Halfak added a comment.

Maybe someone who maintains the #wikidata-query-service can look into integrating the ORES predictions. @Smalyshev? What do you think. Here's what a single prediction looks like:

Predicting the quality of the most recent version of Q2451450 https://ores.wikimedia.org/v3/scores/wikidatawiki/492705837/item_quality

{
  "wikidatawiki": {
    "models": {
      "item_quality": {
        "version": "0.1.0"
      }
    },
    "scores": {
      "492705837": {
        "item_quality": {
          "score": {
            "prediction": "C",
            "probability": {
              "A": 0.0,
              "B": 0.4939343938092204,
              "C": 0.49814893952411293,
              "D": 0.007916666666666666,
              "E": 0.0
            }
          }
        }
      }
    }
  }
}

Here's how I'd turn it into a score between 0 and 100.

>>> VALUES = {'E': 0, "D": 1, "C": 2, "B": 3, "A": 5}
>>> def weighted_score(probas):
...     return sum(VALUES[k]*p for k, p in probas.items())
... 
>>> probas = {
...               "A": 0.0,
...               "B": 0.4939343938092204,
...               "C": 0.49814893952411293,
...               "D": 0.007916666666666666,
...               "E": 0.0
...             }
>>> weighted_score(probas)
2.4860177271425536
>>> weighted_score(probas) * 20
49.72035454285107

Note that the weighted_score() returns a value between 0 and 5.  By simply multiplying by 20, we scale it up to between 0 and 100.

TASK DETAIL

https://phabricator.wikimedia.org/T166427

EMAIL PREFERENCES

https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Halfak
Cc: Smalyshev, Halfak, Aklapper, Multichill, GoranSMilovanovic, QZanden, EBjune, merbst, Avner, debt, Gehel, Jonas, FloNight, Xmlizer, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Alchimista, Mbch331

_______________________________________________
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs