[Wikidata-bugs] [Maniphest] [Commented On] T218901: Track number of Wikidata edits by namespace

[Addshore]

Addshore added a comment.


  Done, and I also switched the default time range of the dashboard to 7 days.

TASK DETAIL
  https://phabricator.wikimedia.org/T218901

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Michael, Addshore
Cc: Lydia_Pintscher, JAllemandou, Addshore, Aklapper, Lucas_Werkmeister_WMDE, 
Daryl-TTMG, RomaAmorRoma, 0010318400, E.S.A-Sheild, darthmon_wmde, pdehaye, 
alaa_wmde, joker88john, Michael, CucyNoiD, Nandana, NebulousIris, Gaboe420, 
Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, 
Af420, Darkminds3113, Bsandipan, Lordiis, Andrawaag, GoranSMilovanovic, 
Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, YULdigitalpreservation, 
LawExplorer, Salgo60, WSH1906, Lewizho99, Maathavan, _jensen, rosalieper, 
Jonas, MisterSynergy, abian, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T218901: Track number of Wikidata edits by namespace

[Lydia_Pintscher]

Lydia_Pintscher added a comment.


  Yeah that makes sense to me too.

TASK DETAIL
  https://phabricator.wikimedia.org/T218901

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Michael, Lydia_Pintscher
Cc: Lydia_Pintscher, JAllemandou, Addshore, Aklapper, Lucas_Werkmeister_WMDE, 
Daryl-TTMG, RomaAmorRoma, 0010318400, E.S.A-Sheild, darthmon_wmde, pdehaye, 
alaa_wmde, joker88john, Michael, CucyNoiD, Nandana, NebulousIris, Gaboe420, 
Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, 
Baloch007, Darkminds3113, Bsandipan, Lordiis, Andrawaag, GoranSMilovanovic, 
Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, YULdigitalpreservation, 
LawExplorer, Salgo60, WSH1906, Lewizho99, Maathavan, _jensen, rosalieper, 
Jonas, MisterSynergy, abian, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T218901: Track number of Wikidata edits by namespace

[Addshore]

Addshore added a comment.


  This dashboard panel should probably use the time range selected for the 
dashboard as a whole.
  This will allow users of the dashboard to easily look at different ranges of 
data for the panel without needing someone to actually edit the dashboard.
  
  I'm aware this is currently only daily data, but it probably still make sense 
to have it all line up.
  Thoughts @Lydia_Pintscher ?

TASK DETAIL
  https://phabricator.wikimedia.org/T218901

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Michael, Addshore
Cc: Lydia_Pintscher, JAllemandou, Addshore, Aklapper, Lucas_Werkmeister_WMDE, 
Daryl-TTMG, RomaAmorRoma, 0010318400, E.S.A-Sheild, darthmon_wmde, pdehaye, 
alaa_wmde, joker88john, Michael, CucyNoiD, Nandana, NebulousIris, Gaboe420, 
Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, 
Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, 
Th3d3v1ls, Ramalepe, Liugev6, QZanden, YULdigitalpreservation, LawExplorer, 
Salgo60, WSH1906, Lewizho99, Maathavan, _jensen, rosalieper, Jonas, 
MisterSynergy, abian, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T218901: Track number of Wikidata edits by namespace

[Michael]

Michael added a comment.


  The Grafana board exists now, but there are still things to be done:
  
  [ ] How do I assign better labels to the serieses?
  [ ] Is a log-10 Y-Axis useful here
  [ ] Is 12 weeks a useful time range?

TASK DETAIL
  https://phabricator.wikimedia.org/T218901

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Michael
Cc: Lydia_Pintscher, JAllemandou, Addshore, Aklapper, Lucas_Werkmeister_WMDE, 
Daryl-TTMG, RomaAmorRoma, E.S.A-Sheild, darthmon_wmde, pdehaye, alaa_wmde, 
joker88john, Michael, CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo, 
Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, 
Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, 
Ramalepe, Liugev6, QZanden, YULdigitalpreservation, LawExplorer, Salgo60, 
WSH1906, Lewizho99, Maathavan, _jensen, rosalieper, Jonas, MisterSynergy, 
abian, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T218901: Track number of Wikidata edits by namespace

[gerritbot]

gerritbot added a comment.


  Change 502169 **merged** by jenkins-bot:
  [analytics/wmde/scripts@production] Count number of Wikidata edits by 
namespace
  
  https://gerrit.wikimedia.org/r/502169

TASK DETAIL
  https://phabricator.wikimedia.org/T218901

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Lucas_Werkmeister_WMDE, gerritbot
Cc: Lydia_Pintscher, JAllemandou, Addshore, Aklapper, Lucas_Werkmeister_WMDE, 
pdehaye, alaa_wmde, joker88john, Michael, CucyNoiD, Nandana, NebulousIris, 
Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, 
Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, 
Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, YULdigitalpreservation, 
LawExplorer, Salgo60, WSH1906, Lewizho99, Maathavan, _jensen, rosalieper, 
Jonas, abian, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T218901: Track number of Wikidata edits by namespace

[Lucas_Werkmeister_WMDE]

Lucas_Werkmeister_WMDE added a comment.


  I don’t think it’s deployed yet (see https://gerrit.wikimedia.org/r/502169 
above). And then we’ll need to add the new metrics to some Grafana board.
  
  Should this go back to some “Doing” column until the deployment is done? 
Though I guess #shape_expressions_sprint_5 
 would no 
longer be the appropriate project.

TASK DETAIL
  https://phabricator.wikimedia.org/T218901

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Lucas_Werkmeister_WMDE
Cc: Lydia_Pintscher, JAllemandou, Addshore, Aklapper, Lucas_Werkmeister_WMDE, 
pdehaye, alaa_wmde, joker88john, Michael, CucyNoiD, Nandana, NebulousIris, 
Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, 
Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, 
Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, YULdigitalpreservation, 
LawExplorer, Salgo60, Lewizho99, Maathavan, _jensen, rosalieper, abian, 
Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T218901: Track number of Wikidata edits by namespace

[Lydia_Pintscher]

Lydia_Pintscher added a comment.


  Where can I see the result? :)

TASK DETAIL
  https://phabricator.wikimedia.org/T218901

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Lucas_Werkmeister_WMDE, Lydia_Pintscher
Cc: Lydia_Pintscher, JAllemandou, Addshore, Aklapper, Lucas_Werkmeister_WMDE, 
pdehaye, alaa_wmde, joker88john, Michael, CucyNoiD, Nandana, NebulousIris, 
Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, 
Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, 
Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, YULdigitalpreservation, 
LawExplorer, Salgo60, Lewizho99, Maathavan, _jensen, rosalieper, abian, 
Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T218901: Track number of Wikidata edits by namespace

[JAllemandou]

JAllemandou added a comment.


  Some queries are computed using hadoop for wikidata (see 
https://github.com/wikimedia/analytics-refinery/tree/master/oozie/wikidata). If 
SQL over recent-changes works for, that's great :)

TASK DETAIL
  https://phabricator.wikimedia.org/T218901

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Lucas_Werkmeister_WMDE, JAllemandou
Cc: JAllemandou, Addshore, Aklapper, Lucas_Werkmeister_WMDE, pdehaye, 
alaa_wmde, joker88john, Michael, CucyNoiD, Nandana, NebulousIris, Gaboe420, 
Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, 
Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, 
Th3d3v1ls, Ramalepe, Liugev6, QZanden, YULdigitalpreservation, LawExplorer, 
Salgo60, Lewizho99, Maathavan, _jensen, rosalieper, abian, Wikidata-bugs, aude, 
Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T218901: Track number of Wikidata edits by namespace

[Lucas_Werkmeister_WMDE]

Lucas_Werkmeister_WMDE added a comment.


  Well, we currently run the cron job at 3AM each day and have it check the 
recent changes from midnight yesterday to midnight today (all UTC), so it’s 
already delayed by three hours. Would using Hadoop be advantageous to us? I’m 
not sure if any of the existing scripts use it.

TASK DETAIL
  https://phabricator.wikimedia.org/T218901

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Lucas_Werkmeister_WMDE
Cc: JAllemandou, Addshore, Aklapper, Lucas_Werkmeister_WMDE, pdehaye, 
alaa_wmde, joker88john, Michael, CucyNoiD, Nandana, NebulousIris, Gaboe420, 
Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, 
Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, 
Th3d3v1ls, Ramalepe, Liugev6, QZanden, YULdigitalpreservation, LawExplorer, 
Salgo60, Lewizho99, Maathavan, _jensen, rosalieper, abian, Wikidata-bugs, aude, 
Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T218901: Track number of Wikidata edits by namespace

[gerritbot]

gerritbot added a comment.


  Change 502169 had a related patch set uploaded (by Hoo man; owner: Lucas 
Werkmeister (WMDE)):
  [analytics/wmde/scripts@production] Count number of Wikidata edits by 
namespace
  
  https://gerrit.wikimedia.org/r/502169

TASK DETAIL
  https://phabricator.wikimedia.org/T218901

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Lucas_Werkmeister_WMDE, gerritbot
Cc: JAllemandou, Addshore, Aklapper, Lucas_Werkmeister_WMDE, pdehaye, 
alaa_wmde, joker88john, Michael, CucyNoiD, Nandana, NebulousIris, Gaboe420, 
Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, 
Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, 
Th3d3v1ls, Ramalepe, Liugev6, QZanden, YULdigitalpreservation, LawExplorer, 
Salgo60, Lewizho99, Maathavan, _jensen, rosalieper, abian, Wikidata-bugs, aude, 
Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T218901: Track number of Wikidata edits by namespace

[gerritbot]

gerritbot added a comment.


  Change 500752 **merged** by jenkins-bot:
  [analytics/wmde/scripts@master] Count number of Wikidata edits by namespace
  
  https://gerrit.wikimedia.org/r/500752

TASK DETAIL
  https://phabricator.wikimedia.org/T218901

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Lucas_Werkmeister_WMDE, gerritbot
Cc: JAllemandou, Addshore, Aklapper, Lucas_Werkmeister_WMDE, pdehaye, 
alaa_wmde, joker88john, Michael, CucyNoiD, Nandana, NebulousIris, Gaboe420, 
Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, 
Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, 
Th3d3v1ls, Ramalepe, Liugev6, QZanden, YULdigitalpreservation, LawExplorer, 
Salgo60, Lewizho99, Maathavan, _jensen, rosalieper, abian, Wikidata-bugs, aude, 
Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T218901: Track number of Wikidata edits by namespace

[JAllemandou]

JAllemandou added a comment.


  Reading about this - Would delayed data be interesting? This information is 
accessible in hadoop :)

TASK DETAIL
  https://phabricator.wikimedia.org/T218901

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Lucas_Werkmeister_WMDE, JAllemandou
Cc: JAllemandou, Addshore, Aklapper, Lucas_Werkmeister_WMDE, pdehaye, 
alaa_wmde, Michael, CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo, 
Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, 
Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, 
Ramalepe, Liugev6, QZanden, YULdigitalpreservation, LawExplorer, Salgo60, 
Lewizho99, Maathavan, _jensen, rosalieper, abian, Wikidata-bugs, aude, 
Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T218901: Track number of Wikidata edits by namespace

[gerritbot]

gerritbot added a comment.


  Change 500752 had a related patch set uploaded (by Lucas Werkmeister (WMDE); 
owner: Lucas Werkmeister (WMDE)):
  [analytics/wmde/scripts@master] WIP: count number of Wikidata edits by 
namespace
  
  https://gerrit.wikimedia.org/r/500752

TASK DETAIL
  https://phabricator.wikimedia.org/T218901

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Lucas_Werkmeister_WMDE, gerritbot
Cc: Addshore, Aklapper, Lucas_Werkmeister_WMDE, pdehaye, alaa_wmde, Michael, 
Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, YULdigitalpreservation, 
LawExplorer, Salgo60, _jensen, rosalieper, abian, Wikidata-bugs, aude, 
Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T218901: Track number of Wikidata edits by namespace

[Lucas_Werkmeister_WMDE]

Lucas_Werkmeister_WMDE added a comment.


  In T218901#5044220 , 
@Addshore wrote:
  
  > Not done by namespace yet but see 
https://github.com/wikimedia/analytics-wmde-scripts/blob/master/src/wikidata/recentChanges.php
 and https://grafana.wikimedia.org/d/00170/wikidata-edits
  
  
  That script uses the API with `action=query=recentchanges`, which 
doesn’t directly give us the namespace. We could try to parse it from the 
`title`; get the page IDs and ask for their namespaces in a separate query; or 
perhaps switch to SQL.
  
  Is there a reason why that script doesn’t use SQL in the first place, by the 
way?

TASK DETAIL
  https://phabricator.wikimedia.org/T218901

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Lucas_Werkmeister_WMDE
Cc: Addshore, Aklapper, Lucas_Werkmeister_WMDE, pdehaye, alaa_wmde, Michael, 
Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, YULdigitalpreservation, 
LawExplorer, Salgo60, _jensen, rosalieper, abian, Wikidata-bugs, aude, 
Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T218901: Track number of Wikidata edits by namespace

[Addshore]

Addshore added a comment.


  Not done by namespace yet but see 
https://github.com/wikimedia/analytics-wmde-scripts/blob/master/src/wikidata/recentChanges.php
 and https://grafana.wikimedia.org/d/00170/wikidata-edits

TASK DETAIL
  https://phabricator.wikimedia.org/T218901

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: Addshore, Aklapper, Lucas_Werkmeister_WMDE, pdehaye, alaa_wmde, Michael, 
Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, YULdigitalpreservation, 
LawExplorer, Salgo60, _jensen, rosalieper, abian, Wikidata-bugs, aude, 
Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs