WMDE-leszek added a comment.
Much appreciated @JAllemandou !TASK DETAILhttps://phabricator.wikimedia.org/T193641EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: JAllemandou, WMDE-leszekCc: WMDE-leszek, Tbayer, Aklapper, GerritBot, JAllemandou, Jonas, RazShuty,
JAllemandou added a comment.
I confirm the fix :) Closing this task.TASK DETAILhttps://phabricator.wikimedia.org/T193641EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: JAllemandouCc: WMDE-leszek, Tbayer, Aklapper, GerritBot, JAllemandou, Jonas, RazShuty,
JAllemandou added a comment.
Bug found and corrected (patches above).
Data is available now and the rerun problem should be solved.TASK DETAILhttps://phabricator.wikimedia.org/T193641EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: JAllemandouCc: WMDE-leszek,
gerritbot added a comment.
Change 482692 merged by Mforns:
[analytics/refinery@master] Correct wikidata-coeditors data dependencies (2nd)
https://gerrit.wikimedia.org/r/482692TASK DETAILhttps://phabricator.wikimedia.org/T193641EMAIL
gerritbot added a comment.
Change 482692 had a related patch set uploaded (by Joal; owner: Joal):
[analytics/refinery@master] Correct wikidata-coeditors data dependencies (2nd)
https://gerrit.wikimedia.org/r/482692TASK DETAILhttps://phabricator.wikimedia.org/T193641EMAIL
gerritbot added a comment.
Change 482664 merged by Mforns:
[analytics/refinery@master] Update wikidata-coeditor job data dependency
https://gerrit.wikimedia.org/r/482664TASK DETAILhttps://phabricator.wikimedia.org/T193641EMAIL
gerritbot added a comment.
Change 482664 had a related patch set uploaded (by Joal; owner: Joal):
[analytics/refinery@master] Update wikidata-coeditor job data dependency
https://gerrit.wikimedia.org/r/482664TASK DETAILhttps://phabricator.wikimedia.org/T193641EMAIL
WMDE-leszek added a comment.
Very much appreciated @JAllemandou!TASK DETAILhttps://phabricator.wikimedia.org/T193641EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: JAllemandou, WMDE-leszekCc: WMDE-leszek, Tbayer, Aklapper, GerritBot, JAllemandou, Jonas,
JAllemandou added a comment.
Hi @WMDE-leszek - core data has not been computed et (usually done around the 9th of the following month).
I'll be sure to have an eye on data showing up for month 12 and rerun the job if needed.TASK DETAILhttps://phabricator.wikimedia.org/T193641EMAIL
WMDE-leszek added a comment.
@JAllemandou: as at WMDE we are in the need for the December data (Dec, 1st in particular), could you maybe please do the magic and re-run the job and backfill the data again? Thanks in advance.TASK DETAILhttps://phabricator.wikimedia.org/T193641EMAIL
JAllemandou added a comment.
Same exact problem as last month: job has run, but no data is present :(
More investigations needed, probably early next year.TASK DETAILhttps://phabricator.wikimedia.org/T193641EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To:
Addshore added a comment.
I don't remember when this is set to run @JAllemandou , but I see no data for Nov yet?TASK DETAILhttps://phabricator.wikimedia.org/T193641EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: JAllemandou, AddshoreCc: WMDE-leszek, Tbayer,
JAllemandou added a comment.
Info backfilled since beggining of time: https://grafana.wikimedia.org/dashboard/db/wikidata-co-editors?orgId=1=now-8y=now
Will keep an eye on next month run.TASK DETAILhttps://phabricator.wikimedia.org/T193641EMAIL
JAllemandou added a comment.
Thanks for raising the issue. This is very bizarre.
The job for october was showing successful in our side. I reran it, and data showed up :(
I have the feeling this is not the first time this happens, something must be wrong somewhere.
I'am also going to run
JAllemandou added a comment.
Jobs have been successful for the past months. However rerunning the jobs manually made the data-points appear. This is very bizarre.
Let's keep this open and monitor next month.TASK DETAILhttps://phabricator.wikimedia.org/T193641EMAIL
Addshore added a comment.
1:25 PM joal: any idea about https://phabricator.wikimedia.org/T193641#4614082 ?
1:30 PM addshore: job seems successfully running - something else must be going on
1:43 PM addshore: just triple checked the query on Spark - Looks correct - The issue is somewhere else
Jonas added a comment.
Mh, it seems like the job is not running @JAllemandou ?TASK DETAILhttps://phabricator.wikimedia.org/T193641EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: JonasCc: Liuxinyu970226, Tbayer, Aklapper, GerritBot, JAllemandou, Jonas,
Addshore added a comment.
It looks like the dashboard only shows data until June currently.
Is the reason we are missing more recent months because the data just isn't there yet or is there something wrong with the job?TASK DETAILhttps://phabricator.wikimedia.org/T193641EMAIL
Jonas added a comment.
Should work as well.
Do you have a list of projects you are also interested in?
What kind of charts would you like to have?TASK DETAILhttps://phabricator.wikimedia.org/T193641EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: JonasCc:
Lydia_Pintscher added a comment.
We said we also want this for the other projects. So far it's only Wikipedia. Is there anything preventing us from doing the other ones as well?TASK DETAILhttps://phabricator.wikimedia.org/T193641EMAIL
On Mon, 7/30/18, Lydia_Pintscher wrote:
Subject: [Wikidata-bugs] [Maniphest] [Commented On] T193641: track number of
editors from other Wikimedia projects who also edit on Wikidata over time
To: wikidata-bugs@lists.wikimedia.org
Date: Monday
Lydia_Pintscher added a comment.
Though thinking about it it might get a bit weird for the time before we had unified logins for all wikis?TASK DETAILhttps://phabricator.wikimedia.org/T193641EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Jonas,
Lydia_Pintscher added a comment.
That'd be awesome!TASK DETAILhttps://phabricator.wikimedia.org/T193641EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Jonas, Lydia_PintscherCc: Liuxinyu970226, Tbayer, Aklapper, GerritBot, JAllemandou, Jonas, RazShuty,
Addshore added a comment.
We should be able to backfill the data for this since wikidata came to be.
Is this something we want to do @Lydia_Pintscher ?TASK DETAILhttps://phabricator.wikimedia.org/T193641EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Jonas,
gerritbot added a comment.
Change 443409 merged by Joal:
[analytics/refinery@master] Introduce oozie job to schedule generating metrics for Wikidata co-editors
https://gerrit.wikimedia.org/r/443409TASK DETAILhttps://phabricator.wikimedia.org/T193641EMAIL
gerritbot added a comment.
Change 443370 abandoned by Jonas Kress (WMDE):
Add monthly storage schema for graphite
https://gerrit.wikimedia.org/r/443370TASK DETAILhttps://phabricator.wikimedia.org/T193641EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Jonas,
gerritbot added a comment.
Change 443069 merged by jenkins-bot:
[analytics/refinery/source@master] Track number of editors from Wikipedia who also edit on Wikidata over time
https://gerrit.wikimedia.org/r/443069TASK DETAILhttps://phabricator.wikimedia.org/T193641EMAIL
gerritbot added a comment.
Change 443409 had a related patch set uploaded (by Jonas Kress (WMDE); owner: Jonas Kress (WMDE)):
[analytics/refinery@master] [WIP] Introduce oozie job to schedule generating metrics for Wikidata co-editors
https://gerrit.wikimedia.org/r/443409TASK
gerritbot added a comment.
Change 443370 had a related patch set uploaded (by Jonas Kress (WMDE); owner: Jonas Kress (WMDE)):
[operations/puppet@production] Add monthly storage schema for graphite
https://gerrit.wikimedia.org/r/443370TASK DETAILhttps://phabricator.wikimedia.org/T193641EMAIL
gerritbot added a comment.
Change 443069 had a related patch set uploaded (by Jonas Kress (WMDE); owner: Jonas Kress (WMDE)):
[analytics/refinery/source@master] Track number of editors from other Wikimedia projects who also edit on Wikidata over time
https://gerrit.wikimedia.org/r/443069TASK
Ladsgroup added a comment.
In T193641#4321435, @Addshore wrote:
@Ladsgroup what were the queries you used to generate the data in the above comment?
To get answer for the first question:
WITH
wikipedias AS (
SELECT
DISTINCT dbname
FROM wmf_raw.mediawiki_project_namespace_map
WHERE
Addshore added a comment.
11:54 AM Joseph Allemandou addshore: By convention, it's -MM, but there is no automated place to get it except asking hive for partitions (or look in folder availability)
11:54 AM ack
11:54 AM so generally can one assume that each month there will be a new one?
RazShuty added a comment.
How many co editors we had since 01.01.2017 until Q2 including
TASK DETAILhttps://phabricator.wikimedia.org/T193641EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: RazShutyCc: RazShuty, Ladsgroup, Addshore, Aklapper, Lydia_Pintscher,
RazShuty added a comment.
Also, the event_timestamp doesn't fit, right?
We want to know these 2 things:
How many co editors we had in Q2 2017 (broken by wikipedia)
How many co editors we had in Q2 2018 (broken by wikipedia)
TASK DETAILhttps://phabricator.wikimedia.org/T193641EMAIL
RazShuty added a comment.
@Addshore can you review the query? the snapshot of the "wikipedias AS" segment should have also changed to '2018-05', right?TASK DETAILhttps://phabricator.wikimedia.org/T193641EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To:
Addshore added a comment.
As we want thi to land in graphite and create a grafana board this is probably very similar to:
https://github.com/wikimedia/analytics-refinery-source/blob/master/refinery-job/src/main/scala/org/wikimedia/analytics/refinery/job/WikidataArticlePlaceholderMetrics.scala
Addshore added a comment.
A starting point for this can be the following query: https://gist.github.com/addshore/a441917678da86f110cd2884033c791d (also linked from within the sheet)TASK DETAILhttps://phabricator.wikimedia.org/T193641EMAIL
37 matches
Mail list logo
