[Wikidata-bugs] [Maniphest] T334558: [Analytics] Unique user-agents accessing Wikidata's REST API

mforns added a comment. @AndrewTavis_WMDE Hi! I think you could go with simply `wmde`. The analytics prefix in product_analytics exists because the team is named like that. In your case, you could use `wmde` I think. BTW this is the task to create the WMDE Airflow instance: T340648 <ht

[Wikidata-bugs] [Maniphest] T314131: Some reliability metrics missing since June 20th '22

mforns added a comment. Yes, if we had implemented the DAG differently, re-running would be a task that Airflow users could easily do! However, this particular DAG (and a couple others) follow a pattern that makes it difficult to re-run partially. We plan to change those DAGs to a better

[Wikidata-bugs] [Maniphest] T314131: Some reliability metrics missing since June 20th '22

mforns added a comment. I've created a task to specifically tackle the back-filling: https://phabricator.wikimedia.org/T321838 TASK DETAIL https://phabricator.wikimedia.org/T314131 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: mforns Cc

[Wikidata-bugs] [Maniphest] T314131: Some reliability metrics missing since June 20th '22

mforns added a comment. Hi @Michael! Yes, we will back-fill as much as we can. I have to talk to the team tomorrow to see how we want to approach that, since that particular Airflow DAG is not easy to re-run partially... I'll keep you posted! TASK DETAIL https

[Wikidata-bugs] [Maniphest] T314131: Some reliability metrics missing since June 20th '22

mforns added a comment. I've looked a bit into this and I think I found what's happening. Indeed the metrics query is able to gather the data correctly, but the metrics do not reach Graphite. The reason is the HiveToGraphite Spark job is failing when sending the metrics to Graphite

[Wikidata-bugs] [Maniphest] T314131: Some reliability metrics missing since June 20th '22

mforns claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T314131 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: mforns Cc: Aklapper, Michael, Astuthiodit_1, EChetty, BTullis, karapayneWMDE, Invadibot, maantietaja, ItamarWMDE

[Wikidata-bugs] [Maniphest] T290303: Migrate WikibaseTermboxInteraction EventLogging Schema to new EventPlatform thingy

mforns added a comment.    TASK DETAIL https://phabricator.wikimedia.org/T290303 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: phuedx, mforns Cc: mforns, phuedx, Manuel, Addshore, Ottomata, awight, Lydia_Pintscher, Aklapper, Michael

[Wikidata-bugs] [Maniphest] T290303: Migrate WikibaseTermboxInteraction EventLogging Schema to new EventPlatform thingy

mforns added a comment. Thanks a lot @phuedx! TASK DETAIL https://phabricator.wikimedia.org/T290303 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: mforns Cc: phuedx, Manuel, Addshore, Ottomata, awight, Lydia_Pintscher, Aklapper, Michael

[Wikidata-bugs] [Maniphest] T290303: Migrate WikibaseTermboxInteraction EventLogging Schema to new EventPlatform thingy

mforns updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T290303 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: mforns Cc: phuedx, Manuel, Addshore, Ottomata, awight, Lydia_Pintscher, Aklapper, Michael, Hellket777

[Wikidata-bugs] [Maniphest] T290303: Migrate WikibaseTermboxInteraction EventLogging Schema to new EventPlatform thingy

mforns updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T290303 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: mforns Cc: phuedx, Manuel, Addshore, Ottomata, awight, Lydia_Pintscher, Aklapper, Michael, Hellket777

[Wikidata-bugs] [Maniphest] T290303: Migrate WikibaseTermboxInteraction EventLogging Schema to new EventPlatform thingy

mforns updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T290303 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: mforns Cc: phuedx, Manuel, Addshore, Ottomata, awight, Lydia_Pintscher, Aklapper, Michael, Hellket777

[Wikidata-bugs] [Maniphest] T299059: Write an Airflow job converting commons structured data dump to Hive

mforns added a project: Airflow. TASK DETAIL https://phabricator.wikimedia.org/T299059 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Snwachukwu, mforns Cc: Cparle, nettrom_WMF, Miriam, Nuria, cchen, AKhatun_WMF, JAllemandou, ntsako, EChetty

[Wikidata-bugs] [Maniphest] T290303: Migrate WikibaseTermboxInteraction EventLogging Schema to new EventPlatform thingy

mforns added projects: Data-Engineering, Data-Engineering-Kanban. TASK DETAIL https://phabricator.wikimedia.org/T290303 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: mforns Cc: Manuel, Addshore, Ottomata, awight, Lydia_Pintscher, Aklapper, Michael

[Wikidata-bugs] [Maniphest] T290303: Migrate WikibaseTermboxInteraction EventLogging Schema to new EventPlatform thingy

mforns updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T290303 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: mforns Cc: Manuel, Addshore, Ottomata, awight, Lydia_Pintscher, Aklapper, Michael, Suran38, Biggs657

[Wikidata-bugs] [Maniphest] T290303: Migrate WikibaseTermboxInteraction EventLogging Schema to new EventPlatform thingy

mforns updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T290303 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: mforns Cc: Manuel, Addshore, Ottomata, awight, Lydia_Pintscher, Aklapper, Michael, Suran38, Biggs657

[Wikidata-bugs] [Maniphest] T290303: Migrate WikibaseTermboxInteraction EventLogging Schema to new EventPlatform thingy

mforns added a comment. @Michael Hi! I'm going to migrate this schema during the next couple weeks. I need to askk you a couple questions about it. 1. Do you need to collect IP or geocode information together with this schema? The legacy EventLogging system collects them

[Wikidata-bugs] [Maniphest] T262942: PoC on anomaly detection with Flink

mforns edited projects, added Analytics-Radar; removed Analytics. TASK DETAIL https://phabricator.wikimedia.org/T262942 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: mforns Cc: Aklapper, Ottomata, Gehel, dcausse, CDanis, Zbyszko, CBogen, Akuckartz

[Wikidata-bugs] [Maniphest] [Commented On] T236895: ArticlePlaceholder dashboard stopped tracking page views

mforns added a comment. We've deployed the patch, now. It has already started to crunch data starting at 2020-01-01. It will take a couple hours to backfill up to today. TASK DETAIL https://phabricator.wikimedia.org/T236895 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings

[Wikidata-bugs] [Maniphest] [Unblock] T238878: Data about how many file pages on Commons contain at least one structured data element

mforns closed subtask T239127: Import slots/slots_roles and wikibase.wbc_entity_usage through scoop as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T238878 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: mforns Cc: Milimetric, Cparle

[Wikidata-bugs] [Maniphest] [Triaged] T239565: Create reportupdater reports that execute SDC requests

mforns triaged this task as "High" priority. TASK DETAIL https://phabricator.wikimedia.org/T239565 WORKBOARD https://phabricator.wikimedia.org/project/board/11/ EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Milimetric, mforns Cc: Ab

[Wikidata-bugs] [Maniphest] [Commented On] T215616: Improve interlingual links across wikis through Wikidata IDs

mforns added a comment. @diego Hi! Is there anythin additional for us Analytics here? Thaanks TASK DETAIL https://phabricator.wikimedia.org/T215616 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: mforns Cc: mforns, Marostegui, Isaac, Tbayer

[Wikidata-bugs] [Maniphest] [Commented On] T127467: Finding items on Wikidata that should be merged

mforns added a comment. @MichaelSchoenitzer_WMDE Oh, cool. Yea, definitely useful. Thanks!TASK DETAILhttps://phabricator.wikimedia.org/T127467EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mfornsCc: mforns, Lahi, MichaelSchoenitzer_WMDE, Ladsgroup, Esc3300

[Wikidata-bugs] [Maniphest] [Commented On] T127467: Finding items on Wikidata that should be merged

mforns added a comment. Hey! As @Ladsgroup knows, I worked on this task during the BCN Hackathon. It was super-interesting and I learned a lot about Wikidata :] Thanks for the opportunity! Here's a summary about what I did, issues I had, and next steps: After a while of reading docs

[Wikidata-bugs] [Maniphest] [Updated] T191022: Add Wikidata website extract oozie job

mforns set the point value for this task to "8". TASK DETAILhttps://phabricator.wikimedia.org/T191022EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Jonas, mfornsCc: Smalyshev, Nuria, gerritbot, JAllemandou, Jonas, Aklapper, Versusxo, Majestic

[Wikidata-bugs] [Maniphest] [Triaged] T187296: Increase kafka event retention to 14 or 21 days

mforns triaged this task as "Low" priority. TASK DETAILhttps://phabricator.wikimedia.org/T187296EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mfornsCc: mforns, elukey, Ottomata, Aklapper, Nuria, Ladsgroup, Pchelolo, JAllemandou, Smalyshev, Lahi, G

[Wikidata-bugs] [Maniphest] [Commented On] T187296: Increase kafka event retention to 14 or 21 days

mforns added a comment. We'll have this on our radar, until things are stable.TASK DETAILhttps://phabricator.wikimedia.org/T187296EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mfornsCc: mforns, elukey, Ottomata, Aklapper, Nuria, Ladsgroup, Pchelolo

[Wikidata-bugs] [Maniphest] [Commented On] T143819: Data request for logs from SparQL interface at query.wikidata.org

mforns added a comment. @Nuria @Smalyshev So probably if we round timestamp and remove sessionId your proposal for dattaset #1 is safe to keep long term (cc @mforns for anything I might be missing) I think it depends highly on how drastically we sanitize the potentially identifying fields (user

[Wikidata-bugs] [Maniphest] [Changed Project Column] T134426: Review shared data namespace (tabular data) implementation

mforns moved this task from Incoming to Radar on the Analytics board. TASK DETAIL https://phabricator.wikimedia.org/T134426 WORKBOARD https://phabricator.wikimedia.org/project/board/11/ EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik, mforns