[Wikidata-bugs] [Maniphest] T358254: [Analytics] Investigate effort of selective legacy migrations to Airflow

Manuel closed this task as "Resolved". Manuel added a comment. Thank you for the investigation! Based on the investigation, let's pause the work on the usage dashboard until further notice and only focus on the Wiktionary Cognate data. I have created a task about re-implementing the

[Wikidata-bugs] [Maniphest] T358254: [Analytics] Investigate effort of selective legacy migrations to Airflow

AndrewTavis_WMDE added a comment. We should discuss what the frequency of the jobs we're discussing is: - For the Wiktionary Cognate data to be of use to editors I'd say we'd be looking at daily jobs as a user would want to be able to make needed edits and then check the next day to see

[Wikidata-bugs] [Maniphest] T358254: [Analytics] Investigate effort of selective legacy migrations to Airflow

AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T358254 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: ECohen_WMDE, AndrewTavis_WMDE, Manuel, Aklapper, Danny_Benjafield_WMDE,

[Wikidata-bugs] [Maniphest] T358254: [Analytics] Investigate effort of selective legacy migrations to Airflow

AndrewTavis_WMDE added a comment. Moving on to the Usage Dashboard, what it is we're looking for is the following two tables: | Project | Project Type | Total Articles | Percent Articles Using WD | Total Articles Using WD | Percent Articles With Sitelinks | Total Articles With

[Wikidata-bugs] [Maniphest] T358254: [Analytics] Investigate effort of selective legacy migrations to Airflow

AndrewTavis_WMDE added a comment. Looking into this more, I'm as of now not sure how the original connection to the Cognate extension data was made. I'm seeing no inputs from a source database in the Wiktionary Cognate dashboard code. The server is loading in data from the published

[Wikidata-bugs] [Maniphest] T358254: [Analytics] Investigate effort of selective legacy migrations to Airflow

AndrewTavis_WMDE added a comment. Initial explorations of the Wiktionary directory indicate that the data we're trying to replicate here is in projectData

[Wikidata-bugs] [Maniphest] T358254: [Analytics] Investigate effort of selective legacy migrations to Airflow

AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T358254 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: ECohen_WMDE, AndrewTavis_WMDE, Manuel, Aklapper, Danny_Benjafield_WMDE,

[Wikidata-bugs] [Maniphest] T358254: [Analytics] Investigate effort of selective legacy migrations to Airflow

AndrewTavis_WMDE claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T358254 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: ECohen_WMDE, AndrewTavis_WMDE, Manuel, Aklapper, Danny_Benjafield_WMDE, Astuthiodit_1,

[Wikidata-bugs] [Maniphest] T358254: [Analytics] Investigate effort of selective legacy migrations to Airflow

ECohen_WMDE added a project: Wikidata Integration in Wikimedia projects. TASK DETAIL https://phabricator.wikimedia.org/T358254 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: ECohen_WMDE Cc: AndrewTavis_WMDE, Manuel, Aklapper, Danny_Benjafield_WMDE,

[Wikidata-bugs] [Maniphest] T358254: [Analytics] Investigate effort of selective legacy migrations to Airflow

Manuel added a parent task: T332899: [EPIC] Migrate selected R-based Wikidata products . TASK DETAIL https://phabricator.wikimedia.org/T358254 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Manuel Cc: AndrewTavis_WMDE, Manuel, Aklapper,

[Wikidata-bugs] [Maniphest] T358254: [Analytics] Investigate effort of selective legacy migrations to Airflow

Manuel edited projects, added Wikidata Analytics (Kanban); removed Wikidata Analytics. TASK DETAIL https://phabricator.wikimedia.org/T358254 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Manuel Cc: AndrewTavis_WMDE, Manuel, Aklapper,

[Wikidata-bugs] [Maniphest] T358254: [Analytics] Investigate effort of selective legacy migrations to Airflow

Manuel renamed this task from "[Analytics] Investigate effort selective legacy migrations to Airflow " to "[Analytics] Investigate effort of selective legacy migrations to Airflow ". TASK DETAIL https://phabricator.wikimedia.org/T358254 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T358254: [Analytics] Investigate effort of selective legacy migrations to Airflow

Manuel created this task. Manuel added projects: Wikidata Analytics, Wikidata. Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION Scope - Understand the complexity of bringing back the data processes for: 1. Cognate “I Miss You” - The main CSV in