[Wikidata-bugs] [Maniphest] T342559: [Analytics] Monthly repeating tasks (next: February 2024)

2024-02-08 Thread AndrewTavis_WMDE
AndrewTavis_WMDE changed the task status from "Stalled" to "In Progress". AndrewTavis_WMDE lowered the priority of this task from "High" to "Medium". TASK DETAIL https://phabricator.wikimedia.org/T342559 EMAIL PREFERENCES https://phabricator.wikim

[Wikidata-bugs] [Maniphest] T342559: [Analytics] Monthly repeating tasks (next: February 2024)

2024-02-08 Thread AndrewTavis_WMDE
AndrewTavis_WMDE claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T342559 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: AndrewTavis_WMDE, Manuel, Aklapper, Danny_Benjafield_WMDE, Astuthiodit_1, karapayneWMDE

[Wikidata-bugs] [Maniphest] T356618: Check of legacy wmde analytics infrastructure

2024-02-08 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T356618 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: hashar, Michael, karapayneWMDE, Aklapper, Manuel, AndrewTavis_WMDE

[Wikidata-bugs] [Maniphest] T356618: Check of legacy wmde analytics infrastructure

2024-02-08 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T356618 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: hashar, Michael, karapayneWMDE, Aklapper, Manuel, AndrewTavis_WMDE

[Wikidata-bugs] [Maniphest] T356618: Check of legacy wmde analytics infrastructure

2024-02-08 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T356618 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: hashar, Michael, karapayneWMDE, Aklapper, Manuel, AndrewTavis_WMDE

[Wikidata-bugs] [Maniphest] T356618: Check of legacy wmde analytics infrastructure

2024-02-08 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T356618 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: hashar, Michael, karapayneWMDE, Aklapper, Manuel, AndrewTavis_WMDE

[Wikidata-bugs] [Maniphest] T356618: Check of legacy wmde analytics infrastructure

2024-02-08 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T356618 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: hashar, Michael, karapayneWMDE, Aklapper, Manuel, AndrewTavis_WMDE

[Wikidata-bugs] [Maniphest] T337799: [EPIC] Analytics support around splitting the WDQS graph [up to milestone 3]

2024-02-08 Thread AndrewTavis_WMDE
AndrewTavis_WMDE closed subtask T349512: [Analytics] Collect multiple sets of SPARQL queries as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T337799 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Manuel, AndrewTavis_WMDE Cc: dr0ptp4kt

[Wikidata-bugs] [Maniphest] T349512: [Analytics] Collect multiple sets of SPARQL queries

2024-02-08 Thread AndrewTavis_WMDE
AndrewTavis_WMDE closed this task as "Resolved". AndrewTavis_WMDE added a comment. Closing this as the MR <https://gitlab.wikimedia.org/repos/search-platform/notebooks/-/merge_requests/2> has been brought in  Thanks all for the support and the great work on this proje

[Wikidata-bugs] [Maniphest] T352538: [EPIC] Evaluate the impact of the graph split

2024-02-08 Thread AndrewTavis_WMDE
AndrewTavis_WMDE closed subtask T349512: [Analytics] Collect multiple sets of SPARQL queries as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T352538 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: Aklapper, Gehel, me

[Wikidata-bugs] [Maniphest] T349512: [Analytics] Collect multiple sets of SPARQL queries

2024-02-07 Thread AndrewTavis_WMDE
AndrewTavis_WMDE added a comment. MR with the notebooks and HTML versions has just been sent as per the Search Team meeting last week: https://gitlab.wikimedia.org/repos/search-platform/notebooks/-/merge_requests/2 Please let me know if anything else is necessary! TASK DETAIL

[Wikidata-bugs] [Maniphest] T349512: [Analytics] Collect multiple sets of SPARQL queries

2024-02-07 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T349512 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: WMDE-leszek, dr0ptp4kt, AndrewTavis_WMDE, Manuel, dcausse, Aklapper

[Wikidata-bugs] [Maniphest] T356618: Check of legacy wmde analytics infrastructure

2024-02-07 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T356618 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: hashar, Michael, karapayneWMDE, Aklapper, Manuel, AndrewTavis_WMDE

[Wikidata-bugs] [Maniphest] T356618: Check of legacy wmde analytics infrastructure

2024-02-07 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T356618 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: hashar, Michael, karapayneWMDE, Aklapper, Manuel, AndrewTavis_WMDE

[Wikidata-bugs] [Maniphest] T356618: Check of legacy wmde analytics infrastructure

2024-02-07 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T356618 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: hashar, Michael, karapayneWMDE, Aklapper, Manuel, AndrewTavis_WMDE

[Wikidata-bugs] [Maniphest] T356618: Check of legacy wmde analytics infrastructure

2024-02-07 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T356618 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: hashar, Michael, karapayneWMDE, Aklapper, Manuel, AndrewTavis_WMDE

[Wikidata-bugs] [Maniphest] T356618: Check of legacy wmde analytics infrastructure

2024-02-07 Thread AndrewTavis_WMDE
AndrewTavis_WMDE added a subscriber: hashar. AndrewTavis_WMDE added a comment. @hashar, pinging you on this as you were helpful in {https://phabricator.wikimedia.org/T354534}. There are a few more related Gerrit repos that should be deprecated at this point, specifically: - WD Analytics

[Wikidata-bugs] [Maniphest] T356618: Check of legacy wmde analytics infrastructure

2024-02-07 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T356618 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: Michael, karapayneWMDE, Aklapper, Manuel, AndrewTavis_WMDE

[Wikidata-bugs] [Maniphest] T356618: Check of legacy wmde analytics infrastructure

2024-02-07 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T356618 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: Michael, karapayneWMDE, Aklapper, Manuel, AndrewTavis_WMDE

[Wikidata-bugs] [Maniphest] T356618: Check of legacy wmde analytics infrastructure

2024-02-06 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T356618 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: Michael, karapayneWMDE, Aklapper, Manuel, AndrewTavis_WMDE

[Wikidata-bugs] [Maniphest] T356618: Check of legacy wmde analytics infrastructure

2024-02-06 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T356618 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: Michael, karapayneWMDE, Aklapper, Manuel, AndrewTavis_WMDE

[Wikidata-bugs] [Maniphest] T356618: Check of legacy wmde analytics infrastructure

2024-02-06 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T356618 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: Michael, karapayneWMDE, Aklapper, Manuel, AndrewTavis_WMDE

[Wikidata-bugs] [Maniphest] T356618: Check of legacy wmde analytics infrastructure

2024-02-06 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T356618 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: Michael, karapayneWMDE, Aklapper, Manuel, AndrewTavis_WMDE

[Wikidata-bugs] [Maniphest] T356618: Check of legacy wmde analytics infrastructure

2024-02-06 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T356618 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: Michael, karapayneWMDE, Aklapper, Manuel, AndrewTavis_WMDE

[Wikidata-bugs] [Maniphest] T356618: Check of legacy wmde analytics infrastructure

2024-02-06 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T356618 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: Michael, karapayneWMDE, Aklapper, Manuel, AndrewTavis_WMDE

[Wikidata-bugs] [Maniphest] T356618: Check of legacy wmde analytics infrastructure

2024-02-06 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T356618 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: Michael, karapayneWMDE, Aklapper, Manuel, AndrewTavis_WMDE

[Wikidata-bugs] [Maniphest] T356618: Check of legacy wmde analytics infrastructure

2024-02-06 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T356618 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: Michael, karapayneWMDE, Aklapper, Manuel, AndrewTavis_WMDE

[Wikidata-bugs] [Maniphest] T356618: Check of legacy wmde analytics infrastructure

2024-02-06 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T356618 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: Michael, karapayneWMDE, Aklapper, Manuel, AndrewTavis_WMDE

[Wikidata-bugs] [Maniphest] T356618: Check of legacy wmde analytics infrastructure

2024-02-06 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T356618 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: Michael, karapayneWMDE, Aklapper, Manuel, AndrewTavis_WMDE

[Wikidata-bugs] [Maniphest] T356618: Check of legacy wmde analytics infrastructure

2024-02-06 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T356618 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: Michael, karapayneWMDE, Aklapper, Manuel, AndrewTavis_WMDE

[Wikidata-bugs] [Maniphest] T356618: Check of legacy wmde analytics infrastructure

2024-02-06 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T356618 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: Michael, karapayneWMDE, Aklapper, Manuel, AndrewTavis_WMDE

[Wikidata-bugs] [Maniphest] T356618: Check of legacy wmde analytics infrastructure

2024-02-06 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T356618 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: Michael, karapayneWMDE, Aklapper, Manuel, AndrewTavis_WMDE

[Wikidata-bugs] [Maniphest] T356618: Check of legacy wmde analytics infrastructure

2024-02-06 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T356618 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: Michael, karapayneWMDE, Aklapper, Manuel, AndrewTavis_WMDE

[Wikidata-bugs] [Maniphest] T356618: Check of legacy wmde analytics infrastructure

2024-02-06 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T356618 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: Michael, karapayneWMDE, Aklapper, Manuel, AndrewTavis_WMDE

[Wikidata-bugs] [Maniphest] T356618: Check of legacy wmde analytics infrastructure

2024-02-06 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T356618 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: Michael, karapayneWMDE, Aklapper, Manuel, AndrewTavis_WMDE

[Wikidata-bugs] [Maniphest] T356618: Check of legacy wmde analytics infrastructure

2024-02-06 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T356618 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: Michael, karapayneWMDE, Aklapper, Manuel, AndrewTavis_WMDE

[Wikidata-bugs] [Maniphest] T356618: Check of legacy wmde analytics infrastructure

2024-02-06 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T356618 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: Michael, karapayneWMDE, Aklapper, Manuel, AndrewTavis_WMDE

[Wikidata-bugs] [Maniphest] T356618: Check of legacy wmde analytics infrastructure

2024-02-06 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T356618 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: Michael, karapayneWMDE, Aklapper, Manuel, AndrewTavis_WMDE

[Wikidata-bugs] [Maniphest] T356659: Remove references of broken tool from Mismatch Finder and Query Builder

2024-02-05 Thread AndrewTavis_WMDE
AndrewTavis_WMDE edited projects, added Wikidata Dev Team, wmde-wikidata-tech; removed Wikidata. TASK DETAIL https://phabricator.wikimedia.org/T356659 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: Aklapper, karapayneWMDE

[Wikidata-bugs] [Maniphest] T356659: Remove references of broken tool from Mismatch Finder and Query Builder

2024-02-05 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T356659 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: Aklapper, karapayneWMDE, AndrewTavis_WMDE, Danny_Benjafield_WMDE, Astuthiodit_1

[Wikidata-bugs] [Maniphest] T356659: Remove references of broken tool from Mismatch Finder and Query Builder

2024-02-05 Thread AndrewTavis_WMDE
AndrewTavis_WMDE created this task. AndrewTavis_WMDE added a project: Wikidata. Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION As a part of exploring WMDE tools that are currently broken in T356618 <https://phabricator.wikimedia.org/T356618>, I found that t

[Wikidata-bugs] [Maniphest] T353453: [Analytics] Impact of Scholia on WDQS

2024-02-05 Thread AndrewTavis_WMDE
AndrewTavis_WMDE claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T353453 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: Lydia_Pintscher, dcausse, Aklapper, Manuel, Danny_Benjafield_WMDE, Astuthiodit_1

[Wikidata-bugs] [Maniphest] T349512: [Analytics] Collect multiple sets of SPARQL queries

2024-01-29 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T349512 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: WMDE-leszek, dr0ptp4kt, AndrewTavis_WMDE, Manuel, dcausse, Aklapper

[Wikidata-bugs] [Maniphest] T349512: [Analytics] Collect multiple sets of SPARQL queries

2024-01-29 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T349512 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: WMDE-leszek, dr0ptp4kt, AndrewTavis_WMDE, Manuel, dcausse, Aklapper

[Wikidata-bugs] [Maniphest] T345262: [Analytics] Enable Global North and Global South aggregations

2024-01-22 Thread AndrewTavis_WMDE
AndrewTavis_WMDE closed this task as "Resolved". AndrewTavis_WMDE added a comment. Closing this as the PR was merged before the holidays :) TASK DETAIL https://phabricator.wikimedia.org/T345262 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailp

[Wikidata-bugs] [Maniphest] T342331: [EPIC] Set up a sustainable tech stack for Wikidata Analytics

2024-01-15 Thread AndrewTavis_WMDE
AndrewTavis_WMDE closed subtask T340648: [Airflow] Setup Airflow instance for WMDE as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T342331 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Manuel, AndrewTavis_WMDE Cc: Aklapper, Manuel, me

[Wikidata-bugs] [Maniphest] T342559: [Analytics] Monthly repeating tasks (next: January 2023)

2024-01-11 Thread AndrewTavis_WMDE
AndrewTavis_WMDE added a comment. @Manuel: the numbers were added in last night :) TASK DETAIL https://phabricator.wikimedia.org/T342559 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: AndrewTavis_WMDE, Manuel, Aklapper

[Wikidata-bugs] [Maniphest] T354534: Archive Wikidata Concepts Monitor repositories

2024-01-08 Thread AndrewTavis_WMDE
AndrewTavis_WMDE added a comment. Thanks for the information, @hashar! I'll communicate the above to the rest of the team over here. TASK DETAIL https://phabricator.wikimedia.org/T354534 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: hashar

[Wikidata-bugs] [Maniphest] T354534: Archive Wikidata Concepts Monitor repositories

2024-01-08 Thread AndrewTavis_WMDE
AndrewTavis_WMDE added a subscriber: Manuel. AndrewTavis_WMDE added a comment. Hey @hashar  For clarification, could I just check that what we're discussing here would shut down the WDCM process such that the data would no longer be exported to the published data sets <ht

[Wikidata-bugs] [Maniphest] T354268: Wikidata-related Cloud VPS alerts about puppet

2024-01-03 Thread AndrewTavis_WMDE
AndrewTavis_WMDE added a comment. Thank you for the further information here, @dcaro! Sorry that we're a bit in the dark on this (inherited infrastructure where the lack of documentation keeps getting more and more apparent). I've noted this to the appropriate parties on our end and we'll

[Wikidata-bugs] [Maniphest] T354268: Wikidata-related Cloud VPS alerts about puppet

2024-01-03 Thread AndrewTavis_WMDE
AndrewTavis_WMDE added a comment. Quoting myself: > For this we'll need to go into the deployment and change the targets within the code itself? Seems like not as none of those are set within the code itself <https://github.com/wikimedia/analytics-wmde-WD-WikidataAnalytics>

[Wikidata-bugs] [Maniphest] T354268: Wikidata-related Cloud VPS alerts about puppet

2024-01-03 Thread AndrewTavis_WMDE
AndrewTavis_WMDE added a comment. Thanks, @Michael  For further understanding, what's the frequency of the alerts? TASK DETAIL https://phabricator.wikimedia.org/T354268 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc

[Wikidata-bugs] [Maniphest] T354268: Wikidata-related Cloud VPS alerts about puppet

2024-01-03 Thread AndrewTavis_WMDE
AndrewTavis_WMDE added a comment. Thanks from me as well, @dcaro! Following up on my point: > Yep, those are yes, the networks they are configured to use (ex. 172.20.0.0/16) overlaps with the one the cloudvps uses internally, specifically the one where the DNS is hosted (172.20.25

[Wikidata-bugs] [Maniphest] T354268: Wikidata-related Cloud VPS alerts about puppet

2024-01-03 Thread AndrewTavis_WMDE
AndrewTavis_WMDE added a comment. Hey @dcaro  Really appreciate you checking all of this for us! > So for that I guess the solution is to change your docker configuration to use a different range. Could I check my/our understanding of this with you? In the above out

[Wikidata-bugs] [Maniphest] T342703: Move generally-useful fields from gdi.country_meta_data to canonical_data.countries

2023-12-22 Thread AndrewTavis_WMDE
AndrewTavis_WMDE added a comment. I just sent along some further commits and re-requested review from @nshahquinn-wmf in canonical-data#10 <https://github.com/wikimedia-research/canonical-data/pull/10> :) Folks can see the new documentation for the table on my branch on GitHub

[Wikidata-bugs] [Maniphest] T342559: [Analytics] Monthly repeating tasks (next: December 2023)

2023-12-22 Thread AndrewTavis_WMDE
AndrewTavis_WMDE changed the task status from "Open" to "Stalled". AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T342559 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To:

[Wikidata-bugs] [Maniphest] T342559: [Analytics] Monthly repeating tasks (next: December 2023)

2023-12-22 Thread AndrewTavis_WMDE
AndrewTavis_WMDE added a comment. Numbers for October and November have been added to the data report <https://docs.google.com/spreadsheets/d/1MoJolxQ0zVWNO0FEEsBPlWJU68k36oJRcFO4sY8dKT4/edit#gid=1942641743>. TASK DETAIL https://phabricator.wikimedia.org/T342559 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T349512: [Analytics] Collect multiple sets of SPARQL queries

2023-12-20 Thread AndrewTavis_WMDE
AndrewTavis_WMDE claimed this task. AndrewTavis_WMDE updated Other Assignee, removed: AndrewTavis_WMDE. TASK DETAIL https://phabricator.wikimedia.org/T349512 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: WMDE-leszek, dr0ptp4kt

[Wikidata-bugs] [Maniphest] T349512: [Analytics] Collect multiple sets of SPARQL queries

2023-12-20 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated Other Assignee, added: AndrewTavis_WMDE. TASK DETAIL https://phabricator.wikimedia.org/T349512 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: WMDE-leszek, dr0ptp4kt, AndrewTavis_WMDE, Manuel, dcausse

[Wikidata-bugs] [Maniphest] T349512: [Analytics] Collect multiple sets of SPARQL queries

2023-12-20 Thread AndrewTavis_WMDE
AndrewTavis_WMDE added a comment. Based on conversations with WMF engineering, uniquely identifying queries that come from the WDQS UI doesn't appear to be possible at this time. We'll thus not be able to include queries from there in the sample. TASK DETAIL https

[Wikidata-bugs] [Maniphest] T349512: [Analytics] Collect multiple sets of SPARQL queries

2023-12-20 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T349512 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: WMDE-leszek, dr0ptp4kt, AndrewTavis_WMDE, Manuel, dcausse, Aklapper

[Wikidata-bugs] [Maniphest] T304448: Compare external datasets to Wikidata's data to get more mismatches for Mismatch Finder

2023-11-27 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T304448 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: Alan_Ang-WMDE, Aklapper, Lydia_Pintscher, Danny_Benjafield_WMDE, Astuthiodit_1

[Wikidata-bugs] [Maniphest] T348609: Investigation to clarify team ownership of WMDE cronjobs on stats1007

2023-11-17 Thread AndrewTavis_WMDE
AndrewTavis_WMDE added a comment. Thank you for this, @WMDE-Fisch! TASK DETAIL https://phabricator.wikimedia.org/T348609 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: Lena_WMDE, WMDE-Fisch, awight, Tobi_WMDE_SW, Michael

[Wikidata-bugs] [Maniphest] T351291: Archive and decomission analytics/wmde/toolkit-analyzer

2023-11-15 Thread AndrewTavis_WMDE
AndrewTavis_WMDE added a comment. Thanks for bringing this to our attention, @hashar! I would say that once the stat1007 ownership/maintenance is resolved, we will also be able to close T218711 <https://phabricator.wikimedia.org/T218711> and T278665 <https://phabricator.wiki

[Wikidata-bugs] [Maniphest] T345262: [Analytics] Enable Global North and Global South aggregations

2023-11-10 Thread AndrewTavis_WMDE
AndrewTavis_WMDE added a comment. A PR has been opened on GitHub <https://github.com/wikimedia-research/canonical-data/pull/10> that sends along the needed changes to the countries table. Once that's merged and the update notebook is ran we'll be good to resolve this as the neede

[Wikidata-bugs] [Maniphest] T350252: Figure out if the WDCM repository on stats1007 is actually used

2023-11-03 Thread AndrewTavis_WMDE
AndrewTavis_WMDE added a comment. Just checked in with @Michael on this and we did a check of my ability to run `sudo -u analytics-wmde crontab -l` on `stat1007`. I sadly don't have access :( TASK DETAIL https://phabricator.wikimedia.org/T350252 EMAIL PREFERENCES https

[Wikidata-bugs] [Maniphest] T350157: [Analytics] Extract a representative sample of SPARQL queries from the query logs

2023-11-02 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T350157 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: AndrewTavis_WMDE, Manuel, Aklapper, Danny_Benjafield_WMDE, Astuthiodit_1

[Wikidata-bugs] [Maniphest] T350157: [Analytics] Extract a representative sample of SPARQL queries from the query logs

2023-11-02 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T350157 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: AndrewTavis_WMDE, Manuel, Aklapper, Danny_Benjafield_WMDE, Astuthiodit_1

[Wikidata-bugs] [Maniphest] T350157: [Analytics] Extract a representative sample of SPARQL queries from the query logs

2023-11-02 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T350157 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: AndrewTavis_WMDE, Manuel, Aklapper, Danny_Benjafield_WMDE, Astuthiodit_1

[Wikidata-bugs] [Maniphest] T350157: [Analytics] Extract a representative sample of SPARQL queries from the query logs

2023-11-02 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T350157 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: AndrewTavis_WMDE, Manuel, Aklapper, Danny_Benjafield_WMDE, Astuthiodit_1

[Wikidata-bugs] [Maniphest] T350157: [Analytics] Extract a representative sample of SPARQL queries from the query logs

2023-11-02 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T350157 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: AndrewTavis_WMDE, Manuel, Aklapper, Danny_Benjafield_WMDE, Astuthiodit_1

[Wikidata-bugs] [Maniphest] T350157: [Analytics] Extract a representative sample of SPARQL queries from the query logs

2023-10-31 Thread AndrewTavis_WMDE
AndrewTavis_WMDE claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T350157 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: AndrewTavis_WMDE, Manuel, Aklapper, Danny_Benjafield_WMDE, Astuthiodit_1, karapayneWMDE

[Wikidata-bugs] [Maniphest] T350157: [Analytics] Extract a representative sample of SPARQL queries from the query logs

2023-10-31 Thread AndrewTavis_WMDE
AndrewTavis_WMDE added a comment. I'm really not sure why I can't assign both `Wikidata Analytics` and `Wikidata Analytics Kanban`, @Manuel. Did you change the settings? TASK DETAIL https://phabricator.wikimedia.org/T350157 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings

[Wikidata-bugs] [Maniphest] T350157: [Analytics] Extract a representative sample of SPARQL queries from the query logs

2023-10-31 Thread AndrewTavis_WMDE
AndrewTavis_WMDE moved this task from Incoming to Kanban on the Wikidata Analytics board. AndrewTavis_WMDE edited projects, added Wikidata Analytics (Kanban); removed Wikidata Analytics. TASK DETAIL https://phabricator.wikimedia.org/T350157 WORKBOARD https://phabricator.wikimedia.org

[Wikidata-bugs] [Maniphest] T350157: [Analytics] Extract a representative sample of SPARQL queries from the query logs

2023-10-31 Thread AndrewTavis_WMDE
AndrewTavis_WMDE edited projects, added Wikidata Analytics; removed Wikidata Analytics (Kanban). TASK DETAIL https://phabricator.wikimedia.org/T350157 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: AndrewTavis_WMDE, Manuel

[Wikidata-bugs] [Maniphest] T350157: [Analytics] Extract a representative sample of SPARQL queries from the query logs

2023-10-31 Thread AndrewTavis_WMDE
AndrewTavis_WMDE edited projects, added Wikidata Analytics (Kanban); removed Wikidata Analytics. TASK DETAIL https://phabricator.wikimedia.org/T350157 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: AndrewTavis_WMDE, Manuel

[Wikidata-bugs] [Maniphest] T350157: [Analytics] Extract a representative sample of SPARQL queries from the query logs

2023-10-31 Thread AndrewTavis_WMDE
AndrewTavis_WMDE edited projects, added Wikidata Analytics; removed Wikidata Analytics (Kanban). TASK DETAIL https://phabricator.wikimedia.org/T350157 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: AndrewTavis_WMDE, Manuel

[Wikidata-bugs] [Maniphest] T350157: [Analytics] Extract a representative sample of SPARQL queries from the query logs

2023-10-31 Thread AndrewTavis_WMDE
AndrewTavis_WMDE edited projects, added Wikidata Analytics (Kanban); removed Wikidata Analytics. TASK DETAIL https://phabricator.wikimedia.org/T350157 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: AndrewTavis_WMDE, Manuel

[Wikidata-bugs] [Maniphest] T350157: [Analytics] Extract a representative sample of SPARQL queries from the query logs

2023-10-31 Thread AndrewTavis_WMDE
AndrewTavis_WMDE added a comment. Will do, @Manuel! TASK DETAIL https://phabricator.wikimedia.org/T350157 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: AndrewTavis_WMDE, Manuel, Aklapper, Danny_Benjafield_WMDE

[Wikidata-bugs] [Maniphest] T348999: Add linter and formatter to wmfdata-python (and link check)

2023-10-30 Thread AndrewTavis_WMDE
AndrewTavis_WMDE added a comment. We could further make use of pre-commit <https://pre-commit.com/> to check code before commits, which is further something that's suggested in the WMF Airflow docs <https://wikitech.wikimedia.org/wiki/Data_Engineering/Systems/Airflow/Develo

[Wikidata-bugs] [Maniphest] T348999: Add linter and formatter to wmfdata-python (and link check)

2023-10-30 Thread AndrewTavis_WMDE
AndrewTavis_WMDE added a comment. Ruff also just brought out its own formatter <https://github.com/astral-sh/ruff/blob/main/crates/ruff_python_formatter/README.md> that's fully compatible with Black. As far as formatting adoption at WMF, product analytics states here in their styl

[Wikidata-bugs] [Maniphest] T349074: [Analytics] Operationalize "UI editors"

2023-10-30 Thread AndrewTavis_WMDE
AndrewTavis_WMDE added a comment. For namespace we're talking about `User:` and similar spaces for projects, discussions, etc etc :) TASK DETAIL https://phabricator.wikimedia.org/T349074 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences

[Wikidata-bugs] [Maniphest] T349074: [Analytics] Operationalize "UI editors"

2023-10-26 Thread AndrewTavis_WMDE
AndrewTavis_WMDE added a comment. Also as far as `device_type` is concerned, @Manuel, we do not have access to a `user_agent` field in wmf.mediawiki_history <https://wikitech.wikimedia.org/wiki/Analytics/Data_Lake/Edits/MediaWiki_history> where we have the revision tags. As users can

[Wikidata-bugs] [Maniphest] T349074: [Analytics] Operationalize "UI editors"

2023-10-26 Thread AndrewTavis_WMDE
AndrewTavis_WMDE added a comment. Generally yes, @Manuel :) Working to get all of these columns figured out now  The last thing I'm considering is how we're subsetting by namespace. We have conditions for UI edits that are inherently based on Wikidata related tags with the catch-all being

[Wikidata-bugs] [Maniphest] T348999: Add linter and formatter to wmfdata-python (and link check)

2023-10-23 Thread AndrewTavis_WMDE
AndrewTavis_WMDE added a comment. Updated the task and also mentioned maybe adding an auto-formatter that could help to make sure that things are running smoothly before we have workflows set up to test PRs/MRs :) TASK DETAIL https://phabricator.wikimedia.org/T348999 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T348999: Add linter and formatter to wmfdata-python (and link check)

2023-10-23 Thread AndrewTavis_WMDE
AndrewTavis_WMDE renamed this task from "wmfdata-python formatting and link check" to "Add linter and formatter to wmfdata-python (and link check)". AndrewTavis_WMDE claimed this task. AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedi

[Wikidata-bugs] [Maniphest] T348999: wmfdata-python formatting and link check

2023-10-23 Thread AndrewTavis_WMDE
AndrewTavis_WMDE added a comment. See T349531: Add testing framework to wmfdata-python <https://phabricator.wikimedia.org/T349531>, @xcollazo! Added you and @nshahquinn-wmf as subscribers already :) TASK DETAIL https://phabricator.wikimedia.org/T348999 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T348999: wmfdata-python formatting and link check

2023-10-23 Thread AndrewTavis_WMDE
AndrewTavis_WMDE added a comment. Ok, great! I'll check out some ideas for Ruff and maybe get started on this next week :) I'll hold off on the GitHub action as well as I'm remembering now that @nshahquinn-wmf mentioned the move to GitLab in T341589: Improve df_to_remarkup formatting

[Wikidata-bugs] [Maniphest] T341589: Improve df_to_remarkup formatting for wmfdata-python

2023-10-23 Thread AndrewTavis_WMDE
AndrewTavis_WMDE closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T341589 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: Aklapper, nshahquinn-wmf, AndrewTavis_WMDE, Danny_Benjafield_WMDE

[Wikidata-bugs] [Maniphest] T341589: Improve df_to_remarkup formatting for wmfdata-python

2023-10-23 Thread AndrewTavis_WMDE
AndrewTavis_WMDE added a comment. @nshahquinn-wmf, resolving this as the PR was merged  Thanks for the support here! TASK DETAIL https://phabricator.wikimedia.org/T341589 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc

[Wikidata-bugs] [Maniphest] T348999: wmfdata-python formatting and link check

2023-10-23 Thread AndrewTavis_WMDE
AndrewTavis_WMDE added a comment. I'd be happy to look into this, @xcollazo! We were discussing linting and checks like this in an open-source project I work on and decided to go with Ruff <https://github.com/astral-sh/ruff>. Would that be worth adopting instead of `flake8`? I coul

[Wikidata-bugs] [Maniphest] T349074: [Analytics] Operationalize "active UI editors"

2023-10-20 Thread AndrewTavis_WMDE
AndrewTavis_WMDE added a comment. Something to also consider here @Manuel is what we like for a timestamp. We have aggregations here, so a granular timestamp would inherently go against the 30 day period. What were you thinking on that? TASK DETAIL https://phabricator.wikimedia.org

[Wikidata-bugs] [Maniphest] T343690: [Analytics] Wikidata edits by UI variant

2023-10-20 Thread AndrewTavis_WMDE
AndrewTavis_WMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T343690 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: AndrewTavis_WMDE, Aklapper, Manuel, Danny_Benjafield_WMDE, Astuthiodit_1

[Wikidata-bugs] [Maniphest] T349074: [Analytics] Operationalize "active UI editors"

2023-10-19 Thread AndrewTavis_WMDE
AndrewTavis_WMDE added a comment. @Manuel, do we want namespace to just be a column? Simplicity wise it might make sense to split all the metrics by namespace and then get aggregates via a group by on user id rather than saving data and the aggregate of data in the same table. TASK DETAIL

[Wikidata-bugs] [Maniphest] T349074: [Analytics] Operationalize "active UI editors"

2023-10-17 Thread AndrewTavis_WMDE
AndrewTavis_WMDE claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T349074 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: Manuel, Aklapper, Danny_Benjafield_WMDE, Astuthiodit_1, karapayneWMDE, Invadibot

[Wikidata-bugs] [Maniphest] T349071: [Analytics] Explore Babels

2023-10-17 Thread AndrewTavis_WMDE
AndrewTavis_WMDE claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T349071 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: Aklapper, Manuel, Danny_Benjafield_WMDE, Astuthiodit_1, karapayneWMDE, Invadibot

[Wikidata-bugs] [Maniphest] T341589: Improve df_to_remarkup formatting for wmfdata-python

2023-10-16 Thread AndrewTavis_WMDE
AndrewTavis_WMDE added a comment. Thanks, @nshahquinn-wmf! I've made wikimedia/wmfdata-python/pull/46 <https://github.com/wikimedia/wmfdata-python/pull/46> with the discussed changes :) :) TASK DETAIL https://phabricator.wikimedia.org/T341589 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T348240: [EPIC] How are Wikidata editors modifying their Item UI?

2023-10-13 Thread AndrewTavis_WMDE
AndrewTavis_WMDE added a comment. wser_properties_table <https://www.mediawiki.org/wiki/Manual:User_properties_table> can be used for preferences. How we access it is still to be figured out. TASK DETAIL https://phabricator.wikimedia.org/T348240 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T348240: [EPIC] How are Wikidata editors modifying their Item UI?

2023-10-13 Thread AndrewTavis_WMDE
AndrewTavis_WMDE added a comment. mediawiki_wikitext_current <https://wikitech.wikimedia.org/wiki/Analytics/Data_Lake/Content/Mediawiki_wikitext_current> can likely be used for the `common.js` and `common.css` files :) TASK DETAIL https://phabricator.wikimedia.org/T348240

[Wikidata-bugs] [Maniphest] T348240: [EPIC] How are Wikidata editors modifying their Item UI?

2023-10-13 Thread AndrewTavis_WMDE
AndrewTavis_WMDE claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T348240 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: Aklapper, Manuel, me, Danny_Benjafield_WMDE, Astuthiodit_1, BeautifulBold, Suran38

<    1   2   3   4   5   6   7   >