[Wikidata-bugs] [Maniphest] T281063: Wikidata Concepts Monitor: some datasets are empty

GoranSMilovanovic closed this task as "Resolved". GoranSMilovanovic added a comment. @MisterSynergy I will close this task now. Please re-open or file a new ticket altogether if you encounter any similar problems. Again, thanks for catching this. TASK DETAIL

[Wikidata-bugs] [Maniphest] T281063: Wikidata Concepts Monitor: some datasets are empty

GoranSMilovanovic closed subtask T281316: WDCM_Sqoop_Clients.R fails from stat1004 (again) as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T281063 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: elukey, WMDE-leszek,

[Wikidata-bugs] [Maniphest] T281063: Wikidata Concepts Monitor: some datasets are empty

GoranSMilovanovic added a comment. @MisterSynergy > your wikidata-analytics.wmcloud.org seems to be down currently, but I am accessing the topItems.csv file directly anyways Yes, some changes in production were just deployed (in relation to T277554

[Wikidata-bugs] [Maniphest] T281063: Wikidata Concepts Monitor: some datasets are empty

MisterSynergy added a comment. In T281063#7047547 , @GoranSMilovanovic wrote: > @MisterSynergy > > The WDCM system update should be in place now. > > Please let me know if the datasets

[Wikidata-bugs] [Maniphest] T281063: Wikidata Concepts Monitor: some datasets are empty

GoranSMilovanovic lowered the priority of this task from "High" to "Low". TASK DETAIL https://phabricator.wikimedia.org/T281063 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: elukey, WMDE-leszek, GoranSMilovanovic, Manuel,

[Wikidata-bugs] [Maniphest] T281063: Wikidata Concepts Monitor: some datasets are empty

GoranSMilovanovic added a comment. @MisterSynergy I have checked the datasets in Wikidata Analytics and everything seems to be in place now. TASK DETAIL https://phabricator.wikimedia.org/T281063 EMAIL

[Wikidata-bugs] [Maniphest] T281063: Wikidata Concepts Monitor: some datasets are empty

GoranSMilovanovic added a comment. @MisterSynergy The WDCM system update should be in place now. Please let me know if the datasets that you need are now complete. I apologize for any

[Wikidata-bugs] [Maniphest] T281063: Wikidata Concepts Monitor: some datasets are empty

GoranSMilovanovic reopened subtask T281316: WDCM_Sqoop_Clients.R fails from stat1004 (again) as Open. TASK DETAIL https://phabricator.wikimedia.org/T281063 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: elukey, WMDE-leszek,

[Wikidata-bugs] [Maniphest] T281063: Wikidata Concepts Monitor: some datasets are empty

GoranSMilovanovic added a comment. Current status: - WDCM system update completed; - monitoring the Wikidata Analytics now, TASK DETAIL https://phabricator.wikimedia.org/T281063 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To:

[Wikidata-bugs] [Maniphest] T281063: Wikidata Concepts Monitor: some datasets are empty

GoranSMilovanovic added a comment. Current status: - WDCM system update: complete; - monitoring WDCM datasets and dashboards now. TASK DETAIL https://phabricator.wikimedia.org/T281063 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To:

[Wikidata-bugs] [Maniphest] T281063: Wikidata Concepts Monitor: some datasets are empty

elukey closed subtask T281316: WDCM_Sqoop_Clients.R fails from stat1004 (again) as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T281063 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic, elukey Cc: elukey, WMDE-leszek,

[Wikidata-bugs] [Maniphest] T281063: Wikidata Concepts Monitor: some datasets are empty

GoranSMilovanovic added a comment. WDCM system update, current status - Collect module (SPARQL/GAS) completed; - ETL module (Spark) completed; - ML module is now running. TASK DETAIL https://phabricator.wikimedia.org/T281063 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T281063: Wikidata Concepts Monitor: some datasets are empty

GoranSMilovanovic added a comment. Current status: - `WDCM_Sqoop_Clients.R` update is completed; - running a manual update of the WDCM system now. TASK DETAIL https://phabricator.wikimedia.org/T281063 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T281063: Wikidata Concepts Monitor: some datasets are empty

GoranSMilovanovic added a comment. Current status: - monitoring the `WDCM_Sqoop_Clients.R` update, - all looking good; - it might take 10 - 12 hours for this procedure to complete. TASK DETAIL https://phabricator.wikimedia.org/T281063 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T281063: Wikidata Concepts Monitor: some datasets are empty

GoranSMilovanovic added a subscriber: elukey. GoranSMilovanovic added a comment. The problem will be handled here and in T281316 (where we already have the solution thanks to @elukey). The following T281063#7037642

[Wikidata-bugs] [Maniphest] T281063: Wikidata Concepts Monitor: some datasets are empty

GoranSMilovanovic added a comment. @MisterSynergy Thank you for catching this. > re-run the script for fresh datasets > ensure that it won't put empty datasets there in the future again Sure, but first we need to find out about the cause of this failure. I suspect that it might be

[Wikidata-bugs] [Maniphest] T281063: Wikidata Concepts Monitor: some datasets are empty

GoranSMilovanovic claimed this task. GoranSMilovanovic added a project: User-GoranSMilovanovic. GoranSMilovanovic triaged this task as "High" priority. GoranSMilovanovic added a subscriber: WMDE-leszek. TASK DETAIL https://phabricator.wikimedia.org/T281063 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T281063: Wikidata Concepts Monitor: some datasets are empty

Lydia_Pintscher added subscribers: Manuel, GoranSMilovanovic. Lydia_Pintscher added a project: WMDE-Analytics-Engineering. TASK DETAIL https://phabricator.wikimedia.org/T281063 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Lydia_Pintscher Cc:

[Wikidata-bugs] [Maniphest] T281063: Wikidata Concepts Monitor: some datasets are empty

MisterSynergy created this task. MisterSynergy added a project: Wikidata. Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION Some of the datasets provided via https://wikidata-analytics.wmcloud.org/app_direct/WikidataAnalytics/datasets.html seem to be empty since an update