AndrewTavis_WMDE added a comment.
Checking in with you all on this: The big question that @Manuel and I have on this is whether or not this process is currently generating some time series data that would be of particular value and then would be lost and not able to be recreated from the data lake. I have been able to get the pageviews per namespace time series dashboard up and running locally, but that has not updated since February. The other data that's being produced by this process, which can be found here <https://analytics.wikimedia.org/published/datasets/wmde-analytics-engineering/Wikidata/>, seems to just be current values and not time series (except for propertypairs, which we're investigating further). Do you all have any knowledge of some tables within the data lake that are being updated by this process that would then be broken by us stopping the job? A broader question: does anyone at WMF know of tables in the data lake that Wikimedia Deutschland created/maintained in the past that are still being updated? Would be great to be pointed towards them so we can investigate further :) Our thoughts on this: - If the answer to the above question of permanently losing some data that's being produced by Concepts Monitor and other WMDE jobs is no, then we're ok with option one above of stopping the job. - Aside from this we'd prefer option two of configuring it to use fixed-resource. TASK DETAIL https://phabricator.wikimedia.org/T334951 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: AndrewTavis_WMDE Cc: ItamarWMDE, BTullis, GoranSMilovanovic, AndrewTavis_WMDE, Aklapper, Manuel, JAllemandou, lbowmaker, xcollazo, Astuthiodit_1, EChetty, karapayneWMDE, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331
_______________________________________________ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
