[Wikidata-bugs] [Maniphest] T334951: Wikidata Concepts Monitor ETL Migration to Spark3
GoranSMilovanovic added a comment. @Manuel It is not that I am very much involved, but the professional situation with me is simply as it is: I can barely find any time besides the responsibilities that I carry. However, I will really make an effort in the end of May to clear up some space for our work in June. Objective constraints - that is all that I can offer as an excuse. TASK DETAIL https://phabricator.wikimedia.org/T334951 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: xcollazo, GoranSMilovanovic Cc: ItamarWMDE, BTullis, GoranSMilovanovic, AndrewTavis_WMDE, Aklapper, Manuel, JAllemandou, lbowmaker, xcollazo, Astuthiodit_1, EChetty, karapayneWMDE, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T334951: Wikidata Concepts Monitor ETL Migration to Spark3
GoranSMilovanovic added a comment. @BTullis With all the good will I have to help with this, there's no chance I'll be able to help before June 2023. TASK DETAIL https://phabricator.wikimedia.org/T334951 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: xcollazo, GoranSMilovanovic Cc: BTullis, GoranSMilovanovic, AndrewTavis_WMDE, Aklapper, Manuel, JAllemandou, lbowmaker, xcollazo, Astuthiodit_1, EChetty, karapayneWMDE, Invadibot, maantietaja, ItamarWMDE, Akuckartz, Nandana, Lahi, Gq86, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T327922: Most of our Wikidata's ShinyProxy based analytics dashboards have stopped working
GoranSMilovanovic added a comment. @MarcoSwart Unfortunately, not yet. I am struggling to find some time and promote my test server to production to serve the dashboards from there at least temporarily, until the CloudVPS issues are resolved. I will let you know as soon as I have something. TASK DETAIL https://phabricator.wikimedia.org/T327922 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: MarcoSwart, GoranSMilovanovic, Otourly, Aklapper, Manuel, Astuthiodit_1, karapayneWMDE, Invadibot, maantietaja, ItamarWMDE, Akuckartz, Nandana, Lahi, Gq86, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T327922: Most of our Wikidata's ShinyProxy based analytics dashboards have stopped working
GoranSMilovanovic added a comment. @Otourly Note: I do not work for WMDE since March 2022, so you will need to see with @Manuel about their plans, but from my side - I will try to set up the Wikidata Analytics dashboards on my server (which is currently a test environment only) as soon as find the time to do it; - from everything I know the dashboards should run from that server w/o any problems; - so that people who need the dashboards will be able access them from there until this problem is fixed; I will share the dashboard URLs once that is finished; - as of serving Wikidata Analytics from Wikimedia's CloudVPS you will really have to wait until this ticket is resolved. TASK DETAIL https://phabricator.wikimedia.org/T327922 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: GoranSMilovanovic, Otourly, Aklapper, Manuel, Astuthiodit_1, karapayneWMDE, Invadibot, maantietaja, ItamarWMDE, Akuckartz, Nandana, Lahi, Gq86, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T321666: Wiktionary Cognate Dashboard is not accessible [timeboxed 0.5 days]
GoranSMilovanovic added a comment. What I will probably be able to do in the following weeks is to prepare a production environment on one my (DataKolektiv) server and run Wikidata Analytics and Wiktionary Cognate in a production environment from there, so that the community can have the dashboards available. As of the CloudVPS related problems in running these two systems under ShinyProxy, there is nothing else that I can do; you need to find someone with expertise in web-servers (ShinyProxy is nothing more than a web-server) and virtualization to identify and solve the problem. From all my previous attempts, Wikidata Analytics and Wiktionary Cognate run safely in any environment that I have tested except CloudVPS. TASK DETAIL https://phabricator.wikimedia.org/T321666 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Lydia_Pintscher, WMDE-leszek, Pamputt, MarcoSwart, GoranSMilovanovic, Otourly, ItamarWMDE, Aklapper, Manuel, Astuthiodit_1, karapayneWMDE, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Thibaut120094, Wikidata-bugs, aude, Darkdadaah, Mbch331, Ltrlg ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T321666: Wiktionary Cognate Dashboard is not accessible [timeboxed 0.5 days]
GoranSMilovanovic added subscribers: WMDE-leszek, Lydia_Pintscher. GoranSMilovanovic added a comment. Ok, we have a problem. @Manuel @ItamarWMDE @WMDE-leszek @Lydia_Pintscher After having rebuilt only two of the Wikidata Analytics images on `wikidata-analytics` in the `wmde-dashboards` CloudVPS project - in an attempt to actually cure something else, namely the Wiktionary Cognate Dashboard - the whole system became irresponsive following the same pattern that @ItamarWMDE and I have already faced (and failed to understand) in 2022 during our work on the `wmdeanalytics` CloudVPS projects. It is simple: - the containers time-out under ShinyProxy <https://www.shinyproxy.io/faq/>. Currently, **not only the Wiktionary Cognate Dashboard, but the whole Wikidata Analytics suite is unavailable.** The problem in CloudVPS has nothing to do with any known ShinyProxy related problematics: - **I can run the Docker containers manually and they respond without any errors** - **I can also replicate the whole Wikidata Analytics suite**, with exactly the same architecture (for R specialists: ShinyProxy + containers from images built under the Golem framework) as we have on our CloudVPS virtual machines, **on a separate, test server, and it delivers there without any hiccups**; - **ergo:** this has something do with the setup of the CloudVPS machines, be it some Puppet run that changed something, or something else that a DevOps engineer might be able to help around - but that I can certainly not help around. It would be a pity to lose the functionality of a five year long development of Wikidata Analytics and Wiktionary Cognate (2017 - 2022) for reasons related to system engineering. And please do not tell me that it is something peculiar, R related thing - R is the 13th most popular programming language on the Tiobe index in 2022, it has native support in standard MLOps solutions like AWS SageMaker, etc. So it's not R, and it is not ShinyProxy, nor it is anything else R related; it is something related to the underlying setup of the CloudVPS machines. Let me know when you find someone who can make a deep dive into this. TASK DETAIL https://phabricator.wikimedia.org/T321666 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Lydia_Pintscher, WMDE-leszek, Pamputt, MarcoSwart, GoranSMilovanovic, Otourly, ItamarWMDE, Aklapper, Manuel, Astuthiodit_1, karapayneWMDE, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Thibaut120094, Wikidata-bugs, aude, Darkdadaah, Mbch331, Ltrlg ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T321666: Wiktionary Cognate Dashboard is not accessible [timeboxed 0.5 days]
GoranSMilovanovic added a comment. I have found some time to inspect the problem - and the problem is very strange. All Wikidata Analytics + Wiktionary Analytics Docker images are being rebuild right now in CloudVPS. The services will be unavailable for some time. For a moment, I was able to put the Wiktionary Cognate Dashboard back online, but it was crushing for some other reasons. I will be reporting back ASAP, but please take into you consideration that my time to work on this issues is quite limited. Thank you. TASK DETAIL https://phabricator.wikimedia.org/T321666 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Pamputt, MarcoSwart, GoranSMilovanovic, Otourly, ItamarWMDE, Aklapper, Manuel, Astuthiodit_1, karapayneWMDE, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Thibaut120094, Wikidata-bugs, aude, Lydia_Pintscher, Darkdadaah, Mbch331, Ltrlg ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T321666: Wiktionary Cognate Dashboard is not accessible [timeboxed 0.5 days]
GoranSMilovanovic added a comment. @Otourly I am currently focused on my professional obligations. I will have some more time following December 26, but then I will also need to rest and spend time with my family. So, as soon as the time permits, I will take a look at this. Also, if the issue here is related to ShinyProxy indeed - as @Itamar hypothesized - then my help is not even necessary. I do not know if anyone tried to test that hypothesis or not in the previous months, but it would definitely be my first choice in addressing why the dashboard stopped. TASK DETAIL https://phabricator.wikimedia.org/T321666 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: MarcoSwart, GoranSMilovanovic, Otourly, ItamarWMDE, Aklapper, Manuel, Astuthiodit_1, karapayneWMDE, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Thibaut120094, Wikidata-bugs, aude, Lydia_Pintscher, Darkdadaah, Mbch331, Ltrlg ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T323460: WDCM update missing
GoranSMilovanovic closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T323460 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: WMDE-leszek, Manuel, ItamarWMDE, GoranSMilovanovic, Aklapper, MisterSynergy, Astuthiodit_1, karapayneWMDE, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T323975: Puppet failure on several WMDE's CloudVPS projects
GoranSMilovanovic added a subscriber: LucasWerkmeister. GoranSMilovanovic added a comment. @LucasWerkmeister Thank you Lucas! TASK DETAIL https://phabricator.wikimedia.org/T323975 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: LucasWerkmeister, Lucas_Werkmeister_WMDE, WMDE-leszek, ItamarWMDE, Manuel, GoranSMilovanovic, Aklapper, Astuthiodit_1, karapayneWMDE, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T323975: Puppet failure on several WMDE's CloudVPS projects
GoranSMilovanovic created this task. GoranSMilovanovic added projects: WMDE-Analytics-Engineering, Wikidata, Wikidata Analytics. Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION I have started to receive e-mail warnings on Puppet failures for WMDE's Wikidata, Wiktionary, and New Editors analytics related CloudVPS projects: - [Cloud VPS alert][wmdeanalytics] Puppet failure on wikidata-analytics-1.wmdeanalytics.eqiad1.wikimedia.cloud - [Cloud VPS alert][wmde-dashboards] Puppet failure on wikidata-analytics.wmde-dashboards.eqiad1.wikimedia.cloud - [Cloud VPS alert][wmde-dashboards] Puppet failure on wiktionary-cognate.wmde-dashboards.eqiad1.wikimedia.cloud - [Cloud VPS alert][wmdeanalytics] Puppet failure on wiktionary-cognate-1.wmdeanalytics.eqiad1.wikimedia.cloud - [Cloud VPS alert][wmde-dashboards] Puppet failure on wmde-neweditors.wmde-dashboards.eqiad1.wikimedia.cloud From the e-mails: > **Puppet is running with failures. Working Puppet runs are needed to maintain instance security and logins. As long as Puppet continues to fail, this system is in danger of becoming unreachable.** The following documentation page (that was not of much help, or at least not for me) is cited in the emails: Portal:Cloud VPS/Admin/Runbooks/Cloud VPS alert Puppet failure on <https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Cloud_VPS_alert_Puppet_failure_on> I have no Puppet or any advanced System Engineering skills, so someone with the appropriate expertise should take a look at this and recommend the course of action. TASK DETAIL https://phabricator.wikimedia.org/T323975 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: WMDE-leszek, ItamarWMDE, Manuel, GoranSMilovanovic, Aklapper, Astuthiodit_1, karapayneWMDE, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T323460: WDCM update missing
GoranSMilovanovic added a comment. @MisterSynergy @Manuel @WMDE-leszek @ItamarWMDE And the update timestamp is now `Last update: 2022-11-28 09:20:32 UTC` - so, WDCM is updating on the schedule. I think we can close this ticket. Thank you. TASK DETAIL https://phabricator.wikimedia.org/T323460 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: WMDE-leszek, Manuel, ItamarWMDE, GoranSMilovanovic, Aklapper, MisterSynergy, Astuthiodit_1, karapayneWMDE, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T323460: WDCM update missing
GoranSMilovanovic added a comment. @MisterSynergy @Manuel @WMDE-leszek @ItamarWMDE I have checked the WDCM dashboards today (November 24, 2022) and the latest update timestamp reported was `Last update: 2022-11-21 11:29:50 UTC` That means that the previous update (the missing one, reported in this ticket) most probably failed for reasons such as high demand of our computational (cluster) resources, or something similar. That can happen, and it already happened in the past - but it happens quite rarely. The WMF has a very nice tech infrastructure but again limited given the number of tasks that it has to carry out and systems that rely on it. TASK DETAIL https://phabricator.wikimedia.org/T323460 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: WMDE-leszek, Manuel, ItamarWMDE, GoranSMilovanovic, Aklapper, MisterSynergy, Astuthiodit_1, karapayneWMDE, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T251792: Wiktionary Cognate Dashboard not updated
GoranSMilovanovic claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T251792 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: ItamarWMDE, Tobi_WMDE_SW, Manuel, Otourly, Addshore, Aklapper, Lydia_Pintscher, GoranSMilovanovic, Lea_Lacroix_WMDE, Astuthiodit_1, karapayneWMDE, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Thibaut120094, jberkel, Psychoslave, Wikidata-bugs, aude, Shizhao, Nemo_bis, Darkdadaah, Mbch331, Ltrlg, Krenair ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T323460: WDCM update missing
GoranSMilovanovic claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T323460 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: WMDE-leszek, Manuel, ItamarWMDE, GoranSMilovanovic, Aklapper, MisterSynergy, Astuthiodit_1, karapayneWMDE, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T323460: WDCM update missing
GoranSMilovanovic added subscribers: ItamarWMDE, Manuel, WMDE-leszek. GoranSMilovanovic added a comment. Restricted Application added a project: User-ItamarWMDE. @MisterSynergy I need to check that as soon as possible and see why the update failed (if the update failed - or it's something else that has gone wrong). Thank you for noticing this and reporting. @Manuel @WMDE-leszek @ItamarWMDE I still have to see what is happening to the Wiktionary Cognate dashboard in T251792 <https://phabricator.wikimedia.org/T251792> . It is quite difficult to run around all these analytical systems now that I am volunteering only - I have tons of things that I have to look after besides this. TASK DETAIL https://phabricator.wikimedia.org/T323460 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: WMDE-leszek, Manuel, ItamarWMDE, GoranSMilovanovic, Aklapper, MisterSynergy, Astuthiodit_1, karapayneWMDE, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T321666: Wiktionary Cognate Dashboard is not accessible [timeboxed 0.5 days]
GoranSMilovanovic added a comment. @ItamarWMDE @Manuel I will see to take a look at it ASAP. TASK DETAIL https://phabricator.wikimedia.org/T321666 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: GoranSMilovanovic, Otourly, ItamarWMDE, Aklapper, Manuel, Astuthiodit_1, karapayneWMDE, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Thibaut120094, Wikidata-bugs, aude, Lydia_Pintscher, Darkdadaah, Mbch331, Ltrlg ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T295396: Redirect deprecated Wikidata Analytics URLs to the current URLs
GoranSMilovanovic added a comment. @karapayneWMDE [Also in a recent email to @Manuel] Move WMDE analytics into a new CloudVPS project <https://phabricator.wikimedia.org/T299568> is not a blocker of [[ https://phabricator.wikimedia.org/T295396 | Redirect deprecated Wikidata Analytics URLs to the current URLs ]]in any way. The issue in the first ticket is related to some problem in the internal communication of ShinyProxy with its Docker containers. The redirect things, if I understand correctly, could be solved by placing Nginx in front of ShinyProxy as described in - Shiny Proxy Docs <https://www.shinyproxy.io/documentation/security/>, and maybe in - Custom Domain and Security for ShinyProxy with Nginx <https://www.r-bloggers.com/2021/08/custom-domain-and-security-for-shinyproxy-with-nginx/> TASK DETAIL https://phabricator.wikimedia.org/T295396 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: karapayneWMDE, ItamarWMDE, noarave, Addshore, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Aklapper, Manuel, Astuthiodit_1, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T307763: Wikidata usage and coverage dashboard only shows partial data
GoranSMilovanovic added a comment. @Lydia_Pintscher @Tobi_WMDE_SW @Manuel @ItamarWMDE I have just checked the dashboard <https://wikidata-analytics.wmcloud.org/app/WikidataAnalytics> and it shows the data for all projects as it did before. Similarly to what recently happened with the Wiktionary Cognate Dashboard, this seems to be related to some temporarily change or failure on the databases/data engineering side (not under my control). Let's monitor the behaviour of this dashboard for a while and then decide if this ticket should be solved. TASK DETAIL https://phabricator.wikimedia.org/T307763 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: GoranSMilovanovic, Tobi_WMDE_SW, Manuel, ItamarWMDE, Aklapper, Lydia_Pintscher, Astuthiodit_1, karapayneWMDE, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T307763: Wikidata usage and coverage dashboard only shows partial data
GoranSMilovanovic added subscribers: ItamarWMDE, Manuel, Tobi_WMDE_SW, GoranSMilovanovic. GoranSMilovanovic added a comment. @Lydia_Pintscher @Tobi_WMDE_SW @Manuel This has probably something to do with the ETL module of the dashboard. I will inspect the issue together with @ItamarWMDE who will be taking over Wikidata Analytics from me as soon as we complete the transfer of the dashboards maintenance to him. TASK DETAIL https://phabricator.wikimedia.org/T307763 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: GoranSMilovanovic, Tobi_WMDE_SW, Manuel, ItamarWMDE, Aklapper, Lydia_Pintscher, Astuthiodit_1, karapayneWMDE, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T297303: Re-productionize the Wiktionary Cognate Dashboard
GoranSMilovanovic added a comment. The current URL is > https://wiktionary-analytics.wmcloud.org/Wiktionary_CognateDashboard/ In case we keep a separate CloudVPS to run this dashboard it would be: > https://wiktionary-analytics.wmcloud.org/app/Wiktionary_CognateDashboard In case we decide to run this dashboard alongside the Wikidata Analytics system it would look like: > https://wikidata-analytics.wmcloud.org/app/Wiktionary_CognateDashboard TASK DETAIL https://phabricator.wikimedia.org/T297303 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Manuel, Aklapper, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T297303: Re-productionize the Wiktionary Cognate Dashboard
GoranSMilovanovic added a comment. Wiktionary Cognate Dashboard is fully re-productionized now, test server: http://datakolektiv.org/app_direct/WiktionaryCognate/ - Deployment: deployment to CloudVPS will take places as soon as - the changes in the dashboard URL are announced in the Wiktionary community - (the changes being necessary because of the new Shinyproxy setup in production, same case as for Wikidata Analytics in the beginning of 2021) - there will be a very short discontinuation of service while the old production environment is replaced by the new one. TASK DETAIL https://phabricator.wikimedia.org/T297303 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Manuel, Aklapper, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T297303: Re-productionize the Wiktionary Cognate Dashboard
GoranSMilovanovic added a comment.
Wiktionary Cognate Dashboard is being test under the new production approach
now on the test server <http://datakolektiv.org/app_direct/WikidataAnalytics/>.
- the dashboard update engine is containerized separately (the same approach
taken as in Qurator Current Events/Curious Facts);
- the dashboard is productionized as an R package under {golem} (it was
previously running in production as a stand-alone Shiny app);
- everything should run under the ShinyProxy server in the same way as
Wikidata Analytics are run.
There are some bugs to be fixed; working on it.
TASK DETAIL
https://phabricator.wikimedia.org/T297303
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: GoranSMilovanovic
Cc: Manuel, Aklapper, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86,
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS,
Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T299571: Input on how we could integrate data analytics in our dev team
GoranSMilovanovic added a subscriber: Tobi_WMDE_SW. GoranSMilovanovic added a comment. @Manuel @Tobi_WMDE_SW Here <https://docs.google.com/document/d/1lSvLkfdcHTReQsFs2WNmjWm1INF5bGKHJE_wm82MOFs/edit> is how I think about what WMDE can do in order to address the questions posed in the ticket description. In short: - for any analytical report on Wikidata, your formula is: SQL/HiveQL/Pyspark (to produce the data) + MediaWiki/JS `D3` library to serve the reports; - for time-series dashboards you have the Graphite/Grafana stack already running; - for more complicate dashboards as I am running in Wikidata Analytics <https://wikidata-analytics.wmcloud.org/app/WikidataAnalytics>: you need someone to pick-up the Python/Plotly/Dash/Flask stack if you do not want to stay in R and you probably do not (since you need to hire an R specialist like me again), and - for the Wikidata Analytics Portal <https://wikidata-analytics.wmcloud.org/app/WikidataAnalytics>: you leave it to me to maintain it on volunteer basis as of April 2022, which I will gladly do, since the transfer of that codebase would ask (a) for another experienced R professional for whom (b) it would again take a lot of time to take over the whole codebase that is a result of my five-year long development efforts. TASK DETAIL https://phabricator.wikimedia.org/T299571 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Tobi_WMDE_SW, GoranSMilovanovic, Manuel, Aklapper, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T297485: Implement regular data backups for our R Shiny dashboards for Wikidata
GoranSMilovanovic added subscribers: JAllemandou, Milimetric, Tobi_WMDE_SW. GoranSMilovanovic added a comment. @Tobi_WMDE_SW #analytics <https://phabricator.wikimedia.org/tag/analytics/> @JAllemandou @Milimetric Our Wikidata Analytics PM @Manuel would like to get in touch with the WMF Analytics team and find out if the data from the Analytics Clients are being regularly backed-up: T297485#7653025 <https://phabricator.wikimedia.org/T297485#7653025> TASK DETAIL https://phabricator.wikimedia.org/T297485 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Tobi_WMDE_SW, Milimetric, JAllemandou, Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T297485: Implement regular data backups for our R Shiny dashboards for Wikidata
GoranSMilovanovic added a comment. @Manuel The WMF Analytics-Engineering team. TASK DETAIL https://phabricator.wikimedia.org/T297485 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T297485: Implement regular data backups for our R Shiny dashboards for Wikidata
GoranSMilovanovic added a comment. @Manuel As long as my R production scripts on the Analytics Clients <https://wikitech.wikimedia.org/wiki/Analytics/Systems/Clients> are running the data that feed our analytics will be regularly updated. The data are copied to the public directory <https://analytics.wikimedia.org/published/datasets/wmde-analytics-engineering/>, and also exist on a path in the `/srv` folder on the Analytics Clients as well as in my home directory there. I guess the Analytics Clients machines are being regularly backed-up but that is more a question for the #analytics <https://phabricator.wikimedia.org/tag/analytics/>. TASK DETAIL https://phabricator.wikimedia.org/T297485 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T297225: [Current Events] filter out some expected/unneeded Items
GoranSMilovanovic added a comment. @Manuel - new items out filter out added; - a `CSV` download button is now present at the bottom of each table; - check out the Dashboard <https://wikidata-analytics.wmcloud.org/app/CurrentEvents>. TASK DETAIL https://phabricator.wikimedia.org/T297225 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: GoranSMilovanovic, Manuel, Aklapper, Lydia_Pintscher, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard
GoranSMilovanovic added a comment. @Manuel Fixed, check out the Dashboard <https://wikidata-analytics.wmcloud.org/app/CurrentEvents>. TASK DETAIL https://phabricator.wikimedia.org/T294983 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Tobi_WMDE_SW, Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T297225: [Current Events] filter out some expected/unneeded Items
GoranSMilovanovic added a comment. @Manuel Great, thanks! TASK DETAIL https://phabricator.wikimedia.org/T297225 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: GoranSMilovanovic, Manuel, Aklapper, Lydia_Pintscher, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T297225: [Current Events] filter out some expected/unneeded Items
GoranSMilovanovic added a comment. @Manuel Could you please provide a `.csv` file with a list of all items that need to be filtered our? Thanks. TASK DETAIL https://phabricator.wikimedia.org/T297225 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: GoranSMilovanovic, Manuel, Aklapper, Lydia_Pintscher, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T297305: Ensure preliminary research data sets are accessible
GoranSMilovanovic added a comment. @Manuel Here you go: Google Drive spreadsheet with research datasets. <https://docs.google.com/spreadsheets/d/13-r6RoIl09H5JXjNksqlqNLOP4mYHyqPYBSaOjuU74A/edit?pli=1#gid=0> TASK DETAIL https://phabricator.wikimedia.org/T297305 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: GoranSMilovanovic, Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T292862: Create an automatically updated dashboard out of the Wikidata Quality Report
GoranSMilovanovic added a comment. Nope. There are several timestamps and you are looking only at the report timestamp which is indeed update daily because the report automatically re-renders itself every day. Take a look at the text of the report, the very first few paragraphs, and you will that there are two additional timestamps: (a) the Wikidata JSON dump to hdfs timestamp and (b) the WDCM re-use statistics timestamp. The report is really update every time we have a new version of the Wikidata JSON dump copied to hdfs to the `wmf.wikidata_entity` table. TASK DETAIL https://phabricator.wikimedia.org/T292862 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Manuel, Aklapper, Lydia_Pintscher, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T297503: Create knowledge-transfer document about the WMDE analytics infrastructure
GoranSMilovanovic added a comment. @Manuel The document is useful, I agree, but trust me on this: it will be more useful to our new Data Analyst to go through all the steps in that document with me 1:1. TASK DETAIL https://phabricator.wikimedia.org/T297503 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: GoranSMilovanovic, Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T295396: Redirect deprecated Wikidata Analytics URLs to the current URLs
GoranSMilovanovic added a comment. @noarave @Manuel @Addshore I would have already added new members but it turns out that I am not authorised to do so in Horizon. TASK DETAIL https://phabricator.wikimedia.org/T295396 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: noarave, Addshore, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T297503: Create knowledge-transfer document about the WMDE analytics infrastructure
GoranSMilovanovic added a comment. @Manuel Here it is: Wikidata Knowledge Transfer <https://docs.google.com/document/d/1bGV5yHV9AKk2nblIo3AY0LBU3nHC54axZTqP16PsM34/edit>. Our new Data Scientist would also have to take a look at my 2017 Onboarding Document <https://docs.google.com/document/d/1lSP4aamtkv1XI5euC1NAGWeci9M39ZiXkkmB9vCwmUE/edit#>. I think that it would be beneficial for the new Data Scientist to have a set of 1:1 sessions with me until we make sure that they can access all of the Analytics Infrastructure. TASK DETAIL https://phabricator.wikimedia.org/T297503 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: GoranSMilovanovic, Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T297485: Implement regular data backups for our R Shiny dashboards for Wikidata
GoranSMilovanovic claimed this task. GoranSMilovanovic added a project: User-GoranSMilovanovic. TASK DETAIL https://phabricator.wikimedia.org/T297485 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T297303: Re-productionize the Wiktionary Cognate Dashboard
GoranSMilovanovic claimed this task. GoranSMilovanovic added a project: User-GoranSMilovanovic. TASK DETAIL https://phabricator.wikimedia.org/T297303 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Manuel, Aklapper, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T283568: [Epic] Wikidata Analytics Core Codebase Maintenance
GoranSMilovanovic added a subtask: T297354: Link Cognate Dashboard from Wikidata Analytics page. TASK DETAIL https://phabricator.wikimedia.org/T283568 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Manuel, Lydia_Pintscher, WMDE-leszek, GoranSMilovanovic, Aklapper, 786, Suran38, Biggs657, Invadibot, Lalamarie69, maantietaja, Juan90264, Alter-paule, Beast1978, Un1tY, Akuckartz, Hook696, Kent7301, joker88john, CucyNoiD, Nandana, Gaboe420, Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, QZanden, LawExplorer, Lewizho99, Maathavan, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T297354: Link Cognate Dashboard from Wikidata Analytics page
GoranSMilovanovic added a parent task: T283568: [Epic] Wikidata Analytics Core Codebase Maintenance. TASK DETAIL https://phabricator.wikimedia.org/T297354 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Manuel, Aklapper, Lydia_Pintscher, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T297354: Link Cognate Dashboard from Wikidata Analytics page
GoranSMilovanovic claimed this task. GoranSMilovanovic added a project: User-GoranSMilovanovic. TASK DETAIL https://phabricator.wikimedia.org/T297354 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Manuel, Aklapper, Lydia_Pintscher, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T297285: Ensure documentation of Qurator Curious Facts code and experiences
GoranSMilovanovic claimed this task. GoranSMilovanovic added a project: User-GoranSMilovanovic. TASK DETAIL https://phabricator.wikimedia.org/T297285 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T297284: Ensure documentation of essential analytics and editor tools
GoranSMilovanovic claimed this task. GoranSMilovanovic added a project: User-GoranSMilovanovic. TASK DETAIL https://phabricator.wikimedia.org/T297284 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Lydia_Pintscher, GoranSMilovanovic, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T292862: Create an automatically updated dashboard out of the Wikidata Quality Report
GoranSMilovanovic claimed this task. GoranSMilovanovic added a project: User-GoranSMilovanovic. TASK DETAIL https://phabricator.wikimedia.org/T292862 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Lydia_Pintscher, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T283568: [Epic] Wikidata Analytics Core Codebase Maintenance
GoranSMilovanovic added a subtask: T297285: Ensure documentation of Qurator Curious Facts code and experiences. TASK DETAIL https://phabricator.wikimedia.org/T283568 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Manuel, Lydia_Pintscher, WMDE-leszek, GoranSMilovanovic, Aklapper, 786, Suran38, Biggs657, Invadibot, Lalamarie69, maantietaja, Juan90264, Alter-paule, Beast1978, Un1tY, Akuckartz, Hook696, Kent7301, joker88john, CucyNoiD, Nandana, Gaboe420, Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, QZanden, LawExplorer, Lewizho99, Maathavan, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T297285: Ensure documentation of Qurator Curious Facts code and experiences
GoranSMilovanovic added a parent task: T283568: [Epic] Wikidata Analytics Core Codebase Maintenance. TASK DETAIL https://phabricator.wikimedia.org/T297285 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T283568: [Epic] Wikidata Analytics Core Codebase Maintenance
GoranSMilovanovic added a subtask: T297225: [Current Events] filter out some expected/unneeded Items. TASK DETAIL https://phabricator.wikimedia.org/T283568 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Manuel, Lydia_Pintscher, WMDE-leszek, GoranSMilovanovic, Aklapper, 786, Suran38, Biggs657, Invadibot, Lalamarie69, maantietaja, Juan90264, Alter-paule, Beast1978, Un1tY, Akuckartz, Hook696, Kent7301, joker88john, CucyNoiD, Nandana, Gaboe420, Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, QZanden, LawExplorer, Lewizho99, Maathavan, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T297225: [Current Events] filter out some expected/unneeded Items
GoranSMilovanovic added a parent task: T283568: [Epic] Wikidata Analytics Core Codebase Maintenance. TASK DETAIL https://phabricator.wikimedia.org/T297225 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: GoranSMilovanovic, Manuel, Aklapper, Lydia_Pintscher, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T283568: [Epic] Wikidata Analytics Core Codebase Maintenance
GoranSMilovanovic added a subtask: T297284: Ensure documentation of essential analytics and editor tools. TASK DETAIL https://phabricator.wikimedia.org/T283568 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Manuel, Lydia_Pintscher, WMDE-leszek, GoranSMilovanovic, Aklapper, 786, Suran38, Biggs657, Invadibot, Lalamarie69, maantietaja, Juan90264, Alter-paule, Beast1978, Un1tY, Akuckartz, Hook696, Kent7301, joker88john, CucyNoiD, Nandana, Gaboe420, Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, QZanden, LawExplorer, Lewizho99, Maathavan, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T297284: Ensure documentation of essential analytics and editor tools
GoranSMilovanovic added a parent task: T283568: [Epic] Wikidata Analytics Core Codebase Maintenance. TASK DETAIL https://phabricator.wikimedia.org/T297284 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Lydia_Pintscher, GoranSMilovanovic, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T283568: [Epic] Wikidata Analytics Core Codebase Maintenance
GoranSMilovanovic added a subtask: T292862: Create an automatically updated dashboard out of the Wikidata Quality Report. TASK DETAIL https://phabricator.wikimedia.org/T283568 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Manuel, Lydia_Pintscher, WMDE-leszek, GoranSMilovanovic, Aklapper, 786, Suran38, Biggs657, Invadibot, Lalamarie69, maantietaja, Juan90264, Alter-paule, Beast1978, Un1tY, Akuckartz, Hook696, Kent7301, joker88john, CucyNoiD, Nandana, Gaboe420, Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, QZanden, LawExplorer, Lewizho99, Maathavan, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T292862: Create an automatically updated dashboard out of the Wikidata Quality Report
GoranSMilovanovic added a parent task: T283568: [Epic] Wikidata Analytics Core Codebase Maintenance. TASK DETAIL https://phabricator.wikimedia.org/T292862 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Lydia_Pintscher, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T296926: Change licensing of Wikidata Analytics repo to BSD 3-Clause
GoranSMilovanovic added a comment. @Manuel > Sure: There used to be multiple files and with this change, there is now only one. The link in the CurrentEvents footer still says GPL and points to the old file and therefore 404s. (Plus maybe there are other links that need updates as well?) I see. Thanks for catching this -> To Do. TASK DETAIL https://phabricator.wikimedia.org/T296926 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Legoktm, WMDE-leszek, Tobi_WMDE_SW, Aklapper, Manuel, 786, Suran38, Biggs657, Invadibot, Lalamarie69, maantietaja, Juan90264, Alter-paule, Beast1978, Un1tY, Akuckartz, Hook696, Kent7301, joker88john, CucyNoiD, Nandana, Gaboe420, Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, GoranSMilovanovic, QZanden, LawExplorer, Lewizho99, Maathavan, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Ricordisamoa, Slaporte, Mbch331, Jay8g ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T296926: Change licensing of Wikidata Analytics repo to BSD 3-Clause
GoranSMilovanovic added a comment. @Manuel > One more thing: Could you please update the links to the new URL (e.g. CurrentEvents license link))? Please clarify. There is one LICENSE file for the whole repo. TASK DETAIL https://phabricator.wikimedia.org/T296926 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Legoktm, WMDE-leszek, Tobi_WMDE_SW, Aklapper, Manuel, 786, Suran38, Biggs657, Invadibot, Lalamarie69, maantietaja, Juan90264, Alter-paule, Beast1978, Un1tY, Akuckartz, Hook696, Kent7301, joker88john, CucyNoiD, Nandana, Gaboe420, Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, GoranSMilovanovic, QZanden, LawExplorer, Lewizho99, Maathavan, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Ricordisamoa, Slaporte, Mbch331, Jay8g ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T296926: Change licensing of Wikidata Analytics repo to BSD 3-Clause
GoranSMilovanovic added a comment. @Manuel Wikidata Analytics <https://github.com/wikimedia/analytics-wmde-WD-WikidataAnalytics> is now BSD 3-Clause licensed <https://github.com/wikimedia/analytics-wmde-WD-WikidataAnalytics/blob/master/LICENSE>. TASK DETAIL https://phabricator.wikimedia.org/T296926 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Legoktm, WMDE-leszek, Tobi_WMDE_SW, Aklapper, Manuel, 786, Suran38, Biggs657, Invadibot, Lalamarie69, maantietaja, Juan90264, Alter-paule, Beast1978, Un1tY, Akuckartz, Hook696, Kent7301, joker88john, CucyNoiD, Nandana, Gaboe420, Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, GoranSMilovanovic, QZanden, LawExplorer, Lewizho99, Maathavan, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Ricordisamoa, Slaporte, Mbch331, Jay8g ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T297225: [Current Events] filter out some expected/unneeded Items
GoranSMilovanovic claimed this task. GoranSMilovanovic added a project: User-GoranSMilovanovic. GoranSMilovanovic added a comment. @Lydia_Pintscher > Example: > The following Items should not show up in the dashboard: > Earth (Q16943273) <- guided tour Item > Wikidata Sandbox (Q4115189) <- playground > Earth (Q17339402) <- guided tour Item **Q.** Is there a rule, a pattern, a schema, anything regular in the items that need to be filtered out, or we are talking only about this three items? TASK DETAIL https://phabricator.wikimedia.org/T297225 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: GoranSMilovanovic, Manuel, Aklapper, Lydia_Pintscher, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T283574: Wikidata Analytics Data Products: DockerHub/Deployment
GoranSMilovanovic added a comment. @WMDE-leszek `docker-compose build` should do (you will find both `docker-compose.yaml` and `Dockerfile` in each directory). **However** I suggest to wait until I merge all the planned changes there (it will happen until the end of December 2021) in the case you want to build and upload the images yourself. I could ping you here when everything is ready if you agree. TASK DETAIL https://phabricator.wikimedia.org/T283574 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Tobi_WMDE_SW, Aklapper, WMDE-leszek, Lydia_Pintscher, GoranSMilovanovic, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T283574: Wikidata Analytics Data Products: DockerHub/Deployment
GoranSMilovanovic added a subscriber: Tobi_WMDE_SW. GoranSMilovanovic added a comment. @WMDE-leszek @Tobi_WMDE_SW Please: do we have any feedback here, or do we want to resolve this ticket? Thanks. TASK DETAIL https://phabricator.wikimedia.org/T283574 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Tobi_WMDE_SW, Aklapper, WMDE-leszek, Lydia_Pintscher, GoranSMilovanovic, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T296926: Change licensing of Wikidata Analytics repo to BSD 3-Clause
GoranSMilovanovic added a comment. @Manuel Thank you for the clarification! > It also excludes the right to imply that the copyright holder (again, "Wikimedia Deutschland" in this case) or the people involved in creating the original work (e.g. the individual developers) are endorsing or promoting the derivative work. I got it now. Or at least I think so. > My understanding is that you need to mention Wikimedia Deutschland and the license etc. (and that you can of course mention that you are the original author) but you must not use the Wikimedia / Wikidata brand's for advertisement etc. without some sort of contract that allows it. Which is pretty much common sense. Absolutely makes sense. > I hope this helps! It does. Ok - I will be working a lot - as @Tobi_WMDE_SW already knows - to align the Wikidata Analytics codebase so that any other R developer can grasp my code easier. The implementation of the BSD 3-Clause will happen along the way before the end of 2021. I will notify you on the change here. TASK DETAIL https://phabricator.wikimedia.org/T296926 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Legoktm, WMDE-leszek, Tobi_WMDE_SW, Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Ricordisamoa, Slaporte, Mbch331, Jay8g ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T296926: Change licensing of Wikidata Analytics repo to BSD 3-Clause
GoranSMilovanovic added a comment. @Manuel I just mentioned it because the document in relation to WMDE GitHub was referred to in the ticket description, we can change the license anyways I guess. **Q.** As of the following from the BSD 3-Clause <https://opensource.org/licenses/BSD-3-Clause>: > 3. Neither the name of the copyright holder nor the names of its contributors may be used to endorse or promote products derived from this software without specific prior written permission. You might help me understand this better, e.g. 1. I develop a derivative work from Wikidata Analytics <https://github.com/wikimedia/analytics-wmde-WD-WikidataAnalytics> in the future (for example, maintain a slightly modified version of Wikidata Analytics <https://wikidata-analytics.wmcloud.org/app/WikidataAnalytics> on my servers); 2. Whom should I not mention (for example in my derivative repository, or elsewhere) "without specific prior written permission": (a) myself, i.e. Goran Milovanovic PR Data Kolektiv, or (b) Wikimedia Deutschland? TASK DETAIL https://phabricator.wikimedia.org/T296926 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Legoktm, WMDE-leszek, Tobi_WMDE_SW, Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Ricordisamoa, Slaporte, Mbch331, Jay8g ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T296926: Change licensing of Wikidata Analytics repo to BSD 3-Clause
GoranSMilovanovic added a comment. @Manuel **Note.** In relation to > https://docs.google.com/document/d/1ZR5uF7cBUIAmBhkj5AeCkruT7p5fUeJj2qqA-N274pU/edit (internal) The Wikidata Analytics repo is not a WMDE GitHub <https://github.com/wmde> repo. Moreover, I do not think that I maintain any code at WMDE's GitHub at all. When the matter of licensing and the repositories was discussed with @Tobi_WMDE_SW (ages ago) - I remember being advised to use the Wikimedia GitHub via Gerrit, or even maintain the repository personally - Tobi can correct me if I am wrong. However, since 2017 no one certainly asked for the code to live on WMDE's GitHub, neither do I have any access rights there. TASK DETAIL https://phabricator.wikimedia.org/T296926 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Legoktm, WMDE-leszek, Tobi_WMDE_SW, Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Ricordisamoa, Slaporte, Mbch331, Jay8g ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T296926: Change licensing to BSD 3-Clause
GoranSMilovanovic added a comment. @Legoktm Bug? The repo is: https://github.com/wikimedia/analytics-wmde-WD-WikidataAnalytics The system is: https://wikidata-analytics.wmcloud.org TASK DETAIL https://phabricator.wikimedia.org/T296926 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Legoktm, WMDE-leszek, Tobi_WMDE_SW, Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Ricordisamoa, Slaporte, Mbch331, Jay8g ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard
GoranSMilovanovic updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T294983 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Tobi_WMDE_SW, Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard
GoranSMilovanovic added a comment. @Manuel We are running it in production: https://wikidata-analytics.wmcloud.org/app/CurrentEvents TASK DETAIL https://phabricator.wikimedia.org/T294983 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Tobi_WMDE_SW, Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard
GoranSMilovanovic added a comment. @Manuel Building the Docker image for Current Events is taking some time on macOS (this is due to my inexperience - I should have used my Debian server instead). I will ping back here as soon as the image is rendered and deployed to CloudVPS. Everything is ready it will just take some time until the system goes live. TASK DETAIL https://phabricator.wikimedia.org/T294983 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Tobi_WMDE_SW, Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard
GoranSMilovanovic added a comment. @Manuel We already have a concise README file created yesterday. I am building the image now and deploying the Current Events in production immediately. I will ping back here when the system is online. TASK DETAIL https://phabricator.wikimedia.org/T294983 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Tobi_WMDE_SW, Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T296387: Some tables show wrong or incomplete information on Current Events dashboard
GoranSMilovanovic added a comment. @Manuel Following our 1:1 - the criterion to keep the top 100 items per table is in force now in the test environment <http://datakolektiv.org/app/QURATOR_CurrentEvents>; - the table loading times have significantly improved; - I am putting the system in production now. TASK DETAIL https://phabricator.wikimedia.org/T296387 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Tobi_WMDE_SW, GoranSMilovanovic, Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T296387: Some tables show wrong or incomplete information on Current Events dashboard
GoranSMilovanovic added a comment. @Manuel > Filters: > min 2 editors > max 100 lines per table from top Please be reminded that we already keep items with `min 2 editors`, and if we go for `max 100 lines per table` then we will end up filtering out items that indeed had `min 2 editors` but do not enter the table because of their row number in it merely. I remember when I started working on this dashboard and how I realised that the problem of what items to present deemed more complicated than what a pure intuition would suggest! Would you have some time for a very concise 1:1 on this, perhaps in the following two hours or so? Thank you. We can figure out the criteria we just need to be aware fully of the consequences of each (non-ideal) option that we have. TASK DETAIL https://phabricator.wikimedia.org/T296387 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Tobi_WMDE_SW, GoranSMilovanovic, Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T296387: Some tables show wrong or incomplete information on Current Events dashboard
GoranSMilovanovic added a comment. @Manuel @Tobi_WMDE_SW To clarify a bit: - if we keep the top 100 items per number of editors, then the top 100 in the 72h dataset might encompass all items with at least, say, 7 editors, while in the 6h dataset at the same time we could have the situation that no items have even reached 7 editors yet; - that would contradict the idea of: `... all 6h should be included in 24h, all 24h should be included in 48h, and all 48h should be included in 72h...`. We need to understand **exactly** what filtering do we want to implement. Let me know of your thoughts and I will implement whatever filtering you find to be the most suitable for this system. TASK DETAIL https://phabricator.wikimedia.org/T296387 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Tobi_WMDE_SW, GoranSMilovanovic, Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard
GoranSMilovanovic added a subscriber: Tobi_WMDE_SW. GoranSMilovanovic added a comment. @Manuel @Tobi_WMDE_SW > Create a short Current Events README **Done.** N.B. I think we would need to include the description of the filtering criteria used on the dashboard in the README file once you decide upon T296387 <https://phabricator.wikimedia.org/T296387>: see my T296387#7544835 <https://phabricator.wikimedia.org/T296387#7544835>. As I have mentioned previously, > The browser title reads “Current Events Dashboard” (it currently shows "Qurator...") can be solved only in the deployment phase, since the App title is controlled by the Shiny Proxy config; so this last opened request will be resolved then. TASK DETAIL https://phabricator.wikimedia.org/T294983 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Tobi_WMDE_SW, Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard
GoranSMilovanovic added a comment. > Remove Constraint Violation Checker for now. **Done**: please check in the test environment <http://datakolektiv.org/app/QURATOR_CurrentEvents>. TASK DETAIL https://phabricator.wikimedia.org/T294983 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard
GoranSMilovanovic updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T294983 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T296387: Some tables show wrong or incomplete information on Current Events dashboard
GoranSMilovanovic added a subscriber: Tobi_WMDE_SW. GoranSMilovanovic added a comment. @Manuel @Tobi_WMDE_SW > The code for label lookup can live in the client JS or on the server. Who in the WMDE is our JS specialist so that I can get in touch with them? I don't do JS as you know, I am Data Scientist. > Loading times are a nightmare now.. can you test to cut off each table after the top 100 entries? But that would contradict yours: > Logic dictates that all 6h should be included in 24h, all 24h should be included in 48h, and all 48h should be included in 72h. This is still not the case, so something *must* be wrong here. from the ticket description. Namely, if you keep top 100 entities, well... Then the entities from the 72h dataset - to take an example only - would not necessarily encompass the entities in the 6h dataset... I think the best way to proceed would be for you to formulate **exactly** the sort criteria that would fit our users' needs the best. To clarify: - in each of the following datasets: 6h, 24h, 48h, 72h, we have - the number of editors who edited a particular item - and the number of edits for those items; - we already keep all items that were edited by two or more editors. Please: exactly what filter/sorting do you have in mind? Besides this open question, everything else is ready for production. TASK DETAIL https://phabricator.wikimedia.org/T296387 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Tobi_WMDE_SW, GoranSMilovanovic, Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T296926: Change licensing to BSD 3-Clause
GoranSMilovanovic claimed this task. GoranSMilovanovic added a project: User-GoranSMilovanovic. TASK DETAIL https://phabricator.wikimedia.org/T296926 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: WMDE-leszek, Tobi_WMDE_SW, Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Ricordisamoa, Slaporte, Mbch331, Jay8g, Legoktm ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T296926: Change licensing to BSD 3-Clause
GoranSMilovanovic added a comment. @Manuel > We want BSD 3-Clause ideally. To do. Thanks. TASK DETAIL https://phabricator.wikimedia.org/T296926 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: WMDE-leszek, Tobi_WMDE_SW, Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Ricordisamoa, Slaporte, Mbch331, Jay8g, Legoktm ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T296926: Clarify licensing
GoranSMilovanovic added a subscriber: WMDE-leszek. GoranSMilovanovic added a comment. @WMDE-leszek I don't think we really need lawyers to decide upon our licences. However, I really would to hear from @Manuel and others as well. Back then when I've started doing analytics for Wikidata GPLv2 sounded good to me. If we need to change this - let me know and I will change the licenses. Thanks. TASK DETAIL https://phabricator.wikimedia.org/T296926 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Manuel, GoranSMilovanovic Cc: WMDE-leszek, Tobi_WMDE_SW, Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T296926: Clarify licensing
GoranSMilovanovic added a subscriber: Tobi_WMDE_SW. GoranSMilovanovic added a comment. @Manuel > Based on input from iRights.Law: If you're unsure which license to pick, normally choose Modified-BSD(called ‘BSD 3-Clause "New" or "Revised" License’ in the GitHub UI) unless it’s a Mediawiki extension then pick GPL 2.0. When I started my contract with WMDE in 2017 the license question was discussed with the EMs and I was told to use any license that I find appropriate. I've found GPL 2.0 appropriate back then @Tobi_WMDE_SW If you suggest that this needs to be changed across the whole Wikidata Analytics Codebase, please let me know as soon as possible. Thanks. TASK DETAIL https://phabricator.wikimedia.org/T296926 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Manuel, GoranSMilovanovic Cc: Tobi_WMDE_SW, Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard
GoranSMilovanovic added a comment. > I need to fix the Current Events README too > What would you suggest? A quick overview should do in this case, right? Exactly. I will take care of it don't worry; I've just mentioned that as a sort of reminder. TASK DETAIL https://phabricator.wikimedia.org/T294983 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T296387: Some tables show wrong or incomplete information on Current Events dashboard
GoranSMilovanovic added a comment. @Manuel > Loading times are a nightmare now.. can you test to cut off each table after the top 100 entries? **To Do** > This would work for now, but the better alternative would be to implement the label lookup in the backend. Please elaborate on this idea, TASK DETAIL https://phabricator.wikimedia.org/T296387 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: GoranSMilovanovic, Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T296387: Some tables show wrong or incomplete information on Current Events dashboard
GoranSMilovanovic added a comment. @Manuel To clarify and help you follow the developments here: I think the whole problem was related to filtering out items based on their revision frequencies ranks, and not absolute revision frequencies. The frequency revision ranks could have differed across the 72h, 48h, 24h, and 6h tables. Now we need a new criterion to filter out items (either by number of editors who work on them or by the absolute number of revisions they receive) in order to avoid serving too long item lists under Current Events. TASK DETAIL https://phabricator.wikimedia.org/T296387 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: GoranSMilovanovic, Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard
GoranSMilovanovic updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T294983 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard
GoranSMilovanovic added a comment. @Manuel > include “user feedback” for empty tables **Done.** TASK DETAIL https://phabricator.wikimedia.org/T294983 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T296387: Some tables show wrong or incomplete information on Current Events dashboard
GoranSMilovanovic added a comment. @Manuel This is possibly fixed now in the test environment <http://datakolektiv.org/app/QURATOR_CurrentEvents>, but we need another decision now: - in order to fix this obvious and annoying bug I removed **all filtering** of items that have received edits by two or more editors recently; - in the test environment you will see that the system now again produces large tables (i.e. all items that have received edits by two or more editors recently are found there); - thus, we need a new criterion on what items to filter our (say: anything with less than N edits is filtered out, or something similar). Please advise. TASK DETAIL https://phabricator.wikimedia.org/T296387 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: GoranSMilovanovic, Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard
GoranSMilovanovic added a comment. @Manuel Reminder on ToDos here: > The browser title reads “Current Events Dashboard” (it currently shows "Qurator...") This will be fixed with the deployment in production; ShinyProxy server settings determine the title of the app and the URL from where it is served. > Show 25 entries should move to the bottom (if possible within the scope of the tools used) I will do my best but thus far I cannot find the way to move it to the bottom of the table. > include “user feedback” for empty tables To be implemented very soon. TASK DETAIL https://phabricator.wikimedia.org/T294983 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard
GoranSMilovanovic updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T294983 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard
GoranSMilovanovic added a comment.
@Manuel
> Footer in the simple ("Made by the Wikimedia development team" etc) or
ideally the new and advanced layout
This is implemented in the test environment
<http://datakolektiv.org/app/QURATOR_CurrentEvents> now, with the following
constraints:
- I could not change the background colour of the footer to match the one
used in the mock-up and examples (note: of course, only pure Shiny tech was
used to build the footer);
- I could not find the Constraint Violation Checker served via any UI online,
so I have linked the command tool's GitHub repo
<https://github.com/wmde/wikidata-constraints-violation-checker> instead;
- finally, all Wikidata Analytics products built since 2017 use GPLv2, so I
have used that license in place of BSD 3-Clause License.
I need to fix the Current Events README too (a generic README
<https://github.com/wikimedia/analytics-wmde-WD-WikidataAnalytics/blob/master/Qurator_CurrentEvents/README.Rmd>
from the {golem} pipeline for Shiny production is still in the repo).
TASK DETAIL
https://phabricator.wikimedia.org/T294983
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: GoranSMilovanovic
Cc: Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86,
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS,
Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard
GoranSMilovanovic updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T294983 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T296387: Some tables show wrong or incomplete information on Current Events dashboard
GoranSMilovanovic added a comment. @Manuel - Found one possible (and most probable) cause of the anomaly; - fixed; - restarted the update engine in the test environment <http://datakolektiv.org/app_direct/QURATOR_CurrentEvents/>; - monitoring. TASK DETAIL https://phabricator.wikimedia.org/T296387 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: GoranSMilovanovic, Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T296387: Some tables show wrong or incomplete information on Current Events dashboard
GoranSMilovanovic added a comment. The anomaly **is now observed** in the test environment <http://datakolektiv.org/app/QURATOR_CurrentEvents>: complete code evaluation of the dashboard's update engine will take place following the implementation of changes requested in T294983 <https://phabricator.wikimedia.org/T294983>. TASK DETAIL https://phabricator.wikimedia.org/T296387 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: GoranSMilovanovic, Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T296387: Some tables show wrong or incomplete information on Current Events dashboard
GoranSMilovanovic added a comment. > Logic dictates that all 6h should be included in 24h, all 24h should be included in 48h, and all 48h should be included in 72h. This is still not the case, so something *must* be wrong here. This anomaly is not present in the **restarted** test environment <http://datakolektiv.org/app/QURATOR_CurrentEvents> (yet). Still monitoring; complete code evaluation of the dashboard's update engine will take place following the implementation of changes requested in T294983 <https://phabricator.wikimedia.org/T294983>. TASK DETAIL https://phabricator.wikimedia.org/T296387 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: GoranSMilovanovic, Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard
GoranSMilovanovic added a comment. > No "Frequently revised items in the previous 72 hours" shown **Fixed** in the test environment <http://datakolektiv.org/app/QURATOR_CurrentEvents>. TASK DETAIL https://phabricator.wikimedia.org/T294983 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard
GoranSMilovanovic added a comment. @Manuel T294983#7529722 <https://phabricator.wikimedia.org/T294983#7529722> > change the order of the tables from 6h-72h to 72h-6h (so that the first table shown will always be filled) **Fixed** in the test environment <http://datakolektiv.org/app/QURATOR_CurrentEvents> (I can also see you have already check marked it). TASK DETAIL https://phabricator.wikimedia.org/T294983 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard
GoranSMilovanovic added a comment. @Manuel Please let's follow the changes in the test environment <http://datakolektiv.org/app/QURATOR_CurrentEvents> first: > As we are sorting for Editors first and Revisions second, they should also appear in that order (as seen in the mockup). **Fixed.** > "Latest update" should move to the bottom **Fixed.** > If only text *or* a picture work for the heading let's go for just text then. **Done.** > no "Updated every minute. Previous 72 hours: As the data on recent changes accumulate we provide summary statistics on edits made in the previous seventy-two (72) hours (or three days) and update the table below every ten minutes. You can instantly update the dashboard by reloading it." should be shown **Fixed.** > Show 25 entries should move to the bottom I still need to see if this is possible at all in datatable (R datatable docs <https://rstudio.github.io/DT/> | datatable docs <https://datatables.net/>) > The browser title still shows "Qurator..." This needs to happen only when we decide to deploy in production. > There is no "Made by the Wikimedia development team" etc footer In the meantime we have a new format for footers that we should try to adopt if we can. **To Do.** Please let me know if there is a selection of links that we want to include in the footer of this Dashboard. Thanks. **NEW from our 1:1 today** > including “user feedback” for empty tables **To do.** > Manuel: 1st prio is the bug about incorrect information You mean the Some tables show wrong or incomplete information on Current Events dashboard <https://phabricator.wikimedia.org/T296387> ticket: of course. ASAP, I am monitoring the situation in the (restarted) test environment <http://datakolektiv.org/app/QURATOR_CurrentEvents>, and I will fix that as soon as I figure exactly what is causing the problem. TASK DETAIL https://phabricator.wikimedia.org/T294983 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T296387: Some tables show wrong or incomplete information on Current Events dashboard
GoranSMilovanovic added a comment. > Logic dictates that all 6h should be included in 24h, all 24h should be included in 48h, and all 48h should be included in 72h. This is still not the case, so something *must* be wrong here. I have restarted the update engine on the test server <http://datakolektiv.org/app/QURATOR_CurrentEvents> and cleared all data. I will be monitoring the accumulation of data across the specified (6h, 24h, 48h, and 72h) intervals to find out why is this happening. TASK DETAIL https://phabricator.wikimedia.org/T296387 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: GoranSMilovanovic, Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard
GoranSMilovanovic added a comment. @Manuel Re: T294983#7509866 <https://phabricator.wikimedia.org/T294983#7509866> > The dashboard is currently sorting out its findings by number of revisions - bug fix! Actually, it is not sorting by number of revisions, I have just checked everything in that respect. It might be the case that one of us accidentally sorted some dashboard table by number of revisions in our 1:1. TASK DETAIL https://phabricator.wikimedia.org/T294983 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T294985: Show up-to-date labels in Current Events Dashboard
GoranSMilovanovic added a comment. @Manuel > In addition to that: Let's please also filter out all Items that were edited by only 1 editor. This should significantly improve the delay! Implemented, deployed. TASK DETAIL https://phabricator.wikimedia.org/T294985 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Manuel, 786, Suran38, Biggs657, Invadibot, Lalamarie69, maantietaja, Juan90264, Alter-paule, Beast1978, Un1tY, Akuckartz, Hook696, Kent7301, joker88john, CucyNoiD, Nandana, Gaboe420, Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, GoranSMilovanovic, QZanden, LawExplorer, Lewizho99, Maathavan, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard
GoranSMilovanovic added a comment. @Manuel @GoranSMilovanovic > Can you please check whether the tabs are named correctly? There seems to be a mix-up of some sort. The dashboard is currently sorting out its findings by number of revisions - bug fix! TASK DETAIL https://phabricator.wikimedia.org/T294983 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T294985: Show up-to-date labels in Current Events Dashboard
GoranSMilovanovic added a comment. @Manuel > There is a noticeable delay now in my setup. How long is the delay, approximately? > In addition to that: Let's please also filter out all Items that were edited by only 1 editor. This should significantly improve the delay! Got it. To be implemented soon. TASK DETAIL https://phabricator.wikimedia.org/T294985 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard
GoranSMilovanovic added a comment. > Name and title read “Wikidata Current Events Dashboard” (text not picture, if at all possible) Not possible. @Manuel: I am not a web designer. In serving dashboards, I work with limited possibilities offered by the RStudio Shiny framework, which is essentially an abstraction over Bootstrap. If you think that in the future we will need more design, UX/UI related tweaks and similar, we need to consider hiring a web-designer/developer or introducing someone who is in web-design/development already in WMDE. > Can you please check whether the tabs are named correctly? There seems to be a mix-up of some sort. Hm. You might be right - I need to check this carefully. TASK DETAIL https://phabricator.wikimedia.org/T294983 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T294984: Filter noise out of Current Events
GoranSMilovanovic added a comment. @Manuel - we are filtering all bot revisions now; - the transition is seamless: the old data (including bot edits) will remain on the dashboard until they are washed out by the new data in the following days. TASK DETAIL https://phabricator.wikimedia.org/T294984 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Manuel, 786, Suran38, Biggs657, Invadibot, Lalamarie69, maantietaja, Juan90264, Alter-paule, Beast1978, Un1tY, Akuckartz, Hook696, Kent7301, joker88john, CucyNoiD, Nandana, Gaboe420, Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, GoranSMilovanovic, QZanden, LawExplorer, Lewizho99, Maathavan, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
