[Wikidata-bugs] [Maniphest] T307763: Wikidata usage and coverage dashboard only shows partial data

2022-05-08 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Lydia_Pintscher @Tobi_WMDE_SW @Manuel @ItamarWMDE I have just checked the dashboard <https://wikidata-analytics.wmcloud.org/app/WikidataAnalytics> and it shows the data for all projects as it did before. Similarly to what recently ha

[Wikidata-bugs] [Maniphest] T307763: Wikidata usage and coverage dashboard only shows partial data

2022-05-06 Thread GoranSMilovanovic
GoranSMilovanovic added subscribers: ItamarWMDE, Manuel, Tobi_WMDE_SW, GoranSMilovanovic. GoranSMilovanovic added a comment. @Lydia_Pintscher @Tobi_WMDE_SW @Manuel This has probably something to do with the ETL module of the dashboard. I will inspect the issue together

[Wikidata-bugs] [Maniphest] T297303: Re-productionize the Wiktionary Cognate Dashboard

2022-02-09 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. The current URL is > https://wiktionary-analytics.wmcloud.org/Wiktionary_CognateDashboard/ In case we keep a separate CloudVPS to run this dashboard it would be: > https://wiktionary-analytics.wmcloud.org/app/Wiktionary_CognateDas

[Wikidata-bugs] [Maniphest] T297303: Re-productionize the Wiktionary Cognate Dashboard

2022-02-09 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. Wiktionary Cognate Dashboard is fully re-productionized now, test server: http://datakolektiv.org/app_direct/WiktionaryCognate/ - Deployment: deployment to CloudVPS will take places as soon as - the changes in the dashboard URL are announced

[Wikidata-bugs] [Maniphest] T297303: Re-productionize the Wiktionary Cognate Dashboard

2022-02-08 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. Wiktionary Cognate Dashboard is being test under the new production approach now on the test server <http://datakolektiv.org/app_direct/WikidataAnalytics/>. - the dashboard update engine is containerized separately (the same approach

[Wikidata-bugs] [Maniphest] T299571: Input on how we could integrate data analytics in our dev team

2022-01-30 Thread GoranSMilovanovic
GoranSMilovanovic added a subscriber: Tobi_WMDE_SW. GoranSMilovanovic added a comment. @Manuel @Tobi_WMDE_SW Here <https://docs.google.com/document/d/1lSvLkfdcHTReQsFs2WNmjWm1INF5bGKHJE_wm82MOFs/edit> is how I think about what WMDE can do in order to address the questions

[Wikidata-bugs] [Maniphest] T297485: Implement regular data backups for our R Shiny dashboards for Wikidata

2022-01-30 Thread GoranSMilovanovic
GoranSMilovanovic added subscribers: JAllemandou, Milimetric, Tobi_WMDE_SW. GoranSMilovanovic added a comment. @Tobi_WMDE_SW #analytics <https://phabricator.wikimedia.org/tag/analytics/> @JAllemandou @Milimetric Our Wikidata Analytics PM @Manuel would like to get in touch with t

[Wikidata-bugs] [Maniphest] T297485: Implement regular data backups for our R Shiny dashboards for Wikidata

2022-01-26 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel The WMF Analytics-Engineering team. TASK DETAIL https://phabricator.wikimedia.org/T297485 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Manuel, Invadibot, maantietaja

[Wikidata-bugs] [Maniphest] T297485: Implement regular data backups for our R Shiny dashboards for Wikidata

2022-01-25 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel As long as my R production scripts on the Analytics Clients <https://wikitech.wikimedia.org/wiki/Analytics/Systems/Clients> are running the data that feed our analytics will be regularly updated. The data are copied to the public dir

[Wikidata-bugs] [Maniphest] T297225: [Current Events] filter out some expected/unneeded Items

2022-01-25 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel - new items out filter out added; - a `CSV` download button is now present at the bottom of each table; - check out the Dashboard <https://wikidata-analytics.wmcloud.org/app/CurrentEvents>. TASK DETAIL https://phabricator.wikimed

[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard

2022-01-25 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel Fixed, check out the Dashboard <https://wikidata-analytics.wmcloud.org/app/CurrentEvents>. TASK DETAIL https://phabricator.wikimedia.org/T294983 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailprefe

[Wikidata-bugs] [Maniphest] T297225: [Current Events] filter out some expected/unneeded Items

2022-01-24 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel Great, thanks! TASK DETAIL https://phabricator.wikimedia.org/T297225 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: GoranSMilovanovic, Manuel, Aklapper, Lydia_Pintscher, Invadibot

[Wikidata-bugs] [Maniphest] T297225: [Current Events] filter out some expected/unneeded Items

2022-01-23 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel Could you please provide a `.csv` file with a list of all items that need to be filtered our? Thanks. TASK DETAIL https://phabricator.wikimedia.org/T297225 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences

[Wikidata-bugs] [Maniphest] T297305: Ensure preliminary research data sets are accessible

2022-01-23 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel Here you go: Google Drive spreadsheet with research datasets. <https://docs.google.com/spreadsheets/d/13-r6RoIl09H5JXjNksqlqNLOP4mYHyqPYBSaOjuU74A/edit?pli=1#gid=0> TASK DETAIL https://phabricator.wikimedia.org/T297305 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T292862: Create an automatically updated dashboard out of the Wikidata Quality Report

2022-01-19 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. Nope. There are several timestamps and you are looking only at the report timestamp which is indeed update daily because the report automatically re-renders itself every day. Take a look at the text of the report, the very first few paragraphs, and you

[Wikidata-bugs] [Maniphest] T297503: Create knowledge-transfer document about the WMDE analytics infrastructure

2022-01-19 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel The document is useful, I agree, but trust me on this: it will be more useful to our new Data Analyst to go through all the steps in that document with me 1:1. TASK DETAIL https://phabricator.wikimedia.org/T297503 EMAIL PREFERENCES https

[Wikidata-bugs] [Maniphest] T295396: Redirect deprecated Wikidata Analytics URLs to the current URLs

2022-01-17 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @noarave @Manuel @Addshore I would have already added new members but it turns out that I am not authorised to do so in Horizon. TASK DETAIL https://phabricator.wikimedia.org/T295396 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings

[Wikidata-bugs] [Maniphest] T297503: Create knowledge-transfer document about the WMDE analytics infrastructure

2022-01-10 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel Here it is: Wikidata Knowledge Transfer <https://docs.google.com/document/d/1bGV5yHV9AKk2nblIo3AY0LBU3nHC54axZTqP16PsM34/edit>. Our new Data Scientist would also have to take a look at my 2017 Onboarding Document <https://docs.g

[Wikidata-bugs] [Maniphest] T297485: Implement regular data backups for our R Shiny dashboards for Wikidata

2021-12-22 Thread GoranSMilovanovic
GoranSMilovanovic claimed this task. GoranSMilovanovic added a project: User-GoranSMilovanovic. TASK DETAIL https://phabricator.wikimedia.org/T297485 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Manuel, Invadibot

[Wikidata-bugs] [Maniphest] T297303: Re-productionize the Wiktionary Cognate Dashboard

2021-12-22 Thread GoranSMilovanovic
GoranSMilovanovic claimed this task. GoranSMilovanovic added a project: User-GoranSMilovanovic. TASK DETAIL https://phabricator.wikimedia.org/T297303 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Manuel, Aklapper, Invadibot

[Wikidata-bugs] [Maniphest] T283568: [Epic] Wikidata Analytics Core Codebase Maintenance

2021-12-21 Thread GoranSMilovanovic
GoranSMilovanovic added a subtask: T297354: Link Cognate Dashboard from Wikidata Analytics page. TASK DETAIL https://phabricator.wikimedia.org/T283568 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Manuel, Lydia_Pintscher

[Wikidata-bugs] [Maniphest] T297354: Link Cognate Dashboard from Wikidata Analytics page

2021-12-21 Thread GoranSMilovanovic
GoranSMilovanovic added a parent task: T283568: [Epic] Wikidata Analytics Core Codebase Maintenance. TASK DETAIL https://phabricator.wikimedia.org/T297354 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Manuel, Aklapper

[Wikidata-bugs] [Maniphest] T297354: Link Cognate Dashboard from Wikidata Analytics page

2021-12-21 Thread GoranSMilovanovic
GoranSMilovanovic claimed this task. GoranSMilovanovic added a project: User-GoranSMilovanovic. TASK DETAIL https://phabricator.wikimedia.org/T297354 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Manuel, Aklapper

[Wikidata-bugs] [Maniphest] T297285: Ensure documentation of Qurator Curious Facts code and experiences

2021-12-08 Thread GoranSMilovanovic
GoranSMilovanovic claimed this task. GoranSMilovanovic added a project: User-GoranSMilovanovic. TASK DETAIL https://phabricator.wikimedia.org/T297285 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Manuel, Invadibot

[Wikidata-bugs] [Maniphest] T297284: Ensure documentation of essential analytics and editor tools

2021-12-08 Thread GoranSMilovanovic
GoranSMilovanovic claimed this task. GoranSMilovanovic added a project: User-GoranSMilovanovic. TASK DETAIL https://phabricator.wikimedia.org/T297284 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Lydia_Pintscher

[Wikidata-bugs] [Maniphest] T292862: Create an automatically updated dashboard out of the Wikidata Quality Report

2021-12-08 Thread GoranSMilovanovic
GoranSMilovanovic claimed this task. GoranSMilovanovic added a project: User-GoranSMilovanovic. TASK DETAIL https://phabricator.wikimedia.org/T292862 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Lydia_Pintscher

[Wikidata-bugs] [Maniphest] T283568: [Epic] Wikidata Analytics Core Codebase Maintenance

2021-12-08 Thread GoranSMilovanovic
GoranSMilovanovic added a subtask: T297285: Ensure documentation of Qurator Curious Facts code and experiences. TASK DETAIL https://phabricator.wikimedia.org/T283568 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Manuel

[Wikidata-bugs] [Maniphest] T297285: Ensure documentation of Qurator Curious Facts code and experiences

2021-12-08 Thread GoranSMilovanovic
GoranSMilovanovic added a parent task: T283568: [Epic] Wikidata Analytics Core Codebase Maintenance. TASK DETAIL https://phabricator.wikimedia.org/T297285 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Manuel

[Wikidata-bugs] [Maniphest] T283568: [Epic] Wikidata Analytics Core Codebase Maintenance

2021-12-08 Thread GoranSMilovanovic
GoranSMilovanovic added a subtask: T297225: [Current Events] filter out some expected/unneeded Items. TASK DETAIL https://phabricator.wikimedia.org/T283568 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Manuel, Lydia_Pintscher

[Wikidata-bugs] [Maniphest] T297225: [Current Events] filter out some expected/unneeded Items

2021-12-08 Thread GoranSMilovanovic
GoranSMilovanovic added a parent task: T283568: [Epic] Wikidata Analytics Core Codebase Maintenance. TASK DETAIL https://phabricator.wikimedia.org/T297225 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: GoranSMilovanovic

[Wikidata-bugs] [Maniphest] T283568: [Epic] Wikidata Analytics Core Codebase Maintenance

2021-12-08 Thread GoranSMilovanovic
GoranSMilovanovic added a subtask: T297284: Ensure documentation of essential analytics and editor tools. TASK DETAIL https://phabricator.wikimedia.org/T283568 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Manuel

[Wikidata-bugs] [Maniphest] T297284: Ensure documentation of essential analytics and editor tools

2021-12-08 Thread GoranSMilovanovic
GoranSMilovanovic added a parent task: T283568: [Epic] Wikidata Analytics Core Codebase Maintenance. TASK DETAIL https://phabricator.wikimedia.org/T297284 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper

[Wikidata-bugs] [Maniphest] T283568: [Epic] Wikidata Analytics Core Codebase Maintenance

2021-12-08 Thread GoranSMilovanovic
GoranSMilovanovic added a subtask: T292862: Create an automatically updated dashboard out of the Wikidata Quality Report. TASK DETAIL https://phabricator.wikimedia.org/T283568 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc

[Wikidata-bugs] [Maniphest] T292862: Create an automatically updated dashboard out of the Wikidata Quality Report

2021-12-08 Thread GoranSMilovanovic
GoranSMilovanovic added a parent task: T283568: [Epic] Wikidata Analytics Core Codebase Maintenance. TASK DETAIL https://phabricator.wikimedia.org/T292862 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper

[Wikidata-bugs] [Maniphest] T296926: Change licensing of Wikidata Analytics repo to BSD 3-Clause

2021-12-08 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel > Sure: There used to be multiple files and with this change, there is now only one. The link in the CurrentEvents footer still says GPL and points to the old file and therefore 404s. (Plus maybe there are other links that need updates as w

[Wikidata-bugs] [Maniphest] T296926: Change licensing of Wikidata Analytics repo to BSD 3-Clause

2021-12-08 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel > One more thing: Could you please update the links to the new URL (e.g. CurrentEvents license link))? Please clarify. There is one LICENSE file for the whole repo. TASK DETAIL https://phabricator.wikimedia.org/T296926 EMAIL PREFEREN

[Wikidata-bugs] [Maniphest] T296926: Change licensing of Wikidata Analytics repo to BSD 3-Clause

2021-12-08 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel Wikidata Analytics <https://github.com/wikimedia/analytics-wmde-WD-WikidataAnalytics> is now BSD 3-Clause licensed <https://github.com/wikimedia/analytics-wmde-WD-WikidataAnalytics/blob/master/LICENSE>. TASK DE

[Wikidata-bugs] [Maniphest] T297225: [Current Events] filter out some expected/unneeded Items

2021-12-07 Thread GoranSMilovanovic
GoranSMilovanovic claimed this task. GoranSMilovanovic added a project: User-GoranSMilovanovic. GoranSMilovanovic added a comment. @Lydia_Pintscher > Example: > The following Items should not show up in the dashboard: > Earth (Q16943273) <- guided tour Item > W

[Wikidata-bugs] [Maniphest] T283574: Wikidata Analytics Data Products: DockerHub/Deployment

2021-12-06 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @WMDE-leszek `docker-compose build` should do (you will find both `docker-compose.yaml` and `Dockerfile` in each directory). **However** I suggest to wait until I merge all the planned changes there (it will happen until the end of December 2021

[Wikidata-bugs] [Maniphest] T283574: Wikidata Analytics Data Products: DockerHub/Deployment

2021-12-06 Thread GoranSMilovanovic
GoranSMilovanovic added a subscriber: Tobi_WMDE_SW. GoranSMilovanovic added a comment. @WMDE-leszek @Tobi_WMDE_SW Please: do we have any feedback here, or do we want to resolve this ticket? Thanks. TASK DETAIL https://phabricator.wikimedia.org/T283574 EMAIL PREFERENCES https

[Wikidata-bugs] [Maniphest] T296926: Change licensing of Wikidata Analytics repo to BSD 3-Clause

2021-12-05 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel Thank you for the clarification! > It also excludes the right to imply that the copyright holder (again, "Wikimedia Deutschland" in this case) or the people involved in creating the original work (e.g. the individu

[Wikidata-bugs] [Maniphest] T296926: Change licensing of Wikidata Analytics repo to BSD 3-Clause

2021-12-05 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel I just mentioned it because the document in relation to WMDE GitHub was referred to in the ticket description, we can change the license anyways I guess. **Q.** As of the following from the BSD 3-Clause <https://opensource.org/licenses/BS

[Wikidata-bugs] [Maniphest] T296926: Change licensing of Wikidata Analytics repo to BSD 3-Clause

2021-12-05 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel **Note.** In relation to > https://docs.google.com/document/d/1ZR5uF7cBUIAmBhkj5AeCkruT7p5fUeJj2qqA-N274pU/edit (internal) The Wikidata Analytics repo is not a WMDE GitHub <https://github.com/wmde> repo. Moreover, I do

[Wikidata-bugs] [Maniphest] T296926: Change licensing to BSD 3-Clause

2021-12-04 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Legoktm Bug? The repo is: https://github.com/wikimedia/analytics-wmde-WD-WikidataAnalytics The system is: https://wikidata-analytics.wmcloud.org TASK DETAIL https://phabricator.wikimedia.org/T296926 EMAIL PREFERENCES https

[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard

2021-12-03 Thread GoranSMilovanovic
GoranSMilovanovic updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T294983 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Tobi_WMDE_SW, Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana

[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard

2021-12-03 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel We are running it in production: https://wikidata-analytics.wmcloud.org/app/CurrentEvents TASK DETAIL https://phabricator.wikimedia.org/T294983 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences

[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard

2021-12-03 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel Building the Docker image for Current Events is taking some time on macOS (this is due to my inexperience - I should have used my Debian server instead). I will ping back here as soon as the image is rendered and deployed to CloudVPS. Everything

[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard

2021-12-03 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel We already have a concise README file created yesterday. I am building the image now and deploying the Current Events in production immediately. I will ping back here when the system is online. TASK DETAIL https://phabricator.wikimedia.org

[Wikidata-bugs] [Maniphest] T296387: Some tables show wrong or incomplete information on Current Events dashboard

2021-12-03 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel Following our 1:1 - the criterion to keep the top 100 items per table is in force now in the test environment <http://datakolektiv.org/app/QURATOR_CurrentEvents>; - the table loading times have significantly improved; - I am p

[Wikidata-bugs] [Maniphest] T296387: Some tables show wrong or incomplete information on Current Events dashboard

2021-12-03 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel > Filters: > min 2 editors > max 100 lines per table from top Please be reminded that we already keep items with `min 2 editors`, and if we go for `max 100 lines per table` then we will end up filtering out items that indeed h

[Wikidata-bugs] [Maniphest] T296387: Some tables show wrong or incomplete information on Current Events dashboard

2021-12-03 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel @Tobi_WMDE_SW To clarify a bit: - if we keep the top 100 items per number of editors, then the top 100 in the 72h dataset might encompass all items with at least, say, 7 editors, while in the 6h dataset at the same time we could have

[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard

2021-12-02 Thread GoranSMilovanovic
GoranSMilovanovic added a subscriber: Tobi_WMDE_SW. GoranSMilovanovic added a comment. @Manuel @Tobi_WMDE_SW > Create a short Current Events README **Done.** N.B. I think we would need to include the description of the filtering criteria used on the dashboard in the README file o

[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard

2021-12-02 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. > Remove Constraint Violation Checker for now. **Done**: please check in the test environment <http://datakolektiv.org/app/QURATOR_CurrentEvents>. TASK DETAIL https://phabricator.wikimedia.org/T294983 EMAIL PREFERENCE

[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard

2021-12-02 Thread GoranSMilovanovic
GoranSMilovanovic updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T294983 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86

[Wikidata-bugs] [Maniphest] T296387: Some tables show wrong or incomplete information on Current Events dashboard

2021-12-02 Thread GoranSMilovanovic
GoranSMilovanovic added a subscriber: Tobi_WMDE_SW. GoranSMilovanovic added a comment. @Manuel @Tobi_WMDE_SW > The code for label lookup can live in the client JS or on the server. Who in the WMDE is our JS specialist so that I can get in touch with them? I don't do JS as you k

[Wikidata-bugs] [Maniphest] T296926: Change licensing to BSD 3-Clause

2021-12-02 Thread GoranSMilovanovic
GoranSMilovanovic claimed this task. GoranSMilovanovic added a project: User-GoranSMilovanovic. TASK DETAIL https://phabricator.wikimedia.org/T296926 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: WMDE-leszek, Tobi_WMDE_SW

[Wikidata-bugs] [Maniphest] T296926: Change licensing to BSD 3-Clause

2021-12-02 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel > We want BSD 3-Clause ideally. To do. Thanks. TASK DETAIL https://phabricator.wikimedia.org/T296926 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: WMDE-les

[Wikidata-bugs] [Maniphest] T296926: Clarify licensing

2021-12-02 Thread GoranSMilovanovic
GoranSMilovanovic added a subscriber: WMDE-leszek. GoranSMilovanovic added a comment. @WMDE-leszek I don't think we really need lawyers to decide upon our licences. However, I really would to hear from @Manuel and others as well. Back then when I've started doing analytics for Wikidata GPLv2

[Wikidata-bugs] [Maniphest] T296926: Clarify licensing

2021-12-02 Thread GoranSMilovanovic
GoranSMilovanovic added a subscriber: Tobi_WMDE_SW. GoranSMilovanovic added a comment. @Manuel > Based on input from iRights.Law: If you're unsure which license to pick, normally choose Modified-BSD(called ‘BSD 3-Clause "New" or "Revised" License’ in the

[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard

2021-11-30 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. > I need to fix the Current Events README too > What would you suggest? A quick overview should do in this case, right? Exactly. I will take care of it don't worry; I've just mentioned that as a sort of reminder. TASK DETAIL

[Wikidata-bugs] [Maniphest] T296387: Some tables show wrong or incomplete information on Current Events dashboard

2021-11-30 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel > Loading times are a nightmare now.. can you test to cut off each table after the top 100 entries? **To Do** > This would work for now, but the better alternative would be to implement the label lookup in the backend.

[Wikidata-bugs] [Maniphest] T296387: Some tables show wrong or incomplete information on Current Events dashboard

2021-11-28 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel To clarify and help you follow the developments here: I think the whole problem was related to filtering out items based on their revision frequencies ranks, and not absolute revision frequencies. The frequency revision ranks could have

[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard

2021-11-28 Thread GoranSMilovanovic
GoranSMilovanovic updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T294983 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86

[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard

2021-11-28 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel > include “user feedback” for empty tables **Done.** TASK DETAIL https://phabricator.wikimedia.org/T294983 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Man

[Wikidata-bugs] [Maniphest] T296387: Some tables show wrong or incomplete information on Current Events dashboard

2021-11-28 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel This is possibly fixed now in the test environment <http://datakolektiv.org/app/QURATOR_CurrentEvents>, but we need another decision now: - in order to fix this obvious and annoying bug I removed **all filtering** of items tha

[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard

2021-11-28 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel Reminder on ToDos here: > The browser title reads “Current Events Dashboard” (it currently shows "Qurator...") This will be fixed with the deployment in production; ShinyProxy server settings determine the title of the ap

[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard

2021-11-28 Thread GoranSMilovanovic
GoranSMilovanovic updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T294983 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86

[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard

2021-11-28 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel > Footer in the simple ("Made by the Wikimedia development team" etc) or ideally the new and advanced layout This is implemented in the test environment <http://datakolektiv.org/app/QURATOR_CurrentEvents> now,

[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard

2021-11-28 Thread GoranSMilovanovic
GoranSMilovanovic updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T294983 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86

[Wikidata-bugs] [Maniphest] T296387: Some tables show wrong or incomplete information on Current Events dashboard

2021-11-28 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel - Found one possible (and most probable) cause of the anomaly; - fixed; - restarted the update engine in the test environment <http://datakolektiv.org/app_direct/QURATOR_CurrentEvents/>; - monitoring. TASK DETAIL

[Wikidata-bugs] [Maniphest] T296387: Some tables show wrong or incomplete information on Current Events dashboard

2021-11-26 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. The anomaly **is now observed** in the test environment <http://datakolektiv.org/app/QURATOR_CurrentEvents>: complete code evaluation of the dashboard's update engine will take place following the implementation of changes requested in T294983

[Wikidata-bugs] [Maniphest] T296387: Some tables show wrong or incomplete information on Current Events dashboard

2021-11-25 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. > Logic dictates that all 6h should be included in 24h, all 24h should be included in 48h, and all 48h should be included in 72h. This is still not the case, so something *must* be wrong here. This anomaly is not present in the **restarted** t

[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard

2021-11-25 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. > No "Frequently revised items in the previous 72 hours" shown **Fixed** in the test environment <http://datakolektiv.org/app/QURATOR_CurrentEvents>. TASK DETAIL https://phabricator.wikimedia.org/T294983 EMAIL

[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard

2021-11-25 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel T294983#7529722 <https://phabricator.wikimedia.org/T294983#7529722> > change the order of the tables from 6h-72h to 72h-6h (so that the first table shown will always be filled) **Fixed** in the test environme

[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard

2021-11-24 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel Please let's follow the changes in the test environment <http://datakolektiv.org/app/QURATOR_CurrentEvents> first: > As we are sorting for Editors first and Revisions second, they should also appear in that order (as seen in t

[Wikidata-bugs] [Maniphest] T296387: Some tables show wrong or incomplete information on Current Events dashboard

2021-11-24 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. > Logic dictates that all 6h should be included in 24h, all 24h should be included in 48h, and all 48h should be included in 72h. This is still not the case, so something *must* be wrong here. I have restarted the update engine on the test ser

[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard

2021-11-18 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel Re: T294983#7509866 <https://phabricator.wikimedia.org/T294983#7509866> > The dashboard is currently sorting out its findings by number of revisions - bug fix! Actually, it is not sorting by number of revisions, I have jus

[Wikidata-bugs] [Maniphest] T294985: Show up-to-date labels in Current Events Dashboard

2021-11-18 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel > In addition to that: Let's please also filter out all Items that were edited by only 1 editor. This should significantly improve the delay! Implemented, deployed. TASK DETAIL https://phabricator.wikimedia.org/T294985 EMAIL PREFEREN

[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard

2021-11-17 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel @GoranSMilovanovic > Can you please check whether the tabs are named correctly? There seems to be a mix-up of some sort. The dashboard is currently sorting out its findings by number of revisions - bug fix! TASK DETAIL ht

[Wikidata-bugs] [Maniphest] T294985: Show up-to-date labels in Current Events Dashboard

2021-11-17 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel > There is a noticeable delay now in my setup. How long is the delay, approximately? > In addition to that: Let's please also filter out all Items that were edited by only 1 editor. This should significantly improve the delay!

[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard

2021-11-17 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. > Name and title read “Wikidata Current Events Dashboard” (text not picture, if at all possible) Not possible. @Manuel: I am not a web designer. In serving dashboards, I work with limited possibilities offered by the RStudio Shiny framework, wh

[Wikidata-bugs] [Maniphest] T294984: Filter noise out of Current Events

2021-11-16 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel - we are filtering all bot revisions now; - the transition is seamless: the old data (including bot edits) will remain on the dashboard until they are washed out by the new data in the following days. TASK DETAIL https

[Wikidata-bugs] [Maniphest] T294985: Show up-to-date labels in Current Events Dashboard

2021-11-16 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel Changes implemented and deployed https://wikidata-analytics.wmcloud.org/app/CurrentEvents > A delay of up to 1h is allowed. - we do real-time: the missing labels are checked from the dashboard directly; tested, wo

[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard

2021-11-16 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel UI changes are now deployed, check: https://wikidata-analytics.wmcloud.org/app/CurrentEvents TASK DETAIL https://phabricator.wikimedia.org/T294983 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences

[Wikidata-bugs] [Maniphest] T295396: Redirect deprecated Wikidata Analytics subdomains to the current subdomain

2021-11-10 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. Note: @GoranSMilovanovic find the old Wikitonary-Analytics domain. TASK DETAIL https://phabricator.wikimedia.org/T295396 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: GoranSMilovanovic

[Wikidata-bugs] [Maniphest] T294984: Filter noise out of Current Events (Estimation)

2021-11-10 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. NOTE: filter out bots with `rcshow`. TASK DETAIL https://phabricator.wikimedia.org/T294984 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Manuel, Invadibot, maantietaja

[Wikidata-bugs] [Maniphest] T294975: UX update for Current Events dashboard

2021-11-10 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel T294985 <https://phabricator.wikimedia.org/T294985> and T294986 <https://phabricator.wikimedia.org/T294986> can be solved together; I think it would not take more than 6 - 8 hours max to introduce changes, test, and deploy the desi

[Wikidata-bugs] [Maniphest] T295057: Create redirects for old Wikidata analytics-related URLs

2021-11-05 Thread GoranSMilovanovic
GoranSMilovanovic added a subscriber: Addshore. GoranSMilovanovic added a comment. @Manuel Let's do it, then. Maybe @addshore? TASK DETAIL https://phabricator.wikimedia.org/T295057 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic

[Wikidata-bugs] [Maniphest] T295044: One-time analytics of total entity usage pages

2021-11-04 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel You are looking for a dashboard via the old URL, try: https://wikidata-analytics.wmcloud.org/app/WD_percentUsageDashboard TASK DETAIL https://phabricator.wikimedia.org/T295044 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel

[Wikidata-bugs] [Maniphest] T294983: UI changes for Current Events Dashboard

2021-11-03 Thread GoranSMilovanovic
GoranSMilovanovic added projects: WMDE-Analytics-Engineering, User-GoranSMilovanovic. TASK DETAIL https://phabricator.wikimedia.org/T294983 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Manuel, Invadibot

[Wikidata-bugs] [Maniphest] T282563: User Retention Wikidata: A model for "participating since" patterns in the 2021 Wikidata Community Survey

2021-11-01 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Jan_Dittrich Do we need this ticket anymore? TASK DETAIL https://phabricator.wikimedia.org/T282563 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Esh77, Pablo, Mohammed_Sadat_WMDE

[Wikidata-bugs] [Maniphest] T283574: Wikidata Analytics Data Products: DockerHub/Deployment

2021-10-28 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @WMDE-leszek So, it has been a while since we have discussed this thing. If the possibility to keep our Wikidata Analytics images in the `wikimediade` docker hub will not open anytime soon, I suggest we close this ticket so that I can close its

[Wikidata-bugs] [Maniphest] T282563: User Retention Wikidata: A model for "participating since" patterns in the 2021 Wikidata Community Survey

2021-10-27 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @MGerlach @Jan_Dittrich I have used XGBoost to train a `leave` vs `stay` binary classifier to our data. I did not go into elaborated cross-validation, used only a single train and single test dataset, downsampling by a huge factor (because

[Wikidata-bugs] [Maniphest] T282563: User Retention Wikidata: A model for "participating since" patterns in the 2021 Wikidata Community Survey

2021-10-26 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @MGerlach @Jan_Dittrich It is a power-law (and thus Lindy) after all: "H0: data IS generated from a power law distribution; H1: data IS NOT generated from a power law distribution." (from: Fitting Heavy Tailed Dis

[Wikidata-bugs] [Maniphest] T285739: [Epic] Wikidata content quality analytics

2021-10-24 Thread GoranSMilovanovic
GoranSMilovanovic claimed this task. GoranSMilovanovic added projects: WMDE-Analytics-Engineering, User-GoranSMilovanovic. TASK DETAIL https://phabricator.wikimedia.org/T285739 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc

[Wikidata-bugs] [Maniphest] T285739: [Epic] Wikidata content quality analytics

2021-10-24 Thread GoranSMilovanovic
GoranSMilovanovic added a subtask: T286257: Insights from the Wikidata Languages Landscape project. TASK DETAIL https://phabricator.wikimedia.org/T285739 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Manuel, Aklapper

[Wikidata-bugs] [Maniphest] T286257: Insights from the Wikidata Languages Landscape project

2021-10-24 Thread GoranSMilovanovic
GoranSMilovanovic added a parent task: T285739: [Epic] Wikidata content quality analytics. TASK DETAIL https://phabricator.wikimedia.org/T286257 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Esc3300, Tobi_WMDE_SW, Manuel

[Wikidata-bugs] [Maniphest] T285739: [Epic] Wikidata content quality analytics

2021-10-24 Thread GoranSMilovanovic
GoranSMilovanovic added a subtask: T288611: Number of links to other Wikimedia projects. TASK DETAIL https://phabricator.wikimedia.org/T285739 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Manuel, Aklapper, Invadibot

[Wikidata-bugs] [Maniphest] T288611: Number of links to other Wikimedia projects

2021-10-24 Thread GoranSMilovanovic
GoranSMilovanovic added a parent task: T285739: [Epic] Wikidata content quality analytics. TASK DETAIL https://phabricator.wikimedia.org/T288611 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Mike_Peel, Tobi_WMDE_SW

[Wikidata-bugs] [Maniphest] T285741: [Epic] Wikidata user segmentation

2021-10-24 Thread GoranSMilovanovic
GoranSMilovanovic claimed this task. GoranSMilovanovic added projects: WMDE-Analytics-Engineering, User-GoranSMilovanovic. GoranSMilovanovic added a comment. @Manuel The following Report (compressed `.zip` archive) F34708922: Wikidata_StrategyReport_Users.nb.zip <ht

  1   2   3   4   5   6   7   8   9   >