[Wikidata-bugs] [Maniphest] T299062: Save stats from wcqs-beta

2022-02-28 Thread Zbyszko
Zbyszko added a comment. Data uploaded. TASK DETAIL https://phabricator.wikimedia.org/T299062 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Aklapper, Gehel, karapayneWMDE, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz

[Wikidata-bugs] [Maniphest] T301953: Investigate wdqs1013 stability issues

2022-02-17 Thread Zbyszko
Zbyszko created this task. Zbyszko added a project: Wikidata-Query-Service. Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION According to this graph: https://grafana.wikimedia.org/d/00489/wikidata-query-service?viewPanel=36=1=1m_name=wdqs , wdqs1013 has the most

[Wikidata-bugs] [Maniphest] T301650: WCQS "Application Connection Error" E009

2022-02-15 Thread Zbyszko
Zbyszko added a comment. @Dominicbm thanks for submitting this. I'm having issues reproducing your problem - can you reliably reproduce it on your end and post a step by step instruction here? TASK DETAIL https://phabricator.wikimedia.org/T301650 EMAIL PREFERENCES https

[Wikidata-bugs] [Maniphest] T301650: WCQS "Application Connection Error" E009

2022-02-15 Thread Zbyszko
Zbyszko claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T301650 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Aklapper, Dominicbm, Invadibot, MPhamWMF, maantietaja, FRomeo_WMF, CBogen, Nintendofan885, Akuckartz

[Wikidata-bugs] [Maniphest] T301255: Adapt QueryBuilder for Wikimedia Commons Query

2022-02-08 Thread Zbyszko
Zbyszko created this task. Zbyszko added projects: Wikidata, Wikidata Query UI. Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION Currently - QueryBuilder is only working for WDQS - not only link on commons-query.wikimedia.org points to that of wikidata.org, but query

[Wikidata-bugs] [Maniphest] T287865: Review documentation - API and related

2022-02-03 Thread Zbyszko
Zbyszko added a subscriber: Cparle. Zbyszko added a comment. We seem to be missing the docs on MoreLikeThis. It would be nice to get MediaSearch API documentation as well, if available - @Cparle is it? TASK DETAIL https://phabricator.wikimedia.org/T287865 EMAIL PREFERENCES https

[Wikidata-bugs] [Maniphest] T299062: Save stats from wcqs-beta

2022-02-03 Thread Zbyszko
Zbyszko added a comment. Putting in waiting to mark the need of repeating the process in two weeks. TASK DETAIL https://phabricator.wikimedia.org/T299062 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Aklapper, Gehel, Invadibot

[Wikidata-bugs] [Maniphest] T299062: Save stats from wcqs-beta

2022-02-02 Thread Zbyszko
Zbyszko added a comment. Based on nginx logs (which are kept over two weeks) - https://drive.google.com/drive/u/0/folders/1ojrcehL7Bz0Cc4wKgdtD8CccruNK8lyh A very convoluted command I used to extract this (from within /var/log/nginx), note Jan and Feb substitutions, they work better

[Wikidata-bugs] [Maniphest] T299062: Save stats from wcqs-beta

2022-02-01 Thread Zbyszko
Zbyszko claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T299062 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Aklapper, Gehel, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86

[Wikidata-bugs] [Maniphest] T296470: Initialize WCQS production servers

2022-01-12 Thread Zbyszko
Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T296470 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: RKemper, bking, EBernhardson, Ottomata, Aklapper, Zbyszko, Invadibot, MPhamWMF, maantietaja

[Wikidata-bugs] [Maniphest] T296470: Initialize WCQS production servers

2022-01-12 Thread Zbyszko
Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T296470 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: RKemper, bking, EBernhardson, Ottomata, Aklapper, Zbyszko, Invadibot, MPhamWMF, maantietaja

[Wikidata-bugs] [Maniphest] T296470: Initialize WCQS production servers

2022-01-11 Thread Zbyszko
Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T296470 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: bking, EBernhardson, Ottomata, Aklapper, Zbyszko, Invadibot, MPhamWMF, maantietaja, CBogen

[Wikidata-bugs] [Maniphest] T296470: Initialize WCQS production servers

2022-01-11 Thread Zbyszko
Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T296470 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: bking, EBernhardson, Ottomata, Aklapper, Zbyszko, Invadibot, MPhamWMF, maantietaja, CBogen

[Wikidata-bugs] [Maniphest] T296470: Initialize WCQS production servers

2022-01-10 Thread Zbyszko
Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T296470 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Ottomata, Aklapper, Zbyszko, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana

[Wikidata-bugs] [Maniphest] T296470: Initialize WCQS production servers

2022-01-07 Thread Zbyszko
Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T296470 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Ottomata, Aklapper, Zbyszko, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana

[Wikidata-bugs] [Maniphest] T296470: Initialize WCQS production servers

2022-01-07 Thread Zbyszko
Zbyszko added a subscriber: Ottomata. Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T296470 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Ottomata, Aklapper, Zbyszko, Invadibot, MPhamWMF

[Wikidata-bugs] [Maniphest] T296470: Initialize WCQS production servers

2022-01-07 Thread Zbyszko
Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T296470 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Aklapper, Zbyszko, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, Namenlos314

[Wikidata-bugs] [Maniphest] T296466: Add MCR filtering to Streaming Updater for WCQS

2021-12-01 Thread Zbyszko
Zbyszko claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T296466 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Aklapper, Zbyszko, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86

[Wikidata-bugs] [Maniphest] T296470: Initialize WCQS production servers

2021-11-25 Thread Zbyszko
Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T296470 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Aklapper, Zbyszko, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, Namenlos314

[Wikidata-bugs] [Maniphest] T296470: Initialize WCQS production servers

2021-11-25 Thread Zbyszko
Zbyszko created this task. Zbyszko added projects: Wikidata, Wikidata-Query-Service, Discovery-Search (Current work). TASK DESCRIPTION This ticket is for tracking final deployment steps for WCQS production. This does not include exposing the service to a general public, only steps to ensure

[Wikidata-bugs] [Maniphest] T296468: Modify flink-job.py script to handle WCQS streaming updater deployment

2021-11-25 Thread Zbyszko
Zbyszko created this task. Zbyszko added projects: Wikidata, Wikidata-Query-Service, Discovery-Search (Current work). TASK DESCRIPTION As a WCQS maintainter I want to be able to deploy WCQS streaming updater the same way as it is being done for WDQS. Flink job deployment script (flink

[Wikidata-bugs] [Maniphest] T296466: Add MCR filtering to Streaming Updater for WCQS

2021-11-25 Thread Zbyszko
Zbyszko created this task. Zbyszko added projects: Wikidata, Wikidata-Query-Service, Discovery-Search (Current work). TASK DESCRIPTION As a WCQS maintainer I want only SDC related revisions to be processed by the streaming updater, so that we won't handle events that will not change

[Wikidata-bugs] [Maniphest] T280485: Additional capacity on the k8s Flink cluster for WCQS updater

2021-11-17 Thread Zbyszko
Zbyszko added a comment. Sorry all for the confusion my typo caused, different name for that magnitude in my native language is confusing me my whole life :). TASK DETAIL https://phabricator.wikimedia.org/T280485 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel

[Wikidata-bugs] [Maniphest] T295676: Redirect to previous URL after auth redirect in WCQS

2021-11-15 Thread Zbyszko
Zbyszko created this task. Zbyszko added a project: Wikidata-Query-Service. Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION As a WCQS user I want to get redirected to the url I started with if I need to authenticate first, so that I don't need to enter the URL again

[Wikidata-bugs] [Maniphest] T294025: WDQS lag is usually longer than one minute

2021-10-28 Thread Zbyszko
Zbyszko closed this task as "Resolved". Zbyszko claimed this task. Zbyszko added a comment. More information provided on wikidata-tech,wikidata mailing lists - https://lists.wikimedia.org/hyperkitty/list/wikidata-t...@lists.wikimedia.org/thread/O5UWOENIEDA2GJSDBL3MEBBFH7ZPXFNY/ T

[Wikidata-bugs] [Maniphest] T293027: Create metrics for measuring WDQS/WCQS update lag

2021-10-22 Thread Zbyszko
Zbyszko added a comment. Here's a proposal for an SLO dashboard, that can use historical data to provide insight into the past performance: https://grafana-rw.wikimedia.org/d/yCBd7Tdnk/wdqs-lag-slo TASK DETAIL https://phabricator.wikimedia.org/T293027 EMAIL PREFERENCES https

[Wikidata-bugs] [Maniphest] T294025: WDQS lag is usually longer than one minute

2021-10-21 Thread Zbyszko
Zbyszko added a comment. Thanks for bringing this up, we haven't explain that part very well yet. Goal of the new updater wasn't to have a best case scenario latency lower than on the old updater. Goal was to eliminate few issues of the old ones, like: - low throughput, that often

[Wikidata-bugs] [Maniphest] T293027: Create metrics for measuring WDQS/WCQS update lag

2021-10-19 Thread Zbyszko
Zbyszko claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T293027 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: RKemper, Aklapper, MPhamWMF, Invadibot, maantietaja, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86

[Wikidata-bugs] [Maniphest] T293027: Create metrics for measuring WDQS/WCQS update lag

2021-10-18 Thread Zbyszko
Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T293027 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: RKemper, Aklapper, MPhamWMF, Invadibot, maantietaja, CBogen, Akuckartz, Nandana, Namenlos314

[Wikidata-bugs] [Maniphest] T293638: Create and update the process for separate WCQS mutation topic

2021-10-18 Thread Zbyszko
Zbyszko created this task. Zbyszko added projects: Wikidata, Wikidata-Query-Service. Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION Currently, WDQS is being updated with streaming updater, using a topic that connects streaming updater producer with consumers

[Wikidata-bugs] [Maniphest] T288231: Deploy the wdqs streaming updater to production

2021-10-18 Thread Zbyszko
Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T288231 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: elukey, Zbyszko, RKemper, Aklapper, dcausse, Suran38, Biggs657, Invadibot, Lalamarie69, MPhamWMF

[Wikidata-bugs] [Maniphest] T293462: Add user blocking in WCQS

2021-10-15 Thread Zbyszko
Zbyszko created this task. Zbyszko added a project: Wikidata-Query-Service. Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION As a WCQS maintainer I want to be able to block specific users so that I can have a quick way of blocking actions that threaten the stability

[Wikidata-bugs] [Maniphest] T288231: Deploy the wdqs streaming updater to production

2021-10-15 Thread Zbyszko
Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T288231 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: RKemper, Aklapper, dcausse, Suran38, Biggs657, Invadibot, Lalamarie69, MPhamWMF, maantietaja

[Wikidata-bugs] [Maniphest] T290299: Replace token store in MW OAuth WCQS proxy with JWT

2021-10-01 Thread Zbyszko
Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T290299 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: ttaylor, CBogen, Gehel, Aklapper, Zache, BPirkle, sdkim, hnowlan, RKemper, Zbyszko, Invadibot

[Wikidata-bugs] [Maniphest] T290299: Replace token store in MW OAuth WCQS proxy with JWT

2021-10-01 Thread Zbyszko
Zbyszko added a comment. @BPirkle when this code was written, there was a bug (now fixed) that prevented us from using OAuth2. Now we could, but since we consider this a temporary measure (with API gateway being a more solid one in the future, as mentioned here T290300 <ht

[Wikidata-bugs] [Maniphest] T290300: Serve WCQS Sparql endpoint through api.wikimedia.org with OAuth 2

2021-09-13 Thread Zbyszko
Zbyszko added a comment. @LucasWerkmeister current WCQS-beta behaviour is a bug - sparql endpoint should be authenticated as well, not only UI (we created a ticket for that - T290889 <https://phabricator.wikimedia.org/T290889>) . Production WCQS will start with the authentication a

[Wikidata-bugs] [Maniphest] T280006: Set up the application authentication for WCQS on commons-query.wikimedia.org

2021-09-13 Thread Zbyszko
Zbyszko added a comment. We should figure out who is the holder of the auth consumer - we probably should have a service account for mediawiki TASK DETAIL https://phabricator.wikimedia.org/T280006 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences

[Wikidata-bugs] [Maniphest] T276469: Cookbooks and / or operation procedures are adapted for the new Flink based WDQS Streaming Updater

2021-09-13 Thread Zbyszko
Zbyszko claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T276469 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: dcausse, Aklapper, Gehel, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, Namenlos314, Lahi

[Wikidata-bugs] [Maniphest] T262265: Provide real-time updates for WCQS

2021-09-09 Thread Zbyszko
Zbyszko reassigned this task from Zbyszko to EBernhardson. TASK DETAIL https://phabricator.wikimedia.org/T262265 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: EBernhardson, Zbyszko Cc: Back_ache, So9q, Salgo60, Gehel, Aklapper, Zbyszko, Invadibot

[Wikidata-bugs] [Maniphest] T290300: Serve WCQS Sparql endpoint through api.wikimedia.org with OAuth 2

2021-09-03 Thread Zbyszko
Zbyszko created this task. Zbyszko added projects: Wikidata, Wikidata-Query-Service, Discovery-Search (Current work). TASK DESCRIPTION As an external/bot developer I want to be able to authenticate with WCQS via my application/bot so that it can use the the service without human interaction

[Wikidata-bugs] [Maniphest] T290299: Replace token store in MW OAuth WCQS proxy with JWT

2021-09-03 Thread Zbyszko
Zbyszko created this task. Zbyszko added projects: Wikidata, Wikidata-Query-Service, Discovery-Search (Current work). TASK DESCRIPTION As a WCQS maintainer I want to simplify MW OAuth Proxy for WCQS so it won't require a cache of tokens so that they aren't invalidated before their expiry

[Wikidata-bugs] [Maniphest] T280006: Set up the application authentication for WCQS on commons-query.wikimedia.org

2021-09-03 Thread Zbyszko
Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T280006 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: RKemper, hnowlan, sdkim, BPirkle, Zache, Aklapper, Gehel, CBogen, ttaylor, Zbyszko, Invadibot

[Wikidata-bugs] [Maniphest] T276469: Cookbooks and / or operation procedures are adapted for the new Flink based WDQS Streaming Updater

2021-08-25 Thread Zbyszko
Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T276469 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: dcausse, Aklapper, Gehel, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana

[Wikidata-bugs] [Maniphest] T288230: Promote MediaInfo RDF format to stable

2021-08-24 Thread Zbyszko
Zbyszko added subscribers: Cparle, LucasWerkmeister, Lydia_Pintscher. Zbyszko added a comment. @Lydia_Pintscher, @LucasWerkmeister, just to confirm(or the opposite) what we discussed in email thread - only thing required here is the doc update? @Cparle - this is probably of interest to SD

[Wikidata-bugs] [Maniphest] T262265: Provide real-time updates for WCQS

2021-08-24 Thread Zbyszko
Zbyszko claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T262265 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: So9q, Salgo60, Gehel, Aklapper, Zbyszko, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana

[Wikidata-bugs] [Maniphest] T280006: Set up the application authentication for WCQS on commons-query.wikimedia.org

2021-08-24 Thread Zbyszko
Zbyszko added a comment. Plan right now assumes that WCQS API will be provided via https://api.wikimedia.org/ <https://api.wikimedia.org/> - technical feasibility is still to be assessed. This will allow us to provide an OAuth 2.0 flow and standardised experience similar to other

[Wikidata-bugs] [Maniphest] T282117: Set up WCQS top level wikimedia domain

2021-08-23 Thread Zbyszko
Zbyszko renamed this task from "Set up WCQS top level wikimedia project" to "Set up WCQS top level wikimedia domain". TASK DETAIL https://phabricator.wikimedia.org/T282117 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszk

[Wikidata-bugs] [Maniphest] T280485: Additional capacity on the k8s Flink cluster for WCQS updater

2021-08-11 Thread Zbyszko
Zbyszko added a comment. The most important parameter to streaming updater is related to storage - we have a huge surplus of computing resources in WDQS streaming updater, since edit rate is much lower in SDoC, there is no risk when it comes to throughput. The storage needs on the other

[Wikidata-bugs] [Maniphest] T280485: Additional capacity on the k8s Flink cluster for WCQS updater

2021-08-11 Thread Zbyszko
Zbyszko claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T280485 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Aklapper, RKemper, Gehel, MPhamWMF, wkandek, JMeybohm, CBogen, Namenlos314, jijiki, Gq86

[Wikidata-bugs] [Maniphest] T288531: Flink job failing in Kubernetes with more than 1 task manager

2021-08-10 Thread Zbyszko
Zbyszko created this task. Zbyszko added projects: Wikidata-Query-Service, Discovery-Search (Current work). Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION Kubernetes deployment of flink and job fails when there are at least 2 task managers, which would suggest issues

[Wikidata-bugs] [Maniphest] T288230: Promote MediaInfo RDF format to stable

2021-08-05 Thread Zbyszko
Zbyszko created this task. Zbyszko added projects: Wikidata, Wikidata-Query-Service. Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION As a WCQS users I want to have a stable reference for MediaInfo RDF format so that I can reference it when using the service and be sure

[Wikidata-bugs] [Maniphest] T260568: [EPIC] Productionize WCQS

2021-08-05 Thread Zbyszko
Zbyszko added a project: Discovery-Search (Current work). TASK DETAIL https://phabricator.wikimedia.org/T260568 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Fuzheado, Zache, ttaylor, CBogen, Gehel, Aklapper, Invadibot, MPhamWMF

[Wikidata-bugs] [Maniphest] T287969: Flink SwiftTempAuth reports IllegalAccessError when running with java 11

2021-08-04 Thread Zbyszko
Zbyszko moved this task from All WDQS-related tasks to Current work on the Wikidata-Query-Service board. Zbyszko added a project: Discovery-Search (Current work). TASK DETAIL https://phabricator.wikimedia.org/T287969 WORKBOARD https://phabricator.wikimedia.org/project/board/891/ EMAIL

[Wikidata-bugs] [Maniphest] T287969: Flink SwiftTempAuth reports IllegalAccessError when running with java 11

2021-08-04 Thread Zbyszko
Zbyszko triaged this task as "High" priority. TASK DETAIL https://phabricator.wikimedia.org/T287969 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Zbyszko, Aklapper, dcausse, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckart

[Wikidata-bugs] [Maniphest] T287969: Flink SwiftTempAuth reports IllegalAccessError when running with java 11

2021-08-04 Thread Zbyszko
Zbyszko claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T287969 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Zbyszko, Aklapper, dcausse, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, Namenlos314, Lahi

[Wikidata-bugs] [Maniphest] T287865: Review documentation - API and related

2021-08-02 Thread Zbyszko
Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T287865 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Aklapper, Zbyszko, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, apaskulin, Nandana

[Wikidata-bugs] [Maniphest] T287865: Review documentation - API and related

2021-08-02 Thread Zbyszko
Zbyszko created this task. Zbyszko added projects: Documentation, Wikidata, Discovery-Search. Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION As a search API user I'd like to have a relevant documentation on how to use Search APIs and features so that I know how

[Wikidata-bugs] [Maniphest] T273901: Automate event stream ingestion into HDFS for streams that don't use EventGate

2021-07-22 Thread Zbyszko
Zbyszko added a comment. @Ottomata thanks! TASK DETAIL https://phabricator.wikimedia.org/T273901 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Ottomata, Zbyszko Cc: Zbyszko, Mholloway, MPhamWMF, Gehel, Aklapper, JAllemandou, dcausse, Mstyles

[Wikidata-bugs] [Maniphest] T244590: [Epic] Rework the WDQS updater as an event driven application

2021-07-20 Thread Zbyszko
Zbyszko closed subtask T247058: Deployment strategy and hardware requirement for new Flink based WDQS updater as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T244590 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: MPhamWMF

[Wikidata-bugs] [Maniphest] T247058: Deployment strategy and hardware requirement for new Flink based WDQS updater

2021-07-20 Thread Zbyszko
Zbyszko closed this task as "Resolved". Zbyszko claimed this task. Zbyszko added a comment. Strategy was developed and is being implemented. TASK DETAIL https://phabricator.wikimedia.org/T247058 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailp

[Wikidata-bugs] [Maniphest] T244590: [Epic] Rework the WDQS updater as an event driven application

2021-07-20 Thread Zbyszko
Zbyszko closed subtask T262676: Make the pipeline more robust when backfilling data generated during a DC switch as Declined. TASK DETAIL https://phabricator.wikimedia.org/T244590 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: MPhamWMF

[Wikidata-bugs] [Maniphest] T262676: Make the pipeline more robust when backfilling data generated during a DC switch

2021-07-20 Thread Zbyszko
Zbyszko closed this task as "Declined". Zbyszko added a comment. Issue is no longer valid. TASK DETAIL https://phabricator.wikimedia.org/T262676 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Zbyszko, dcausse, Aklapper,

[Wikidata-bugs] [Maniphest] T273901: Automate event stream ingestion into HDFS for streams that don't use EventGate

2021-07-20 Thread Zbyszko
Zbyszko added a comment. @Ottomata can this be closed? TASK DETAIL https://phabricator.wikimedia.org/T273901 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Ottomata, Zbyszko Cc: Zbyszko, Mholloway, MPhamWMF, Gehel, Aklapper, JAllemandou, dcausse

[Wikidata-bugs] [Maniphest] T286938: Create a plan for a final streaming updater rollout as source of truth for blazegraph instances

2021-07-19 Thread Zbyszko
Zbyszko created this task. Zbyszko added projects: Wikidata-Query-Service, Wikidata, Discovery-Search (Current work). Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION As a streaming updater deployer I want to have a plan for the production rollout so that the production

[Wikidata-bugs] [Maniphest] T264006: Deploy Flink (rdf-streaming-updater) to kubernetes (k8s)

2021-06-22 Thread Zbyszko
Zbyszko added a comment. @jijiki Great, thank you! TASK DETAIL https://phabricator.wikimedia.org/T264006 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: jijiki, dcausse, Zbyszko, akosiaris, Mstyles, Gehel, Aklapper, Biggs657

[Wikidata-bugs] [Maniphest] T284040: Enable blank node skolemization on wcqs

2021-06-07 Thread Zbyszko
Zbyszko claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T284040 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Aklapper, Multichill, dcausse, Invadibot, Lalamarie69, MPhamWMF, maantietaja, Alter-paule, Beast1978, CBogen

[Wikidata-bugs] [Maniphest] T280006: Set up the application authentication for WCQS on commons-query.wikimedia.org

2021-05-06 Thread Zbyszko
Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T280006 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Aklapper, Gehel, CBogen, ttaylor, Zbyszko, Invadibot, MPhamWMF, maantietaja, Akuckartz, Nandana

[Wikidata-bugs] [Maniphest] T280006: Set up the application authentication for WCQS on commons-query.wikimedia.org

2021-05-06 Thread Zbyszko
Zbyszko renamed this task from "Set up the application authentication for WCQS" to "Set up the application authentication for WCQS on commons-query.wikimedia.org". Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T280006 EMAIL

[Wikidata-bugs] [Maniphest] T282117: Set up WCQS top level wikimedia project

2021-05-06 Thread Zbyszko
Zbyszko created this task. Zbyszko added projects: Wikidata, Wikidata-Query-Service. TASK DESCRIPTION As a WCQS user I want to be able to have WCQS accessible via commons-query.wikimedia.org so that I can that proper bot authentication is enabled. We need to have both more representative

[Wikidata-bugs] [Maniphest] T280022: Data missing from WCQS

2021-04-20 Thread Zbyszko
Zbyszko added a comment. Currently, last available data in WCQS is from April 3rd, so we're 2 weeks behind. It turns out that commons dump generation time grew and its end overtook our Monday's reload beginning. This means that each Monday for the last few weeks, when the reload

[Wikidata-bugs] [Maniphest] T280022: Data missing from WCQS

2021-04-19 Thread Zbyszko
Zbyszko claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T280022 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: CBogen, Aklapper, Invadibot, MPhamWMF, maantietaja, Akuckartz, Nandana, Namenlos314, Lahi, Gq86

[Wikidata-bugs] [Maniphest] T280022: Data missing from WCQS

2021-04-19 Thread Zbyszko
Zbyszko set the point value for this task to "5". TASK DETAIL https://phabricator.wikimedia.org/T280022 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: CBogen, Aklapper, Invadibot, MPhamWMF, maantietaja, Akuckartz, Nandana, N

[Wikidata-bugs] [Maniphest] T280006: Set up the application authentication for WCQS

2021-04-15 Thread Zbyszko

[Wikidata-bugs] [Maniphest] T280008: Set up WCQS monitoring

2021-04-15 Thread Zbyszko
Zbyszko removed a project: Epic. TASK DETAIL https://phabricator.wikimedia.org/T280008 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Aklapper, Gehel, CBogen, ttaylor, Zbyszko, Invadibot, MPhamWMF, maantietaja, Akuckartz, Nandana

[Wikidata-bugs] [Maniphest] T280247: Create WCQS UI microsite deployment

2021-04-15 Thread Zbyszko
Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T280247 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Aklapper, Gehel, CBogen, ttaylor, Zbyszko, Invadibot, MPhamWMF, maantietaja, NavinRizwi

[Wikidata-bugs] [Maniphest] T280247: Create WCQS UI microsite deployment

2021-04-15 Thread Zbyszko
Zbyszko removed a project: Epic. TASK DETAIL https://phabricator.wikimedia.org/T280247 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Aklapper, Gehel, CBogen, ttaylor, Zbyszko, Invadibot, MPhamWMF, maantietaja, Akuckartz, Nandana

[Wikidata-bugs] [Maniphest] T280247: Create WCQS UI microsite deployment

2021-04-15 Thread Zbyszko
Zbyszko added a comment. On Tue, 13 Apr 2021 at 11:52, Zbyszko Papierski wrote: Hi, We're about to start to push WCQS to production and I need to have some info on how to work with the current WDQS GUI. It was decided that the code will remain the same for both WCQS and WDQS - we

[Wikidata-bugs] [Maniphest] T280247: Create WCQS UI microsite deployment

2021-04-15 Thread Zbyszko
Zbyszko created this task. Zbyszko added projects: Wikidata, Epic, Wikidata-Query-Service. TASK DESCRIPTION As a WCQS maintainer I want to have a deployment process for WCQS UI that requires fewest manual steps. WDQS UI is deployed as a microsite (see details here T266702 <ht

[Wikidata-bugs] [Maniphest] T280008: Set up WCQS monitoring

2021-04-13 Thread Zbyszko
Zbyszko created this task. Zbyszko added projects: Wikidata, Epic, Wikidata-Query-Service. TASK DESCRIPTION As a WCQS maintainer I want to be able to monitor WCQS performance so I can verify if service is working correctly. We can go with almost exactly the things we monitor for WDQS

[Wikidata-bugs] [Maniphest] T280006: Set up the application authentication for WCQS

2021-04-13 Thread Zbyszko
Zbyszko created this task. Zbyszko added projects: Wikidata, Epic, Wikidata-Query-Service. TASK DESCRIPTION As an external/bot developer I want to be able to authenticate with WCQS via my application/bot so that it can use the the service without human interaction. Beta WCQS is currently

[Wikidata-bugs] [Maniphest] T260568: [EPIC] Productionize WCQS

2021-04-13 Thread Zbyszko
Zbyszko added a subtask: T280001: Set up puppet configuration for new WCQS cluster. TASK DETAIL https://phabricator.wikimedia.org/T260568 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: ttaylor, CBogen, Gehel, Aklapper, Invadibot

[Wikidata-bugs] [Maniphest] T280001: Set up puppet configuration for new WCQS cluster

2021-04-13 Thread Zbyszko
Zbyszko added a parent task: T260568: [EPIC] Productionize WCQS. TASK DETAIL https://phabricator.wikimedia.org/T280001 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Aklapper, Zbyszko, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz

[Wikidata-bugs] [Maniphest] T280001: Set up puppet configuration for new WCQS cluster

2021-04-13 Thread Zbyszko
Zbyszko created this task. Zbyszko added projects: Wikidata, Wikidata-Query-Service. Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION As a WCQS maintainer I want new instances of WCQS to be configurable via Puppet so I can efficiently maintain a WCQS production cluster

[Wikidata-bugs] [Maniphest] T276469: Cookbooks and / or operation procedures are adapted for the new Flink based WDQS Streaming Updater

2021-03-08 Thread Zbyszko
Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T276469 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Aklapper, Gehel, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86

[Wikidata-bugs] [Maniphest] T269302: Many files on Commons cannot be found in WCQS

2021-03-03 Thread Zbyszko
Zbyszko added a comment. First M-entity mentioned in the ticket was missing because there was a bug with weekly reloads, that has now been fixed - entries added before the reload should be available. As for the second part of the ticket - sdc has uri encoded contentUrl (although

[Wikidata-bugs] [Maniphest] T269302: Many files on Commons cannot be found in WCQS

2021-03-03 Thread Zbyszko
Zbyszko claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T269302 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: CBogen, Lydia_Pintscher, Vojtech.dostal, Dipsacus_fullonum, Aklapper, GFontenelle_WMF, MPhamWMF, FRomeo_WMF

[Wikidata-bugs] [Maniphest] T269331: wdqs.data-reload cookbook fails when deleting the old namespace

2021-02-24 Thread Zbyszko
Zbyszko claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T269331 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: RKemper, dcausse, Aklapper, MPhamWMF, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86

[Wikidata-bugs] [Maniphest] T273735: Migrate Streaming Updater to newer Scala version

2021-02-03 Thread Zbyszko
Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T273735 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Aklapper, Zbyszko, MPhamWMF, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86

[Wikidata-bugs] [Maniphest] T273735: Migrate Streaming Updater to newer Scala version

2021-02-03 Thread Zbyszko
Zbyszko created this task. Zbyszko added a project: Wikidata-Query-Service. Restricted Application added a subscriber: Aklapper. Restricted Application added a project: Wikidata. TASK DESCRIPTION As a Streaming Updater maintainter I want to be able to compile and run streaming updater on newer

[Wikidata-bugs] [Maniphest] T267310: Allow job name configuration for Streaming Updater

2021-02-03 Thread Zbyszko
Zbyszko claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T267310 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Aklapper, Zbyszko, MPhamWMF, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE

[Wikidata-bugs] [Maniphest] T269451: Possible flink optimizations/cleanups

2021-02-02 Thread Zbyszko
Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T269451 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: dcausse, Aklapper, MPhamWMF, Alter-paule, Beast1978, CBogen, Un1tY, Akuckartz, Hook696, Kent7301

[Wikidata-bugs] [Maniphest] T267825: Outdated data still present in WCQS a month after statement update

2021-02-01 Thread Zbyszko
Zbyszko added a comment. Issue was fixed manually for now - I'll do a proper deployment once I get some time to deal with recent microsite GUI changes. TASK DETAIL https://phabricator.wikimedia.org/T267825 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel

[Wikidata-bugs] [Maniphest] T269451: Possible flink optimizations/cleanups

2021-02-01 Thread Zbyszko
Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T269451 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: dcausse, Aklapper, MPhamWMF, Alter-paule, Beast1978, CBogen, Un1tY, Akuckartz, Hook696, Kent7301

[Wikidata-bugs] [Maniphest] T261119: Architecture review of Flink based WDQS Streaming Updater

2021-01-25 Thread Zbyszko
Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T261119 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Aklapper, Zbyszko, dcausse, Gehel, MPhamWMF, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86

[Wikidata-bugs] [Maniphest] T269451: Possible flink optimizations/cleanups

2021-01-18 Thread Zbyszko
Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T269451 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: dcausse, Aklapper, MPhamWMF, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86

[Wikidata-bugs] [Maniphest] T272265: Resolve WDQS changelog situation

2021-01-18 Thread Zbyszko
Zbyszko created this task. Zbyszko added a project: Wikidata-Query-Service. Restricted Application added a subscriber: Aklapper. Restricted Application added a project: Wikidata. TASK DESCRIPTION As a developer I want to know the source of truth of WDQS changelog so that I can watch

[Wikidata-bugs] [Maniphest] T269451: Possible flink optimizations/cleanups

2021-01-12 Thread Zbyszko
Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T269451 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: dcausse, Aklapper, MPhamWMF, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86

[Wikidata-bugs] [Maniphest] T269451: Possible flink optimizations/cleanups

2021-01-12 Thread Zbyszko
Zbyszko claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T269451 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: dcausse, Aklapper, MPhamWMF, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE

[Wikidata-bugs] [Maniphest] T267825: Outdated data still present in WCQS a month after statement update

2021-01-12 Thread Zbyszko
Zbyszko added a comment. In T267825#6721180 <https://phabricator.wikimedia.org/T267825#6721180>, @Mstyles wrote: > On the wcqs beta host, `curl -d "query=select * { sdc:M8979671 wdt:P571 ?o . }" localhost/bigdata/namespace/wcq/sparql` returns an item with the cor

[Wikidata-bugs] [Maniphest] T267825: Outdated data still present in WCQS a month after statement update

2021-01-11 Thread Zbyszko
Zbyszko claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T267825 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Mstyles, CBogen, JeanFred, Aklapper, GFontenelle_WMF, MPhamWMF, Nintendofan885, Akuckartz, Nandana, JKSTNK

  1   2   3   4   >