[Wikidata-bugs] [Maniphest] T264447: Examine cases where Blazegraph generates results that timeout and don’t make it back to the user

Zbyszko claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T264447 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: CBogen, Lydia_Pintscher, JAllemandou, Gehel, Aklapper, Akuckartz, Nandana, Namenlos314, Lahi, Gq86

[Wikidata-bugs] [Maniphest] T264447: Examine cases where Blazegraph generates results that timeout and don’t make it back to the user

Zbyszko added a comment. For now, we use status_code = 500 and query_time > 60s to assert that query timed out. Example notebook:F33929802: timed out queries (1).ipynb <https://phabricator.wikimedia.org/F33929802> TASK DETAIL https://phabricator.wikimedia.org/T264447 EMAIL PR

[Wikidata-bugs] [Maniphest] T267175: SPARQL-Query shows entries, which should be filter out; number of entries in result set might change when executed repeatedly (possible caching/indexing problem)

Zbyszko claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T267175 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Tagishsimon, Lydia_Pintscher, CBogen, Z_thomas, agray, Gehel, Lucas_Werkmeister_WMDE, Aklapper, M2k_dewiki

[Wikidata-bugs] [Maniphest] T267175: SPARQL-Query shows entries, which should be filter out; number of entries in result set might change when executed repeatedly (possible caching/indexing problem)

Zbyszko added a comment. I started to investigate the issue, but had to get back to some previous issue - I should have some update before the end of the week, though. TASK DETAIL https://phabricator.wikimedia.org/T267175 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings

[Wikidata-bugs] [Maniphest] T267175: SPARQL-Query shows entries, which should be filter out; number of entries in result set might change when executed repeatedly (possible caching/indexing problem)

Zbyszko added a comment. Few details on the issue: - For extensively modified entities (e.g. by bots) log show that information provided by RecentChanges API isn't always up to date. This can lead to lost revisions - if the last change was among the ones not yet provided by th

[Wikidata-bugs] [Maniphest] T271412: Investigate an alert on statements volume in Blazegraph instances

Zbyszko created this task. Zbyszko added a project: Wikidata-Query-Service. Restricted Application added a subscriber: Aklapper. Restricted Application added a project: Wikidata. TASK DESCRIPTION As a WDQS maintainer I want to verify if it's possible to create an alert that would trigg

[Wikidata-bugs] [Maniphest] T267825: Outdated data still present in WCQS a month after statement update

Zbyszko claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T267825 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Mstyles, CBogen, JeanFred, Aklapper, GFontenelle_WMF, MPhamWMF, Nintendofan885, Akuckartz, Nandana, JKSTNK

[Wikidata-bugs] [Maniphest] T267825: Outdated data still present in WCQS a month after statement update

Zbyszko added a comment. In T267825#6721180 <https://phabricator.wikimedia.org/T267825#6721180>, @Mstyles wrote: > On the wcqs beta host, `curl -d "query=select * { sdc:M8979671 wdt:P571 ?o . }" localhost/bigdata/namespace/wcq/sparql` returns an item with the cor

[Wikidata-bugs] [Maniphest] T269451: Possible flink optimizations/cleanups

Zbyszko claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T269451 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: dcausse, Aklapper, MPhamWMF, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE

[Wikidata-bugs] [Maniphest] T269451: Possible flink optimizations/cleanups

Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T269451 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: dcausse, Aklapper, MPhamWMF, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86

[Wikidata-bugs] [Maniphest] T272265: Resolve WDQS changelog situation

Zbyszko created this task. Zbyszko added a project: Wikidata-Query-Service. Restricted Application added a subscriber: Aklapper. Restricted Application added a project: Wikidata. TASK DESCRIPTION As a developer I want to know the source of truth of WDQS changelog so that I can watch for

[Wikidata-bugs] [Maniphest] T269451: Possible flink optimizations/cleanups

Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T269451 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: dcausse, Aklapper, MPhamWMF, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86

[Wikidata-bugs] [Maniphest] T290299: Replace token store in MW OAuth WCQS proxy with JWT

Zbyszko added a comment. @BPirkle when this code was written, there was a bug (now fixed) that prevented us from using OAuth2. Now we could, but since we consider this a temporary measure (with API gateway being a more solid one in the future, as mentioned here T290300 <ht

[Wikidata-bugs] [Maniphest] T290299: Replace token store in MW OAuth WCQS proxy with JWT

Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T290299 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: ttaylor, CBogen, Gehel, Aklapper, Zache, BPirkle, sdkim, hnowlan, RKemper, Zbyszko, Invadibot

[Wikidata-bugs] [Maniphest] T288231: Deploy the wdqs streaming updater to production

Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T288231 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: RKemper, Aklapper, dcausse, Suran38, Biggs657, Invadibot, Lalamarie69, MPhamWMF, maantietaja

[Wikidata-bugs] [Maniphest] T293462: Add user blocking in WCQS

Zbyszko created this task. Zbyszko added a project: Wikidata-Query-Service. Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION As a WCQS maintainer I want to be able to block specific users so that I can have a quick way of blocking actions that threaten the stability of

[Wikidata-bugs] [Maniphest] T288231: Deploy the wdqs streaming updater to production

Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T288231 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: elukey, Zbyszko, RKemper, Aklapper, dcausse, Suran38, Biggs657, Invadibot, Lalamarie69, MPhamWMF

[Wikidata-bugs] [Maniphest] T293638: Create and update the process for separate WCQS mutation topic

Zbyszko created this task. Zbyszko added projects: Wikidata, Wikidata-Query-Service. Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION Currently, WDQS is being updated with streaming updater, using a topic that connects streaming updater producer with consumers. It was

[Wikidata-bugs] [Maniphest] T293027: Create metrics for measuring WDQS/WCQS update lag

Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T293027 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: RKemper, Aklapper, MPhamWMF, Invadibot, maantietaja, CBogen, Akuckartz, Nandana, Namenlos314

[Wikidata-bugs] [Maniphest] T293027: Create metrics for measuring WDQS/WCQS update lag

Zbyszko claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T293027 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: RKemper, Aklapper, MPhamWMF, Invadibot, maantietaja, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86

[Wikidata-bugs] [Maniphest] T294025: WDQS lag is usually longer than one minute

Zbyszko added a comment. Thanks for bringing this up, we haven't explain that part very well yet. Goal of the new updater wasn't to have a best case scenario latency lower than on the old updater. Goal was to eliminate few issues of the old ones, like: - low throughput,

[Wikidata-bugs] [Maniphest] T293027: Create metrics for measuring WDQS/WCQS update lag

Zbyszko added a comment. Here's a proposal for an SLO dashboard, that can use historical data to provide insight into the past performance: https://grafana-rw.wikimedia.org/d/yCBd7Tdnk/wdqs-lag-slo TASK DETAIL https://phabricator.wikimedia.org/T293027 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T294025: WDQS lag is usually longer than one minute

Zbyszko closed this task as "Resolved". Zbyszko claimed this task. Zbyszko added a comment. More information provided on wikidata-tech,wikidata mailing lists - https://lists.wikimedia.org/hyperkitty/list/wikidata-t...@lists.wikimedia.org/thread/O5UWOENIEDA2GJSDBL3MEBBFH7ZPXFNY/ T

[Wikidata-bugs] [Maniphest] T295676: Redirect to previous URL after auth redirect in WCQS

Zbyszko created this task. Zbyszko added a project: Wikidata-Query-Service. Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION As a WCQS user I want to get redirected to the url I started with if I need to authenticate first, so that I don't need to enter the URL

[Wikidata-bugs] [Maniphest] T280485: Additional capacity on the k8s Flink cluster for WCQS updater

Zbyszko added a comment. Sorry all for the confusion my typo caused, different name for that magnitude in my native language is confusing me my whole life :). TASK DETAIL https://phabricator.wikimedia.org/T280485 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel

[Wikidata-bugs] [Maniphest] T296466: Add MCR filtering to Streaming Updater for WCQS

Zbyszko created this task. Zbyszko added projects: Wikidata, Wikidata-Query-Service, Discovery-Search (Current work). TASK DESCRIPTION As a WCQS maintainer I want only SDC related revisions to be processed by the streaming updater, so that we won't handle events that will not chang

[Wikidata-bugs] [Maniphest] T296468: Modify flink-job.py script to handle WCQS streaming updater deployment

Zbyszko created this task. Zbyszko added projects: Wikidata, Wikidata-Query-Service, Discovery-Search (Current work). TASK DESCRIPTION As a WCQS maintainter I want to be able to deploy WCQS streaming updater the same way as it is being done for WDQS. Flink job deployment script (flink

[Wikidata-bugs] [Maniphest] T296470: Initialize WCQS production servers

Zbyszko created this task. Zbyszko added projects: Wikidata, Wikidata-Query-Service, Discovery-Search (Current work). TASK DESCRIPTION This ticket is for tracking final deployment steps for WCQS production. This does not include exposing the service to a general public, only steps to ensure

[Wikidata-bugs] [Maniphest] T296470: Initialize WCQS production servers

Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T296470 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Aklapper, Zbyszko, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, Namenlos314

[Wikidata-bugs] [Maniphest] T296466: Add MCR filtering to Streaming Updater for WCQS

Zbyszko claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T296466 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Aklapper, Zbyszko, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86

[Wikidata-bugs] [Maniphest] T296470: Initialize WCQS production servers

Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T296470 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Aklapper, Zbyszko, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, Namenlos314

[Wikidata-bugs] [Maniphest] T296470: Initialize WCQS production servers

Zbyszko added a subscriber: Ottomata. Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T296470 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Ottomata, Aklapper, Zbyszko, Invadibot, MPhamWMF

[Wikidata-bugs] [Maniphest] T296470: Initialize WCQS production servers

Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T296470 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Ottomata, Aklapper, Zbyszko, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana

[Wikidata-bugs] [Maniphest] T296470: Initialize WCQS production servers

Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T296470 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Ottomata, Aklapper, Zbyszko, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana

[Wikidata-bugs] [Maniphest] T296470: Initialize WCQS production servers

Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T296470 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: bking, EBernhardson, Ottomata, Aklapper, Zbyszko, Invadibot, MPhamWMF, maantietaja, CBogen

[Wikidata-bugs] [Maniphest] T296470: Initialize WCQS production servers

Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T296470 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: bking, EBernhardson, Ottomata, Aklapper, Zbyszko, Invadibot, MPhamWMF, maantietaja, CBogen

[Wikidata-bugs] [Maniphest] T296470: Initialize WCQS production servers

Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T296470 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: RKemper, bking, EBernhardson, Ottomata, Aklapper, Zbyszko, Invadibot, MPhamWMF, maantietaja

[Wikidata-bugs] [Maniphest] T296470: Initialize WCQS production servers

Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T296470 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: RKemper, bking, EBernhardson, Ottomata, Aklapper, Zbyszko, Invadibot, MPhamWMF, maantietaja

[Wikidata-bugs] [Maniphest] T299062: Save stats from wcqs-beta

Zbyszko claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T299062 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Aklapper, Gehel, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86

[Wikidata-bugs] [Maniphest] T299062: Save stats from wcqs-beta

Zbyszko added a comment. Based on nginx logs (which are kept over two weeks) - https://drive.google.com/drive/u/0/folders/1ojrcehL7Bz0Cc4wKgdtD8CccruNK8lyh A very convoluted command I used to extract this (from within /var/log/nginx), note Jan and Feb substitutions, they work better for

[Wikidata-bugs] [Maniphest] T299062: Save stats from wcqs-beta

Zbyszko added a comment. Putting in waiting to mark the need of repeating the process in two weeks. TASK DETAIL https://phabricator.wikimedia.org/T299062 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Aklapper, Gehel, Invadibot

[Wikidata-bugs] [Maniphest] T287865: Review documentation - API and related

Zbyszko added a subscriber: Cparle. Zbyszko added a comment. We seem to be missing the docs on MoreLikeThis. It would be nice to get MediaSearch API documentation as well, if available - @Cparle is it? TASK DETAIL https://phabricator.wikimedia.org/T287865 EMAIL PREFERENCES https

[Wikidata-bugs] [Maniphest] T301255: Adapt QueryBuilder for Wikimedia Commons Query

Zbyszko created this task. Zbyszko added projects: Wikidata, Wikidata Query UI. Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION Currently - QueryBuilder is only working for WDQS - not only link on commons-query.wikimedia.org points to that of wikidata.org, but query

[Wikidata-bugs] [Maniphest] T301650: WCQS "Application Connection Error" E009

Zbyszko claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T301650 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Aklapper, Dominicbm, Invadibot, MPhamWMF, maantietaja, FRomeo_WMF, CBogen, Nintendofan885, Akuckartz

[Wikidata-bugs] [Maniphest] T301650: WCQS "Application Connection Error" E009

Zbyszko added a comment. @Dominicbm thanks for submitting this. I'm having issues reproducing your problem - can you reliably reproduce it on your end and post a step by step instruction here? TASK DETAIL https://phabricator.wikimedia.org/T301650 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T301953: Investigate wdqs1013 stability issues

Zbyszko created this task. Zbyszko added a project: Wikidata-Query-Service. Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION According to this graph: https://grafana.wikimedia.org/d/00489/wikidata-query-service?viewPanel=36&orgId=1&refresh=1m&var-clust

[Wikidata-bugs] [Maniphest] T299062: Save stats from wcqs-beta

Zbyszko added a comment. Data uploaded. TASK DETAIL https://phabricator.wikimedia.org/T299062 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Aklapper, Gehel, karapayneWMDE, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz

[Wikidata-bugs] [Maniphest] T284040: Enable blank node skolemization on wcqs

Zbyszko claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T284040 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Aklapper, Multichill, dcausse, Invadibot, Lalamarie69, MPhamWMF, maantietaja, Alter-paule, Beast1978, CBogen

[Wikidata-bugs] [Maniphest] T264006: Deploy Flink (rdf-streaming-updater) to kubernetes (k8s)

Zbyszko added a comment. @jijiki Great, thank you! TASK DETAIL https://phabricator.wikimedia.org/T264006 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: jijiki, dcausse, Zbyszko, akosiaris, Mstyles, Gehel, Aklapper, Biggs657

[Wikidata-bugs] [Maniphest] T286938: Create a plan for a final streaming updater rollout as source of truth for blazegraph instances

Zbyszko created this task. Zbyszko added projects: Wikidata-Query-Service, Wikidata, Discovery-Search (Current work). Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION As a streaming updater deployer I want to have a plan for the production rollout so that the production

[Wikidata-bugs] [Maniphest] T273901: Automate event stream ingestion into HDFS for streams that don't use EventGate

Zbyszko added a comment. @Ottomata can this be closed? TASK DETAIL https://phabricator.wikimedia.org/T273901 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Ottomata, Zbyszko Cc: Zbyszko, Mholloway, MPhamWMF, Gehel, Aklapper, JAllemandou, dcausse

[Wikidata-bugs] [Maniphest] T262676: Make the pipeline more robust when backfilling data generated during a DC switch

Zbyszko closed this task as "Declined". Zbyszko added a comment. Issue is no longer valid. TASK DETAIL https://phabricator.wikimedia.org/T262676 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Zbyszko, dcausse, Aklapper,

[Wikidata-bugs] [Maniphest] T244590: [Epic] Rework the WDQS updater as an event driven application

Zbyszko closed subtask T262676: Make the pipeline more robust when backfilling data generated during a DC switch as "Declined". TASK DETAIL https://phabricator.wikimedia.org/T244590 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To:

[Wikidata-bugs] [Maniphest] T247058: Deployment strategy and hardware requirement for new Flink based WDQS updater

Zbyszko closed this task as "Resolved". Zbyszko claimed this task. Zbyszko added a comment. Strategy was developed and is being implemented. TASK DETAIL https://phabricator.wikimedia.org/T247058 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailprefer

[Wikidata-bugs] [Maniphest] T244590: [Epic] Rework the WDQS updater as an event driven application

Zbyszko closed subtask T247058: Deployment strategy and hardware requirement for new Flink based WDQS updater as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T244590 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc

[Wikidata-bugs] [Maniphest] T273901: Automate event stream ingestion into HDFS for streams that don't use EventGate

Zbyszko added a comment. @Ottomata thanks! TASK DETAIL https://phabricator.wikimedia.org/T273901 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Ottomata, Zbyszko Cc: Zbyszko, Mholloway, MPhamWMF, Gehel, Aklapper, JAllemandou, dcausse, Mstyles

[Wikidata-bugs] [Maniphest] T287865: Review documentation - API and related

Zbyszko created this task. Zbyszko added projects: Documentation, Wikidata, Discovery-Search. Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION As a search API user I'd like to have a relevant documentation on how to use Search APIs and features so that I know h

[Wikidata-bugs] [Maniphest] T287865: Review documentation - API and related

Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T287865 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Aklapper, Zbyszko, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, apaskulin, Nandana

[Wikidata-bugs] [Maniphest] T287969: Flink SwiftTempAuth reports IllegalAccessError when running with java 11

Zbyszko claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T287969 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Zbyszko, Aklapper, dcausse, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, Namenlos314, Lahi

[Wikidata-bugs] [Maniphest] T287969: Flink SwiftTempAuth reports IllegalAccessError when running with java 11

Zbyszko triaged this task as "High" priority. TASK DETAIL https://phabricator.wikimedia.org/T287969 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Zbyszko, Aklapper, dcausse, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckart

[Wikidata-bugs] [Maniphest] T287969: Flink SwiftTempAuth reports IllegalAccessError when running with java 11

Zbyszko moved this task from All WDQS-related tasks to Current work on the Wikidata-Query-Service board. Zbyszko added a project: Discovery-Search (Current work). TASK DETAIL https://phabricator.wikimedia.org/T287969 WORKBOARD https://phabricator.wikimedia.org/project/board/891/ EMAIL

[Wikidata-bugs] [Maniphest] T260568: [EPIC] Productionize WCQS

Zbyszko added a project: Discovery-Search (Current work). TASK DETAIL https://phabricator.wikimedia.org/T260568 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Fuzheado, Zache, ttaylor, CBogen, Gehel, Aklapper, Invadibot, MPhamWMF

[Wikidata-bugs] [Maniphest] T288230: Promote MediaInfo RDF format to stable

Zbyszko created this task. Zbyszko added projects: Wikidata, Wikidata-Query-Service. Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION As a WCQS users I want to have a stable reference for MediaInfo RDF format so that I can reference it when using the service and be sure

[Wikidata-bugs] [Maniphest] T288531: Flink job failing in Kubernetes with more than 1 task manager

Zbyszko created this task. Zbyszko added projects: Wikidata-Query-Service, Discovery-Search (Current work). Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION Kubernetes deployment of flink and job fails when there are at least 2 task managers, which would suggest issues

[Wikidata-bugs] [Maniphest] T280485: Additional capacity on the k8s Flink cluster for WCQS updater

Zbyszko claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T280485 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Aklapper, RKemper, Gehel, MPhamWMF, wkandek, JMeybohm, CBogen, Namenlos314, jijiki, Gq86

[Wikidata-bugs] [Maniphest] T280485: Additional capacity on the k8s Flink cluster for WCQS updater

Zbyszko added a comment. The most important parameter to streaming updater is related to storage - we have a huge surplus of computing resources in WDQS streaming updater, since edit rate is much lower in SDoC, there is no risk when it comes to throughput. The storage needs on the other

[Wikidata-bugs] [Maniphest] T282117: Set up WCQS top level wikimedia domain

Zbyszko renamed this task from "Set up WCQS top level wikimedia project" to "Set up WCQS top level wikimedia domain". TASK DETAIL https://phabricator.wikimedia.org/T282117 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszk

[Wikidata-bugs] [Maniphest] T280006: Set up the application authentication for WCQS on commons-query.wikimedia.org

Zbyszko added a comment. Plan right now assumes that WCQS API will be provided via https://api.wikimedia.org/ <https://api.wikimedia.org/> - technical feasibility is still to be assessed. This will allow us to provide an OAuth 2.0 flow and standardised experience similar to other

[Wikidata-bugs] [Maniphest] T262265: Provide real-time updates for WCQS

Zbyszko claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T262265 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: So9q, Salgo60, Gehel, Aklapper, Zbyszko, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana

[Wikidata-bugs] [Maniphest] T288230: Promote MediaInfo RDF format to stable

Zbyszko added subscribers: Cparle, LucasWerkmeister, Lydia_Pintscher. Zbyszko added a comment. @Lydia_Pintscher, @LucasWerkmeister, just to confirm(or the opposite) what we discussed in email thread - only thing required here is the doc update? @Cparle - this is probably of interest to SD

[Wikidata-bugs] [Maniphest] T276469: Cookbooks and / or operation procedures are adapted for the new Flink based WDQS Streaming Updater

Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T276469 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: dcausse, Aklapper, Gehel, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana

[Wikidata-bugs] [Maniphest] T280006: Set up the application authentication for WCQS on commons-query.wikimedia.org

Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T280006 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: RKemper, hnowlan, sdkim, BPirkle, Zache, Aklapper, Gehel, CBogen, ttaylor, Zbyszko, Invadibot

[Wikidata-bugs] [Maniphest] T290299: Replace token store in MW OAuth WCQS proxy with JWT

Zbyszko created this task. Zbyszko added projects: Wikidata, Wikidata-Query-Service, Discovery-Search (Current work). TASK DESCRIPTION As a WCQS maintainer I want to simplify MW OAuth Proxy for WCQS so it won't require a cache of tokens so that they aren't invalidated before th

[Wikidata-bugs] [Maniphest] T290300: Serve WCQS Sparql endpoint through api.wikimedia.org with OAuth 2

Zbyszko created this task. Zbyszko added projects: Wikidata, Wikidata-Query-Service, Discovery-Search (Current work). TASK DESCRIPTION As an external/bot developer I want to be able to authenticate with WCQS via my application/bot so that it can use the the service without human interaction

[Wikidata-bugs] [Maniphest] T262265: Provide real-time updates for WCQS

Zbyszko reassigned this task from Zbyszko to EBernhardson. TASK DETAIL https://phabricator.wikimedia.org/T262265 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: EBernhardson, Zbyszko Cc: Back_ache, So9q, Salgo60, Gehel, Aklapper, Zbyszko, Invadibot

[Wikidata-bugs] [Maniphest] T276469: Cookbooks and / or operation procedures are adapted for the new Flink based WDQS Streaming Updater

Zbyszko claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T276469 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: dcausse, Aklapper, Gehel, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, Namenlos314, Lahi

[Wikidata-bugs] [Maniphest] T280006: Set up the application authentication for WCQS on commons-query.wikimedia.org

Zbyszko added a comment. We should figure out who is the holder of the auth consumer - we probably should have a service account for mediawiki TASK DETAIL https://phabricator.wikimedia.org/T280006 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To

[Wikidata-bugs] [Maniphest] T290300: Serve WCQS Sparql endpoint through api.wikimedia.org with OAuth 2

Zbyszko added a comment. @LucasWerkmeister current WCQS-beta behaviour is a bug - sparql endpoint should be authenticated as well, not only UI (we created a ticket for that - T290889 <https://phabricator.wikimedia.org/T290889>) . Production WCQS will start with the authentication alre

[Wikidata-bugs] [Maniphest] T261119: Architecture review of Flink based WDQS Streaming Updater

Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T261119 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Aklapper, Zbyszko, dcausse, Gehel, MPhamWMF, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86

[Wikidata-bugs] [Maniphest] T269451: Possible flink optimizations/cleanups

Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T269451 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: dcausse, Aklapper, MPhamWMF, Alter-paule, Beast1978, CBogen, Un1tY, Akuckartz, Hook696, Kent7301

[Wikidata-bugs] [Maniphest] T267825: Outdated data still present in WCQS a month after statement update

Zbyszko added a comment. Issue was fixed manually for now - I'll do a proper deployment once I get some time to deal with recent microsite GUI changes. TASK DETAIL https://phabricator.wikimedia.org/T267825 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/

[Wikidata-bugs] [Maniphest] T269451: Possible flink optimizations/cleanups

Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T269451 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: dcausse, Aklapper, MPhamWMF, Alter-paule, Beast1978, CBogen, Un1tY, Akuckartz, Hook696, Kent7301

[Wikidata-bugs] [Maniphest] T267310: Allow job name configuration for Streaming Updater

Zbyszko claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T267310 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Aklapper, Zbyszko, MPhamWMF, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE

[Wikidata-bugs] [Maniphest] T273735: Migrate Streaming Updater to newer Scala version

Zbyszko created this task. Zbyszko added a project: Wikidata-Query-Service. Restricted Application added a subscriber: Aklapper. Restricted Application added a project: Wikidata. TASK DESCRIPTION As a Streaming Updater maintainter I want to be able to compile and run streaming updater on newer

[Wikidata-bugs] [Maniphest] T273735: Migrate Streaming Updater to newer Scala version

Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T273735 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Aklapper, Zbyszko, MPhamWMF, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86

[Wikidata-bugs] [Maniphest] T269331: wdqs.data-reload cookbook fails when deleting the old namespace

Zbyszko claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T269331 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: RKemper, dcausse, Aklapper, MPhamWMF, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86

[Wikidata-bugs] [Maniphest] T269302: Many files on Commons cannot be found in WCQS

Zbyszko claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T269302 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: CBogen, Lydia_Pintscher, Vojtech.dostal, Dipsacus_fullonum, Aklapper, GFontenelle_WMF, MPhamWMF, FRomeo_WMF

[Wikidata-bugs] [Maniphest] T269302: Many files on Commons cannot be found in WCQS

Zbyszko added a comment. First M-entity mentioned in the ticket was missing because there was a bug with weekly reloads, that has now been fixed - entries added before the reload should be available. As for the second part of the ticket - sdc has uri encoded contentUrl (although

[Wikidata-bugs] [Maniphest] T276469: Cookbooks and / or operation procedures are adapted for the new Flink based WDQS Streaming Updater

Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T276469 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Aklapper, Gehel, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86

[Wikidata-bugs] [Maniphest] T280001: Set up puppet configuration for new WCQS cluster

Zbyszko created this task. Zbyszko added projects: Wikidata, Wikidata-Query-Service. Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION As a WCQS maintainer I want new instances of WCQS to be configurable via Puppet so I can efficiently maintain a WCQS production cluster

[Wikidata-bugs] [Maniphest] T280001: Set up puppet configuration for new WCQS cluster

Zbyszko added a parent task: T260568: [EPIC] Productionize WCQS. TASK DETAIL https://phabricator.wikimedia.org/T280001 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Aklapper, Zbyszko, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz

[Wikidata-bugs] [Maniphest] T260568: [EPIC] Productionize WCQS

Zbyszko added a subtask: T280001: Set up puppet configuration for new WCQS cluster. TASK DETAIL https://phabricator.wikimedia.org/T260568 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: ttaylor, CBogen, Gehel, Aklapper, Invadibot

[Wikidata-bugs] [Maniphest] T280006: Set up the application authentication for WCQS

Zbyszko created this task. Zbyszko added projects: Wikidata, Epic, Wikidata-Query-Service. TASK DESCRIPTION As an external/bot developer I want to be able to authenticate with WCQS via my application/bot so that it can use the the service without human interaction. Beta WCQS is currently

[Wikidata-bugs] [Maniphest] T280008: Set up WCQS monitoring

Zbyszko created this task. Zbyszko added projects: Wikidata, Epic, Wikidata-Query-Service. TASK DESCRIPTION As a WCQS maintainer I want to be able to monitor WCQS performance so I can verify if service is working correctly. We can go with almost exactly the things we monitor for WDQS. It

[Wikidata-bugs] [Maniphest] T280247: Create WCQS UI microsite deployment

Zbyszko created this task. Zbyszko added projects: Wikidata, Epic, Wikidata-Query-Service. TASK DESCRIPTION As a WCQS maintainer I want to have a deployment process for WCQS UI that requires fewest manual steps. WDQS UI is deployed as a microsite (see details here T266702 <ht

[Wikidata-bugs] [Maniphest] T280247: Create WCQS UI microsite deployment

Zbyszko added a comment. On Tue, 13 Apr 2021 at 11:52, Zbyszko Papierski wrote: Hi, We're about to start to push WCQS to production and I need to have some info on how to work with the current WDQS GUI. It was decided that the code will remain the same for both WCQS and WDQS

[Wikidata-bugs] [Maniphest] T280247: Create WCQS UI microsite deployment

Zbyszko removed a project: Epic. TASK DETAIL https://phabricator.wikimedia.org/T280247 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Aklapper, Gehel, CBogen, ttaylor, Zbyszko, Invadibot, MPhamWMF, maantietaja, Akuckartz, Nandana

[Wikidata-bugs] [Maniphest] T280247: Create WCQS UI microsite deployment

Zbyszko updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T280247 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Aklapper, Gehel, CBogen, ttaylor, Zbyszko, Invadibot, MPhamWMF, maantietaja, NavinRizwi

[Wikidata-bugs] [Maniphest] T280008: Set up WCQS monitoring

Zbyszko removed a project: Epic. TASK DETAIL https://phabricator.wikimedia.org/T280008 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko Cc: Aklapper, Gehel, CBogen, ttaylor, Zbyszko, Invadibot, MPhamWMF, maantietaja, Akuckartz, Nandana

[Wikidata-bugs] [Maniphest] T280006: Set up the application authentication for WCQS

<    1   2   3   4   >