[Wikidata-bugs] [Maniphest] T246004: Spike: Can/should Swift be used as Flink checkpoint backend?

Gehel closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T246004 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko, Gehel Cc: elukey, EBernhardson, JMeybohm, fgiunchedi, CBogen, #analytics, dcausse, Gehe

[Wikidata-bugs] [Maniphest] T244590: [Epic] Rework the WDQS updater as an event driven application

Gehel closed subtask T246004: Spike: Can/should Swift be used as Flink checkpoint backend? as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T244590 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Thadguidry, tfmorris, revi

[Wikidata-bugs] [Maniphest] T246004: Spike: Can/should Swift be used as Flink checkpoint backend?

Gehel updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T246004 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko, Gehel Cc: elukey, EBernhardson, JMeybohm, fgiunchedi, CBogen, #analytics, dcausse, Gehel, Zbyszko

[Wikidata-bugs] [Maniphest] T257045: [Epic] Better understanding of WDQS users and use cases

Gehel closed subtask T264447: Examine cases where Blazegraph generates results that timeout and don’t make it back to the user as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T257045 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel

[Wikidata-bugs] [Maniphest] T264194: Examine WDQS queries for intent

Gehel closed subtask T264447: Examine cases where Blazegraph generates results that timeout and don’t make it back to the user as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T264194 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences

[Wikidata-bugs] [Maniphest] T264447: Examine cases where Blazegraph generates results that timeout and don’t make it back to the user

Gehel closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T264447 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko, Gehel Cc: CBogen, Lydia_Pintscher, JAllemandou, Gehel, Aklapper, MPhamWMF, Akuckartz

[Wikidata-bugs] [Maniphest] T221632: Storage capacity upgrade for WDQS

Gehel closed subtask T246345: Service implementation on wdqs101[1-3].eqiad.wmnet as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T221632 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: wiki_willy, mark, RobH, faidon, Smalyshev

[Wikidata-bugs] [Maniphest] T246345: Service implementation on wdqs101[1-3].eqiad.wmnet

Gehel closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T246345 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper, Gehel Cc: Mathew.onipe, Smalyshev, Gehel, Aklapper, MPhamWMF, CBogen, Akuckartz

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

Gehel closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T269204 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper, Gehel Cc: Gehel, RKemper, dcausse, Aklapper, MPhamWMF, lmata, CBogen, Akuckartz

[Wikidata-bugs] [Maniphest] T269872: wdqs-categories prometheus exporter failing on select wdqs instances

Gehel closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T269872 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper, Gehel Cc: Gehel, RKemper, Aklapper, MPhamWMF, CBogen, Akuckartz, Nandana, Namenlos314,

[Wikidata-bugs] [Maniphest] T270236: wdqs1005: disk space critical on /srv/

Gehel closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T270236 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Gehel, Aklapper, RKemper, MPhamWMF, CBogen, Akuckartz, Nandana, Namenlos314,

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

Gehel closed subtask T244753: Migrate WDQS to Debian Buster as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T269204 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper, Gehel Cc: Gehel, RKemper, dcausse, Aklapper, MPhamWMF, lmata

[Wikidata-bugs] [Maniphest] T244753: Migrate WDQS to Debian Buster

Gehel closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T244753 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper, Gehel Cc: Aklapper, MoritzMuehlenhoff, Gehel, Ramtin0071, MPhamWMF, Devnull, lmata,

[Wikidata-bugs] [Maniphest] T269876: Add swift plugin to Flink k8s

Gehel assigned this task to Mstyles. TASK DETAIL https://phabricator.wikimedia.org/T269876 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Mstyles, Gehel Cc: Aklapper, Gehel, Mstyles, MPhamWMF, Alter-paule, Beast1978, CBogen, Un1tY, Akuckartz

[Wikidata-bugs] [Maniphest] T270476: Linked Data Fragments endpoint returns IllegalStateException

Gehel created this task. Gehel added a project: Wikidata-Query-Service. Restricted Application added a subscriber: Aklapper. Restricted Application added a project: Wikidata. TASK DESCRIPTION As received on wikidata ML <https://lists.wikimedia.org/pipermail/wikidata/2020-December/014420.h

[Wikidata-bugs] [Maniphest] T270236: wdqs1005: disk space critical on /srv/

Gehel moved this task from In Progress to Needs Reporting on the Discovery-Search (Current work) board. Gehel added a comment. data reload completed on wdqs1007 TASK DETAIL https://phabricator.wikimedia.org/T270236 WORKBOARD https://phabricator.wikimedia.org/project/board/1227/ EMAIL

[Wikidata-bugs] [Maniphest] T270236: wdqs1005: disk space critical on /srv/

Gehel moved this task from Incoming to In Progress on the Discovery-Search (Current work) board. Gehel claimed this task. Gehel added a comment. Data reloaded on wdqs1005, reload in progress for wdqs1007 which has a similar issue. TASK DETAIL https://phabricator.wikimedia.org/T270236

[Wikidata-bugs] [Maniphest] T267029: The streaming-updater-producer should handle backfills gracefully

Gehel closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T267029 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: dcausse, Gehel Cc: dcausse, Aklapper, CBogen, Akuckartz, Nandana, Namenlos314,

[Wikidata-bugs] [Maniphest] T264006: Deploy Flink to kubernetes (k8s)

Gehel closed subtask T265504: Create Blubberfile in WDQS repo as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T264006 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Mstyles, Gehel, Aklapper, CBogen, Akuckartz, Nandana

[Wikidata-bugs] [Maniphest] T265504: Create Blubberfile in WDQS repo

Gehel closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T265504 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Mstyles, Gehel Cc: hashar, Zbyszko, akosiaris, Ottomata, dcausse, Aklapper, Gehel, Mstyles, A

[Wikidata-bugs] [Maniphest] T255657: Strange result in Wikidata query (full URLs given instead of identifiers)

Gehel closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T255657 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: dcausse, Gehel Cc: VladimirAlexiev, dcausse, Nikki, Lucas_Werkmeister_WMDE, Aklapper, Epidosis, A

[Wikidata-bugs] [Maniphest] T259588: Reload categories once 1.36.0-wmf.3 is running on all groups

Gehel closed this task as "Resolved". Gehel claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T259588 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: RKemper, dcausse, Aklapper, Wilmanbeno, CBogen, Akuckart

[Wikidata-bugs] [Maniphest] T264006: Deploy Flink to kubernetes (k8s)

Gehel closed subtask T265512: Set up Pipeline Configuration in WDQS repo as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T264006 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Mstyles, Gehel, Aklapper, CBogen, Akuckartz

[Wikidata-bugs] [Maniphest] T265512: Set up Pipeline Configuration in WDQS repo

Gehel closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T265512 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Mstyles, Gehel Cc: dcausse, dduvall, jeena, akosiaris, Aklapper, Gehel, Mstyles, Alter-paule,

[Wikidata-bugs] [Maniphest] T269872: wdqs-categories prometheus exporter failing on select wdqs instances

Gehel triaged this task as "High" priority. Gehel moved this task from Incoming to In Progress on the Discovery-Search (Current work) board. TASK DETAIL https://phabricator.wikimedia.org/T269872 WORKBOARD https://phabricator.wikimedia.org/project/board/1227/ EMAIL PREFERENC

[Wikidata-bugs] [Maniphest] T269872: wdqs-categories prometheus exporter failing on select wdqs instances

Gehel added a comment. Looking at the prometheus blazegraph exporter <https://github.com/wikimedia/puppet/blob/production/modules/query_service/files/monitor/prometheus-blazegraph-exporter.py#L45>, we seem to hardcode the "wdq" namespace, which isn't available for the catego

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

Gehel added a subtask: T269331: wdqs.data-reload cookbook fails when deleting the old namespace. TASK DETAIL https://phabricator.wikimedia.org/T269204 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper, Gehel Cc: Gehel, RKemper, dcausse

[Wikidata-bugs] [Maniphest] T269331: wdqs.data-reload cookbook fails when deleting the old namespace

Gehel added a parent task: T269204: Some wdqs metrics changed when switching to python3. TASK DETAIL https://phabricator.wikimedia.org/T269331 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: RKemper, dcausse, Aklapper, CBogen, Akuckartz

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

Gehel added a comment. Note that migrating WDQS to Buster is tracked in T244753 <https://phabricator.wikimedia.org/T244753> TASK DETAIL https://phabricator.wikimedia.org/T269204 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper, Ge

[Wikidata-bugs] [Maniphest] T244753: Migrate WDQS to Debian Buster

Gehel added a parent task: T269204: Some wdqs metrics changed when switching to python3. TASK DETAIL https://phabricator.wikimedia.org/T244753 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Aklapper, MoritzMuehlenhoff, Gehel, Devnull

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

Gehel added a subtask: T244753: Migrate WDQS to Debian Buster. TASK DETAIL https://phabricator.wikimedia.org/T269204 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper, Gehel Cc: Gehel, RKemper, dcausse, Aklapper, lmata, CBogen, Akuckartz

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

Gehel added a comment. We could also upgrade all nodes to buster. Since the new instances are already running on Buster, this should be easy enough (and needs to be done anyway). TASK DETAIL https://phabricator.wikimedia.org/T269204 EMAIL PREFERENCES https://phabricator.wikimedia.org

[Wikidata-bugs] [Maniphest] T264659: Update BAG & BRT SPARQL endpoint in the whitelist

Gehel closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T264659 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko, Gehel Cc: Gehel, Denengelse, RhinosF1, Aklapper, Multichill, CBogen, Akuckartz, CptVi

[Wikidata-bugs] [Maniphest] T265512: Set up Pipeline Configuration in WDQS repo

Gehel added a comment. A few additional notes / context in no particular order: `streaming-updater-producer` is strongly coupled with the rest of the wikidata/query/rdf project. It might be possible to externalize it to it's own repo, but it will still have dependencies on the rest

[Wikidata-bugs] [Maniphest] T244590: [Epic] Rework the WDQS updater as an event driven application

Gehel closed subtask T266750: The streaming updater consumer should stop accumulating patches if it cannot handle them as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T244590 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc

[Wikidata-bugs] [Maniphest] T266750: The streaming updater consumer should stop accumulating patches if it cannot handle them

Gehel closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T266750 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: dcausse, Gehel Cc: Aklapper, dcausse, CBogen, Akuckartz, Nandana, Namenlos314,

[Wikidata-bugs] [Maniphest] T266751: The streaming updater should identify all shared statements properly

Gehel closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T266751 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: dcausse, Gehel Cc: dcausse, Aklapper, CBogen, Akuckartz, Nandana, Namenlos314,

[Wikidata-bugs] [Maniphest] T244590: [Epic] Rework the WDQS updater as an event driven application

Gehel closed subtask T255399: Prepare wdqs1009 to run the streaming updater as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T244590 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Thadguidry, tfmorris, revi, Ladsgroup

[Wikidata-bugs] [Maniphest] T255399: Prepare wdqs1009 to run the streaming updater

Gehel closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T255399 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper, Gehel Cc: Gehel, Ottomata, Aklapper, dcausse, Alter-paule, Beast1978, CBogen, Un1tY,

[Wikidata-bugs] [Maniphest] T267924: WDQS Updater (based on recent changes) missed some updates

Gehel triaged this task as "Low" priority. TASK DETAIL https://phabricator.wikimedia.org/T267924 WORKBOARD https://phabricator.wikimedia.org/project/board/891/ EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Gehel, Aklappe

[Wikidata-bugs] [Maniphest] T267927: Reload wikidata journal from fresh dumps

Gehel triaged this task as "High" priority. TASK DETAIL https://phabricator.wikimedia.org/T267927 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Aklapper, dcausse, CBogen, Akuckartz, Nandana, Namenlos314,

[Wikidata-bugs] [Maniphest] T267924: WDQS Updater (based on recent changes) missed some updates

Gehel moved this task from All WDQS-related tasks to Tech Debt on the Wikidata-Query-Service board. Gehel added a comment. The data reload in T267927 <https://phabricator.wikimedia.org/T267927> will fix the actual issue. We are not going to fix the current updater, our focus is on mig

[Wikidata-bugs] [Maniphest] T267845: Create Wikibase Query Service output format for urlencoded SPARQL API request

Gehel closed this task as "Resolved". Gehel claimed this task. Gehel added a comment. Looking at the above comments, it looks like the Link menu is a good enough solution. If that's not the case, please reopen! TASK DETAIL https://phabricator.wikimedia.org/T267845 EMAIL P

[Wikidata-bugs] [Maniphest] T267644: Update Wikidata unit conversion config (normalized quantities)

Gehel added subscribers: Zbyszko, dcausse. Gehel added a comment. @dcausse / @Zbyszko : can you answer for the impact on the streaming updater? TASK DETAIL https://phabricator.wikimedia.org/T267644 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences

[Wikidata-bugs] [Maniphest] T266212: Wikidata autocomplete service should do token search and not prefix search

Gehel renamed this task from "improve Wikidata autocomplete service" to "Wikidata autocomplete service should do token search and not prefix search". TASK DETAIL https://phabricator.wikimedia.org/T266212 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/pa

[Wikidata-bugs] [Maniphest] T266212: improve Wikidata autocomplete service

Gehel moved this task from needs triage to Feature Requests on the Discovery-Search board. Gehel triaged this task as "Low" priority. TASK DETAIL https://phabricator.wikimedia.org/T266212 WORKBOARD https://phabricator.wikimedia.org/project/board/1849/ EMAIL PREFERENC

[Wikidata-bugs] [Maniphest] T267310: Allow job name configuration for Streaming Updater

Gehel added a parent task: T264006: Deploy Flink to kubernetes (k8s). TASK DETAIL https://phabricator.wikimedia.org/T267310 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Aklapper, Zbyszko, CBogen, Akuckartz, Nandana, Namenlos314, Lahi

[Wikidata-bugs] [Maniphest] T264006: Deploy Flink to kubernetes (k8s)

Gehel added a subtask: T267310: Allow job name configuration for Streaming Updater. TASK DETAIL https://phabricator.wikimedia.org/T264006 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Mstyles, Gehel, Aklapper, CBogen, Akuckartz, Nandana

[Wikidata-bugs] [Maniphest] T267175: SPARQL-Query shows entries, which should be filter out; number of entries in result set might change when executed repeatedly (possible caching/indexing problem)

Gehel added a comment. We'll need to do some investigation to see what kind of underlying bug is hiding here. We are planning a full data reload anyway, which should solve this. TASK DETAIL https://phabricator.wikimedia.org/T267175 EMAIL PREFERENCES https://phabricator.wikimedia.org

[Wikidata-bugs] [Maniphest] T267310: Allow job name configuration for Streaming Updater

Gehel moved this task from All WDQS-related tasks to Current work on the Wikidata-Query-Service board. Gehel added a project: Discovery-Search (Current work). TASK DETAIL https://phabricator.wikimedia.org/T267310 WORKBOARD https://phabricator.wikimedia.org/project/board/891/ EMAIL

[Wikidata-bugs] [Maniphest] T267310: Allow job name configuration for Streaming Updater

Gehel triaged this task as "High" priority. TASK DETAIL https://phabricator.wikimedia.org/T267310 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Aklapper, Zbyszko, CBogen, Akuckartz, Nandana, Namenlos314,

[Wikidata-bugs] [Maniphest] T267175: SPARQL-Query shows entries, which should be filter out; number of entries in result set might change when executed repeatedly (possible caching/indexing problem)

Gehel moved this task from All WDQS-related tasks to Current work on the Wikidata-Query-Service board. Gehel added a project: Discovery-Search (Current work). TASK DETAIL https://phabricator.wikimedia.org/T267175 WORKBOARD https://phabricator.wikimedia.org/project/board/891/ EMAIL

[Wikidata-bugs] [Maniphest] T267175: SPARQL-Query shows entries, which should be filter out; number of entries in result set might change when executed repeatedly (possible caching/indexing problem)

Gehel triaged this task as "High" priority. TASK DETAIL https://phabricator.wikimedia.org/T267175 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Lucas_Werkmeister_WMDE, Aklapper, M2k_dewiki, CBogen, Akuckartz, Nandana, Namenlo

[Wikidata-bugs] [Maniphest] T233204: Mixup of unicode characters in Query Service

Gehel moved this task from All WDQS-related tasks to Current work on the Wikidata-Query-Service board. Gehel added a project: Discovery-Search (Current work). TASK DETAIL https://phabricator.wikimedia.org/T233204 WORKBOARD https://phabricator.wikimedia.org/project/board/891/ EMAIL

[Wikidata-bugs] [Maniphest] T233204: Mixup of unicode characters in Query Service

Gehel raised the priority of this task from "Low" to "Medium". TASK DETAIL https://phabricator.wikimedia.org/T233204 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Unjoanqualsevol, Nikki, CamelCaseNick,

[Wikidata-bugs] [Maniphest] T252124: Scap configuration for WDQS should get server groups from a known source or truth

Gehel closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T252124 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko, Gehel Cc: thcipriani, Aklapper, RKemper, Gehel, Devnull, lmata, CBogen, Akuckartz, Lega

[Wikidata-bugs] [Maniphest] T264042: Query service returns weird Commons links when asking for P50 (author) statement value

Gehel closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T264042 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko, Gehel Cc: Zbyszko, CBogen, Lucas_Werkmeister_WMDE, Aklapper, matej_suchanek, Vojtech.dos

[Wikidata-bugs] [Maniphest] T262828: Near zero downtime Data reload for WCQS

Gehel closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T262828 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko, Gehel Cc: Gehel, Bugreporter, Aklapper, Zbyszko, Alter-paule, Beast1978, CBogen, Un1tY,

[Wikidata-bugs] [Maniphest] T251488: [epic] Create minimal SPARQL Endpoint for Commons on WMCS

Gehel closed subtask T262828: Near zero downtime Data reload for WCQS as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T251488 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: BeatEstermann, Poyekhali, Steinsplitter

[Wikidata-bugs] [Maniphest] T261937: Add CPU load and query concurrency as context to event logging from WDQS

Gehel closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T261937 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko, Gehel Cc: Zbyszko, JAllemandou, Aklapper, Gehel, CBogen, Akuckartz, Nandana, Namenlos314,

[Wikidata-bugs] [Maniphest] T244590: [Epic] Rework the WDQS updater as an event driven application

Gehel closed subtask T256882: The streaming updater should support page undeletes as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T244590 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Thadguidry, tfmorris, revi, Ladsgroup

[Wikidata-bugs] [Maniphest] T256882: The streaming updater should support page undeletes

Gehel closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T256882 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko, Gehel Cc: Aklapper, dcausse, CBogen, Akuckartz, Nandana, Namenlos314,

[Wikidata-bugs] [Maniphest] T257045: [Epic] Better understanding of WDQS users and use cases

Gehel closed subtask T261937: Add CPU load and query concurrency as context to event logging from WDQS as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T257045 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: GoranSMilovanovic

[Wikidata-bugs] [Maniphest] T244590: [Epic] Rework the WDQS updater as an event driven application

Gehel closed subtask T265452: Add a configurable restart strategy to the streaming updater as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T244590 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Thadguidry, tfmorris, revi

[Wikidata-bugs] [Maniphest] T263952: mwapi calls rarely return results

Gehel closed this task as "Resolved". Gehel added a comment. This should be resolved, but hard to reproduce, so hard to test. Feel free to reopen if the error occurs again. TASK DETAIL https://phabricator.wikimedia.org/T263952 EMAIL PREFERENCES https://phabricator.wikimedia.or

[Wikidata-bugs] [Maniphest] T265452: Add a configurable restart strategy to the streaming updater

Gehel closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T265452 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: dcausse, Gehel Cc: Aklapper, dcausse, CBogen, Akuckartz, Nandana, Namenlos314,

[Wikidata-bugs] [Maniphest] T266318: Clarify dependencies on codehale dropwizards

Gehel closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T266318 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko, Gehel Cc: dcausse, Aklapper, CBogen, Akuckartz, Nandana, Namenlos314,

[Wikidata-bugs] [Maniphest] T244590: [Epic] Rework the WDQS updater as an event driven application

Gehel closed subtask T266318: Clarify dependencies on codehale dropwizards as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T244590 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Thadguidry, tfmorris, revi, Ladsgroup, Multichill

[Wikidata-bugs] [Maniphest] T266470: Expose wdqs1009 to wdqs users and gather feedback

Gehel added a comment. This task is about exposing wdqs1009 as a test server to the internet. This needs a new DNS entry, configuration of the caching / routing layer and communication with the traffic team. TASK DETAIL https://phabricator.wikimedia.org/T266470 EMAIL PREFERENCES https

[Wikidata-bugs] [Maniphest] T239931: Reduce the impact of the sanitizer on wikidata

Gehel removed projects: Wikibase wb_terms leftovers 2020, Wikidata-Campsite (Wikidata-Campsite-Iteration-∞). Gehel added a comment. Saneitizer is running slower than usual at the moment, this needs to be investigated first. See T266762 <https://phabricator.wikimedia.org/T266762> and r

[Wikidata-bugs] [Maniphest] T266827: New search keyword itemquality to get result from ORES

Gehel added a comment. A lot more work than just creating a keyword is needed to make this work. The item quality is not indexed at the moment (but it might make sense to index it). Doing this in particular for Wikidata where data size and update rates are high needs quite a bit of thinking

[Wikidata-bugs] [Maniphest] T266828: Expose ORES item quality to WDQS

Gehel added a comment. We don't want to add peripheral data into the existing WDQS storage. We might want to start another endpoint and allow federation with it. TASK DETAIL https://phabricator.wikimedia.org/T266828 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel

[Wikidata-bugs] [Maniphest] T244341: Stop using blank nodes for encoding SomeValue and OWL constraints in WDQS

Gehel added a subtask: T266470: Expose wdqs1009 to wdqs users and gather feedback. TASK DETAIL https://phabricator.wikimedia.org/T244341 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: JMinor, TomT0m, Gehel, Multichill, Pfps, Mmarx

[Wikidata-bugs] [Maniphest] T244590: [Epic] Rework the WDQS updater as an event driven application

Gehel added a subtask: T266470: Expose wdqs1009 to wdqs users and gather feedback. TASK DETAIL https://phabricator.wikimedia.org/T244590 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Thadguidry, tfmorris, revi, Ladsgroup, Multichill

[Wikidata-bugs] [Maniphest] T266470: Expose wdqs1009 to wdqs users and gather feedback

Gehel added parent tasks: T244590: [Epic] Rework the WDQS updater as an event driven application, T244341: Stop using blank nodes for encoding SomeValue and OWL constraints in WDQS. TASK DETAIL https://phabricator.wikimedia.org/T266470 EMAIL PREFERENCES https://phabricator.wikimedia.org

[Wikidata-bugs] [Maniphest] T261119: Architecture review of Flink based WDQS Streaming Updater

Gehel added a parent task: T244590: [Epic] Rework the WDQS updater as an event driven application. TASK DETAIL https://phabricator.wikimedia.org/T261119 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko, Gehel Cc: Aklapper, Zbyszko, dcausse

[Wikidata-bugs] [Maniphest] T244590: [Epic] Rework the WDQS updater as an event driven application

Gehel added a subtask: T261119: Architecture review of Flink based WDQS Streaming Updater. TASK DETAIL https://phabricator.wikimedia.org/T244590 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Thadguidry, tfmorris, revi, Ladsgroup

[Wikidata-bugs] [Maniphest] T244590: [Epic] Rework the WDQS updater as an event driven application

Gehel added a subtask: T266750: The streaming updater consumer should stop accumulating patches if it cannot handle them. TASK DETAIL https://phabricator.wikimedia.org/T244590 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Thadguidry

[Wikidata-bugs] [Maniphest] T266750: The streaming updater consumer should stop accumulating patches if it cannot handle them

Gehel added a parent task: T244590: [Epic] Rework the WDQS updater as an event driven application. TASK DETAIL https://phabricator.wikimedia.org/T266750 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: dcausse, Gehel Cc: Aklapper, dcausse, Alter

[Wikidata-bugs] [Maniphest] T251488: [epic] Create minimal SPARQL Endpoint for Commons on WMCS

Gehel added a subtask: T262828: Near zero downtime Data reload for WCQS. TASK DETAIL https://phabricator.wikimedia.org/T251488 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: BeatEstermann, Poyekhali, Steinsplitter, Lydia_Pintscher

[Wikidata-bugs] [Maniphest] T262828: Near zero downtime Data reload for WCQS

Gehel added a parent task: T251488: [epic] Create minimal SPARQL Endpoint for Commons on WMCS. TASK DETAIL https://phabricator.wikimedia.org/T262828 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko, Gehel Cc: Gehel, Bugreporter, Aklapper

[Wikidata-bugs] [Maniphest] T266702: Move WDQS UI to microsites

Gehel added a comment. I don't like having services proxying each others internally. Both `edge->wdqs->static` and `edge-static-wdqs` are adding accidental complexity to the architecture. This should really be a traffic routing question, wdqs and wdqs-ui are to separate se

[Wikidata-bugs] [Maniphest] T259588: Reload categories once 1.36.0-wmf.3 is running on all groups

Gehel triaged this task as "High" priority. TASK DETAIL https://phabricator.wikimedia.org/T259588 WORKBOARD https://phabricator.wikimedia.org/project/board/1227/ EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: dcausse

[Wikidata-bugs] [Maniphest] T264006: Deploy Flink to kubernetes (k8s)

Gehel triaged this task as "High" priority. TASK DETAIL https://phabricator.wikimedia.org/T264006 WORKBOARD https://phabricator.wikimedia.org/project/board/1227/ EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Mstyles, Gehel

[Wikidata-bugs] [Maniphest] T258269: Add query result to the current WDQS event logging

Gehel lowered the priority of this task from "High" to "Medium". TASK DETAIL https://phabricator.wikimedia.org/T258269 WORKBOARD https://phabricator.wikimedia.org/project/board/1227/ EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailprefer

[Wikidata-bugs] [Maniphest] T264447: Examine cases where Blazegraph generates results that timeout and don’t make it back to the user

Gehel triaged this task as "High" priority. TASK DETAIL https://phabricator.wikimedia.org/T264447 WORKBOARD https://phabricator.wikimedia.org/project/board/1227/ EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: CBogen, Lydia

[Wikidata-bugs] [Maniphest] T266495: Create Debian Package for Flink

Gehel triaged this task as "High" priority. TASK DETAIL https://phabricator.wikimedia.org/T266495 WORKBOARD https://phabricator.wikimedia.org/project/board/1227/ EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: elukey, EB

[Wikidata-bugs] [Maniphest] T265526: Create Helm Chart

Gehel triaged this task as "High" priority. TASK DETAIL https://phabricator.wikimedia.org/T265526 WORKBOARD https://phabricator.wikimedia.org/project/board/1227/ EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Aklapper, Gehe

[Wikidata-bugs] [Maniphest] T265512: Set up Pipeline Configuration in WDQS repo

Gehel triaged this task as "High" priority. TASK DETAIL https://phabricator.wikimedia.org/T265512 WORKBOARD https://phabricator.wikimedia.org/project/board/1227/ EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Aklapper, Gehe

[Wikidata-bugs] [Maniphest] T258269: Add query result to the current WDQS event logging

Gehel triaged this task as "High" priority. TASK DETAIL https://phabricator.wikimedia.org/T258269 WORKBOARD https://phabricator.wikimedia.org/project/board/1227/ EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: J

[Wikidata-bugs] [Maniphest] T244590: [Epic] Rework the WDQS updater as an event driven application

Gehel closed subtask T256875: The streaming updater should support page deletions as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T244590 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Thadguidry, tfmorris, revi, Ladsgroup

[Wikidata-bugs] [Maniphest] T256875: The streaming updater should support page deletions

Gehel closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T256875 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Mstyles, Gehel Cc: Aklapper, dcausse, Alter-paule, Beast1978, CBogen, Un1tY, Akuckartz, Hook696

[Wikidata-bugs] [Maniphest] T244590: [Epic] Rework the WDQS updater as an event driven application

Gehel closed subtask T256949: The streaming updater should support suppressed deletes as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T244590 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Thadguidry, tfmorris, revi, Ladsgroup

[Wikidata-bugs] [Maniphest] T256949: The streaming updater should support suppressed deletes

Gehel closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T256949 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Mstyles, Gehel Cc: Mstyles, Bugreporter, dcausse, Aklapper, Alter-paule, Beast1978, CBogen, Un1tY,

[Wikidata-bugs] [Maniphest] T262009: Add an entry in the WDQS Runbook on killer queries

Gehel closed this task as "Resolved". Gehel claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T262009 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Aklapper, RKemper, Gehel, CBogen, Akuckartz, Nandana, Namenlos3

[Wikidata-bugs] [Maniphest] T265868: wdqs2002 out of disk space

Gehel closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T265868 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: RKemper, dcausse, Gehel, Aklapper, CBogen, Akuckartz, Nandana, Namenlos314,

[Wikidata-bugs] [Maniphest] T265868: wdqs2002 out of disk space

Gehel created this task. Gehel added projects: Wikidata-Query-Service, Discovery-Search (Current work). Restricted Application added a subscriber: Aklapper. Restricted Application added a project: Wikidata. TASK DESCRIPTION The journal has grown to 1.3TB: gehel@wdqs2002:~$ ls -lh /srv

[Wikidata-bugs] [Maniphest] T265868: wdqs2002 out of disk space

Gehel moved this task from Incoming to In Progress on the Discovery-Search (Current work) board. Gehel claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T265868 WORKBOARD https://phabricator.wikimedia.org/project/board/1227/ EMAIL PREFERENCES https

[Wikidata-bugs] [Maniphest] T265290: Review the federation input process for WDQS

Gehel moved this task from All WDQS-related tasks to Current work on the Wikidata-Query-Service board. Gehel added a project: Discovery-Search (Current work). TASK DETAIL https://phabricator.wikimedia.org/T265290 WORKBOARD https://phabricator.wikimedia.org/project/board/891/ EMAIL

[Wikidata-bugs] [Maniphest] T264642: Log Formatting for WDQS

Gehel added a comment. It should be relatively easy to edit the logback.xml configuration file. I'm not entirely sure how this would be done in the context of the docker images, maybe @Addshore has a good idea. See documentation: http://logback.qos.ch/manual/layouts.html

  1   2   3   4   5   6   7   8   9   10   >