Smalyshev added a subscriber: Gehel.Smalyshev added a comment.
I see https://www.wikidata.org/wiki/Wikidata:SPARQL_query_service/Copyright was created, which is nice. But myself and probably other people from WDQS team (at least @Gehel, maybe also @Lucas_Werkmeister_WMDE and others) should be able
Smalyshev added a comment.
We have a limit of 20M per update, and we usually update about 500 to 700 entities, so we expect the average item's data size be no more than around 30k. However, we have things like:
-rw-r--r-- 1 smalyshev wikidev 763K Dec 17 08:40 Q56939386.ttl
-rw-r--r-- 1 smalyshev
Smalyshev added a comment.
The fix is already in new Sesame, so https://github.com/blazegraph/database/pull/112 should solve the issue by upgrading Sesame version to 2.8.11.TASK DETAILhttps://phabricator.wikimedia.org/T200612EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel
Smalyshev added a comment.
Created upstream patch as https://github.com/wikimedia/wikidata-query-blazegraph/commit/21874a5da9ad92edfedf1be7b46a9ffba0579147, if CI passes, will deploy it.TASK DETAILhttps://phabricator.wikimedia.org/T196859EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings
Smalyshev added a comment.
Interesting... didn't happen to me on Mac. I thought they should be consistent between OSes? Maybe I did something wrong? Please re-open the upstream mozilla bug then.TASK DETAILhttps://phabricator.wikimedia.org/T166491EMAIL PREFERENCEShttps://phabricator.wikimedia.org
Smalyshev removed a project: User-Smalyshev.
TASK DETAILhttps://phabricator.wikimedia.org/T154280EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Esc3300, Smalyshev, Nikki, Aklapper, Multichill, ET4Eva, Nandana, Lahi, Gq86, Darkminds3113
Smalyshev added a project: Discovery-Wikidata-Query-Service-Sprint.
TASK DETAILhttps://phabricator.wikimedia.org/T210901EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: gerritbot, Lucas_Werkmeister_WMDE, Addshore, Krenair, Aklapper, Smalyshev
Smalyshev added a project: Discovery-Wikidata-Query-Service-Sprint.
TASK DETAILhttps://phabricator.wikimedia.org/T200612EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Smalyshev, seav, Aklapper, jindrichmynarz, Nandana, Lahi, Gq86
Smalyshev added projects: User-Smalyshev, Discovery-Wikidata-Query-Service-Sprint.
TASK DETAILhttps://phabricator.wikimedia.org/T196859EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Aklapper, Esc3300, Smalyshev, ET4Eva, Nandana, Lahi, Gq86
Smalyshev removed a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T207665EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: gerritbot, Aklapper, Mathew.onipe, Smalyshev, Gehel, Nandana, Lahi, Gq86, Lucas_Werkmeister_WMDE
Smalyshev closed this task as "Resolved".Smalyshev claimed this task.Smalyshev added a comment.
I just checked in Firefox 64, and it seems to work fine now.TASK DETAILhttps://phabricator.wikimedia.org/T166491EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailp
Smalyshev added a project: Technical-Debt.
TASK DETAILhttps://phabricator.wikimedia.org/T161991EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Smalyshev, Aklapper, daniel, ET4Eva, Nandana, Lahi, Gq86, Darkminds3113, Lucas_Werkmeister_WMDE
Smalyshev added a comment.
Also got this one today:
Exception in thread "main" java.lang.OutOfMemoryError: Java heap space
at java.util.Arrays.copyOf(Arrays.java:3332)
at java.lang.AbstractStringBuilder.ensureCapacityInternal(AbstractStringBuilde
Smalyshev added a comment.
It is the standard Mediawiki title encoding - however Mediawiki represents the title, the same does WDQS, since Mediawiki (Wikidata) is the data source.
If I take the str() form of the URL, it must return the decoded URL
I don't think this is the case. Could you point
Smalyshev triaged this task as "Normal" priority.
TASK DETAILhttps://phabricator.wikimedia.org/T201354EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Gehel, Aklapper, Smalyshev, Nandana, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSM
Smalyshev changed the task status from "Open" to "Stalled".Smalyshev triaged this task as "Normal" priority.
TASK DETAILhttps://phabricator.wikimedia.org/T181319EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Sma
Smalyshev lowered the priority of this task from "Normal" to "Low".
TASK DETAILhttps://phabricator.wikimedia.org/T176239EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: TerraCodes, Smalyshev, Aklapper, Yurik, ET4Eva,
Smalyshev triaged this task as "Low" priority.
TASK DETAILhttps://phabricator.wikimedia.org/T195045EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Aklapper, Lydia_Pintscher, Smalyshev, ET4Eva, Nandana, Lahi, Gq86, Dar
Smalyshev triaged this task as "Normal" priority.
TASK DETAILhttps://phabricator.wikimedia.org/T209034EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: gerritbot, Aklapper, Smalyshev, Lucas_Werkmeister_WMDE, Nikki, CucyNoiD, Nandana, Ne
Smalyshev added a project: User-Smalyshev.
TASK DETAILhttps://phabricator.wikimedia.org/T208014EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Aklapper, Smalyshev, Nandana, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune
Smalyshev closed this task as "Resolved".Smalyshev claimed this task.Smalyshev added a comment.
Probably was due to delete channel not working, should be ok now.TASK DETAILhttps://phabricator.wikimedia.org/T209577EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailp
Smalyshev added a comment.
Submitted https://github.com/blazegraph/database/issues/110 for upstream.TASK DETAILhttps://phabricator.wikimedia.org/T200612EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Smalyshev, seav, Aklapper, jindrichmynarz
Smalyshev triaged this task as "Normal" priority.
TASK DETAILhttps://phabricator.wikimedia.org/T200612EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Smalyshev, seav, Aklapper, jindrichmynarz, Nandana, Lahi, Gq86, Lucas_Werkme
Smalyshev added a comment.
This is fixed in 2.8.0 of Sesame, unfortunately Blazegraph does not build cleanly with it... Will have to look into how to upgrade.TASK DETAILhttps://phabricator.wikimedia.org/T200612EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences
Smalyshev added a comment.
This seems to be an issue in Sesame library, it quotes commas when they are part of the literal value, but not when they are part of the URI.TASK DETAILhttps://phabricator.wikimedia.org/T200612EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel
Smalyshev added subscribers: Mathew.onipe, Gehel, Smalyshev.Smalyshev added a comment.
@Mathew.onipe Is this something you can do? @Gehel is on parental leave, so he's out for the month.TASK DETAILhttps://phabricator.wikimedia.org/T208215EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings
Smalyshev claimed this task.
TASK DETAILhttps://phabricator.wikimedia.org/T210901EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: gerritbot, Lucas_Werkmeister_WMDE, Addshore, Krenair, Aklapper, Smalyshev, CucyNoiD, Nandana, NebulousIris, Gaboe420
Smalyshev added a comment.
Sounds good to me.TASK DETAILhttps://phabricator.wikimedia.org/T194177EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Smalyshev, Aklapper, Lucas_Werkmeister_WMDE, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, EBjune
Smalyshev lowered the priority of this task from "High" to "Normal".Smalyshev added a comment.
Given that this seems to be very rare, dropping the priority a bit.TASK DETAILhttps://phabricator.wikimedia.org/T210235EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/pa
Smalyshev added a comment.
Added Ctrl-Alt-Space and Alt-Enter as secondary shortcuts for now.TASK DETAILhttps://phabricator.wikimedia.org/T203320EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: gerritbot, Lucas_Werkmeister_WMDE, Smalyshev
Smalyshev raised the priority of this task from "High" to "Unbreak Now!".Smalyshev added a comment.Restricted Application added subscribers: Liuxinyu970226, TerraCodes.
I see JS error: this._querySamplesApi.getLanguage in not a function. There were some changes related
Smalyshev edited projects, added Wikidata Query UI; removed Wikidata-Query-Service.
TASK DETAILhttps://phabricator.wikimedia.org/T211629EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Aklapper, Lucas_Werkmeister_WMDE, Stas, Daniel_Mietchen
Smalyshev changed the task status from "Open" to "Stalled".Smalyshev triaged this task as "Low" priority.
TASK DETAILhttps://phabricator.wikimedia.org/T210164EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Smalyshev
Smalyshev added subscribers: Multichill, hoo, Lydia_Pintscher, Nikki.Smalyshev merged a task: T211469: Inconsistent query results for recently created items on query service.
TASK DETAILhttps://phabricator.wikimedia.org/T210044EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel
Smalyshev closed this task as a duplicate of T210044: Data corruption when loading RDF data into WDQS.
TASK DETAILhttps://phabricator.wikimedia.org/T211469EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: hoo, Aklapper, Smalyshev, Lydia_Pintscher
Smalyshev added a parent task: T210044: Data corruption when loading RDF data into WDQS.
TASK DETAILhttps://phabricator.wikimedia.org/T207826EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Aklapper, Smalyshev, Nandana, Lahi, Gq86
Smalyshev added a subtask: T207826: Weird reference message in WDQS updater.
TASK DETAILhttps://phabricator.wikimedia.org/T210044EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: KaMan, Fnielsen, abian, Lea_Lacroix_WMDE, MisterSynergy, ValterVB
Smalyshev closed this task as "Resolved".Smalyshev claimed this task.
TASK DETAILhttps://phabricator.wikimedia.org/T211462EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: gerritbot, Mathew.onipe, Gehel, Aklapper, Smalyshev, CucyNoi
Smalyshev added a comment.
Also it seems like /srv/wdqs/blazegraph is created with wrong permissions by default - Blazegraph can not write its store file there.TASK DETAILhttps://phabricator.wikimedia.org/T211462EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences
Smalyshev created this task.Smalyshev added a project: Wikidata-Query-Service.Restricted Application added a subscriber: Aklapper.Restricted Application added a project: Wikidata.
TASK DESCRIPTIONWhen trying to install WDQS on labs, I get this from puppet:
Notice: /Stage[main]/Wdqs::Deploy
Smalyshev edited projects, added Wikidata Query UI; removed Wikidata-Query-Service.Smalyshev changed the task status from "Open" to "Stalled".
TASK DETAILhttps://phabricator.wikimedia.org/T171706EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailprefere
Smalyshev added a project: User-Smalyshev.
TASK DETAILhttps://phabricator.wikimedia.org/T210901EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: gerritbot, Lucas_Werkmeister_WMDE, Addshore, Krenair, Aklapper, Smalyshev, CucyNoiD, Nandana
Smalyshev closed this task as "Resolved".Smalyshev added a comment.
Looks like with the change above errors are no longer happening. As I see no noticeable change on the dashboard tracking entity fetch times, I think the problem is solved.
Thanks for the help, @Imarlier and @ema!TASK D
Smalyshev added a comment.
@Fnielsen deletion issues were because of T210451TASK DETAILhttps://phabricator.wikimedia.org/T210044EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Fnielsen, abian, Lea_Lacroix_WMDE, MisterSynergy, ValterVB, gerritbot
Smalyshev closed this task as "Invalid".Smalyshev added a comment.
This query can not work as described, because SERVICE wikibase:label clause is in one query (inside federated query) and labels are in another query (outside), so inside service does not know anything about it.TASK D
Smalyshev added a comment.
The query is captured in F27383365.TASK DETAILhttps://phabricator.wikimedia.org/T210044EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Fnielsen, abian, Lea_Lacroix_WMDE, MisterSynergy, ValterVB, gerritbot, Graemebp
Smalyshev added a comment.
SPARQL dumps show that data is present in SPARQL but not in the database. Filed https://github.com/blazegraph/database/issues/109 with upstream and will dig into it further to see what we can find out there.TASK DETAILhttps://phabricator.wikimedia.org/T210044EMAIL
Smalyshev added a comment.
I've reduced the pool lifetime to 1s (which should be essentially as if there was no pooling if I get it correctly), let's see what happens. I've also looked through the code, and I don't see any possibility we're leaking connections (could be wrong of course) so
Smalyshev added a subtask: T210901: Stale reads for WDQS Updater.
TASK DETAILhttps://phabricator.wikimedia.org/T168214EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Jonas, PokestarFan, Aklapper, Smalyshev, ET4Eva, Nandana, Lahi, Gq86
Smalyshev added a parent task: T168214: Updater misses updates when two updates happen very close to each other.
TASK DETAILhttps://phabricator.wikimedia.org/T210901EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Lucas_Werkmeister_WMDE, Addshore
Smalyshev added a comment.
This looks like it can be caused by T210901: Stale reads for WDQS Updater.TASK DETAILhttps://phabricator.wikimedia.org/T168214EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Jonas, PokestarFan, Aklapper, Smalyshev
Smalyshev added a comment.
Why are you trying to use federation when running on the same service? Can't you just use a subquery?TASK DETAILhttps://phabricator.wikimedia.org/T211107EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Smalyshev
Smalyshev closed this task as "Resolved".Smalyshev claimed this task.
TASK DETAILhttps://phabricator.wikimedia.org/T210903EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: gerritbot, Gehel, Aklapper, Smalyshev, CucyNoiD, Nandana, Ne
Smalyshev added a comment.
RDF dumps confirm that data is coming fine through
This also happens for single-update items, which haven't been touched for a while, so it's not some kind of update race. Weird thing is it happens on multiple servers in the same way. E.g. check on Q3601865 reveals
Smalyshev added a comment.
Thanks, I'll try to play with the connection pooling and see what happens and report here.TASK DETAILhttps://phabricator.wikimedia.org/T207718EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Imarlier, SmalyshevCc: BBlack, ema, Gehel
Smalyshev triaged this task as "Normal" priority.
TASK DETAILhttps://phabricator.wikimedia.org/T210903EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: gerritbot, Gehel, Aklapper, Smalyshev, CucyNoiD, Nandana, NebulousIris, Gaboe420
Smalyshev added a comment.
@lmarlier wouldn't that be slower? But I could try that too I guess.TASK DETAILhttps://phabricator.wikimedia.org/T207718EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Imarlier, SmalyshevCc: BBlack, ema, Gehel, Aklapper, Smalyshev
Smalyshev added a subscriber: Fnielsen.Smalyshev merged a task: T211010: Missing triples in Wikidata Query Service.
TASK DETAILhttps://phabricator.wikimedia.org/T210044EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Fnielsen, abian
Smalyshev closed this task as a duplicate of T210044: Data corruption when loading RDF data into WDQS.
TASK DETAILhttps://phabricator.wikimedia.org/T211010EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Fnielsen, Aklapper, Nandana, Lahi, Gq86
Smalyshev added a comment.
I don't think we need to support fbcid in query strings themselves, but I see no problem in UI stripping it when translating hash to the query.TASK DETAILhttps://phabricator.wikimedia.org/T210139EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel
Smalyshev added a comment.
we could add another param to ensure the latest is retrieved?
The problem is that if the DB does not have this revision, it can't be retrieved...
We could also specify a specific rev id to be retrieved as you have that info?
I don't want to get the specific one, I
Smalyshev removed Smalyshev as the assignee of this task.
TASK DETAILhttps://phabricator.wikimedia.org/T210772EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Smalyshev, Aklapper, Andrew, Nandana, GTirloni, AndyTan, sietec, Bstorm, Lahi, aborrero
Smalyshev added a subscriber: Gehel.Smalyshev added a comment.
@Gehel do you know any maven magic to make this work?TASK DETAILhttps://phabricator.wikimedia.org/T210903EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Gehel, Aklapper, Smalyshev
Smalyshev created this task.Smalyshev added a project: Wikidata-Query-Service.Restricted Application added a subscriber: Aklapper.Restricted Application added a project: Wikidata.
TASK DESCRIPTIONIt would be nice to be able to see which git tag the running code is built from. Since we're doing
Smalyshev updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...```
20:53:35.953 [update 1] WARN o.wikidata.query.rdf.tool.rdf.Munger - Stale revision on Q5576287: change is 797238340, RDF is 683087222
09:23:21.076 [update 4] WARN o.wikidata.query.rdf.tool.rdf.Munger - Stale
Smalyshev triaged this task as "High" priority.
TASK DETAILhttps://phabricator.wikimedia.org/T210901EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Aklapper, Smalyshev, Nandana, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovi
Smalyshev created this task.Smalyshev added projects: Wikidata-Query-Service, Wikidata.Restricted Application added a subscriber: Aklapper.
TASK DESCRIPTIONI suspect that WDQS updater may be reading older RDF data than the latest edit. I.e. I am getting log messages like this:
20:14:17.327
Smalyshev updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTIONuser:KaMan [[ https://www.wikidata.org/wiki/Wikidata:Contact_the_development_team#Not_stable_number_of_senses_in_lexemes | noticed ]] that the number of Senses in English, reported by ListeriaBot [[ https
Smalyshev added a subtask: T210495: Number of Senses is decreasing on ListeriaBot's report.
TASK DETAILhttps://phabricator.wikimedia.org/T210044EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Lea_Lacroix_WMDE, MisterSynergy, ValterVB, gerritbot
Smalyshev added a parent task: T210044: Data corruption when loading RDF data into WDQS.
TASK DETAILhttps://phabricator.wikimedia.org/T210495EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Smalyshev, ArthurPSmith, KaMan, Lucas_Werkmeister_WMDE
Smalyshev triaged this task as "Normal" priority.Smalyshev added a comment.
Generally we do need this host, but in light of T206636 I haven't been using it much lately because it run out of space and generally fell into disrepair. We'd need some host that is at least close to what
Smalyshev added a comment.
Prefixed listed here: https://www.mediawiki.org/wiki/Wikibase/Indexing/RDF_Dump_Format#Prefixes_used probably should be configurable, except for wikibase one which probably should stay the same. Configuration should allow for easily generating the set of prefixes from
Smalyshev added a comment.
In the meantime, can I delete t206636-3?
Yes.TASK DETAILhttps://phabricator.wikimedia.org/T206636EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Addshore, Andrew, Aklapper, Smalyshev, Gehel, Legado_Shulgin, Nandana
Smalyshev added a comment.
The dist.xml builds distributable package, but we don't use it to deploy. We use /wikidata/query/deploy repo, which should have all the files that are needed to be deployed.TASK DETAILhttps://phabricator.wikimedia.org/T207665EMAIL PREFERENCEShttps
Smalyshev edited projects, added Wikidata Query UI; removed Wikidata-Query-Service.
TASK DETAILhttps://phabricator.wikimedia.org/T210692EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Aklapper, Yurik, Nandana, Lahi, Gq86, Lucas_Werkmeister_WMDE
Smalyshev updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTIONThe CTRL-SPACE shortcut in #wikidata-query-serviceui seems to be hardcoded [1] and it's a key combination that's not particularly friendly to Mac OS or Chromebook users. Please consider making it configurable, I'd
Smalyshev edited projects, added Wikidata Query UI; removed Wikidata-Query-Service.
TASK DETAILhttps://phabricator.wikimedia.org/T210679EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Tarrow, Addshore, DarTar, Aklapper, Nandana, Lahi, Gq86
Smalyshev added a comment.
@Lea_Lacroix_WMDE yes, this is possible.TASK DETAILhttps://phabricator.wikimedia.org/T210044EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Lea_Lacroix_WMDE, MisterSynergy, ValterVB, gerritbot, Graemebp, Gstupp, Tarrow
Smalyshev renamed this task from "wdqs-updater crashing on all wdqs servers" to "wdqs-updater crashing when update size is too large".Smalyshev edited projects, added Wikidata-Query-Service, User-Smalyshev; removed Patch-For-Review, Operations.Restricted Application added a pro
Smalyshev added a comment.
Hmm looks like newer items are affected too, so probably it's an instance of T210044: Data corruption when loading RDF data into WDQS.TASK DETAILhttps://phabricator.wikimedia.org/T210495EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences
Smalyshev added a comment.
Looks like some data affected by T207673 wasn't properly updated. I'll try to re-update them.TASK DETAILhttps://phabricator.wikimedia.org/T210495EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Smalyshev, ArthurPSmith
Smalyshev added projects: User-Smalyshev, Wikidata-Query-Service.Smalyshev added a comment.
We've had issues with deletes not being reported (T210451) but this should be fixed now. But the new ones should not be missing. I'll take a look into what's going on (probably will take a couple of days
Smalyshev added a comment.
Got it, thanks. I guess then we have to give up on the idea to compare to SQL for the test in T209402: A/B testing plan for wbsearchentities, context=item and not do it in other tests. Not a big deal, I was just not aware it's not an option anymore.TASK DETAILhttps
Smalyshev added a comment.
Does it mean SQL-based search doesn't work now on Wikidata, or that we need to do some more setup to make it work? Would setting useTermsTableSearchFields be enough? Should we have it enabled in our mediawiki configs or disabling it also means we don't have proper index
Smalyshev added a comment.
@Pchelolo No I already updated the affected items manually.TASK DETAILhttps://phabricator.wikimedia.org/T210451EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovac, SmalyshevCc: Stashbot, gerritbot, MisterSynergy, mobrovac
Smalyshev removed a project: Operations.
TASK DETAILhttps://phabricator.wikimedia.org/T210431EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: jcrespo, Aklapper, Mathew.onipe, Gehel, Smalyshev, Nandana, Lahi, Gq86, Lucas_Werkmeister_WMDE
Smalyshev added a comment.
Yep, seeing the events in grafana now, so I think it's all good now. Thanks!TASK DETAILhttps://phabricator.wikimedia.org/T210451EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovac, SmalyshevCc: Stashbot, gerritbot
Smalyshev added a comment.
I think I've extracted all I need from the DB tables for now, but I'll double-check and if anything is still missing I check the extracted data, thanks!TASK DETAILhttps://phabricator.wikimedia.org/T210451EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel
Smalyshev added a comment.
To make the problem worse, looks like breakage started more than 30 days ago - which means we don't have a record of the old deleted entries in recentchanges, so we don't know which items to update :(TASK DETAILhttps://phabricator.wikimedia.org/T210451EMAIL
Smalyshev added a comment.
It does cause pretty severe breakage - all delete updates are missing from WDQS and people are complaining (in fact, have been complaining for a while now, I just now figured out that it's because we don't have any delete events at all!)TASK DETAILhttps
Smalyshev added a project: Wikimedia-Incident.
TASK DETAILhttps://phabricator.wikimedia.org/T210451EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: TerraCodes, Liuxinyu970226, Aklapper, Pchelolo, Ottomata, Gehel, Smalyshev, Legado_Shulgin, Nandana
Smalyshev triaged this task as "Unbreak Now!" priority.Restricted Application added subscribers: Liuxinyu970226, TerraCodes.
TASK DETAILhttps://phabricator.wikimedia.org/T210451EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc:
Smalyshev created this task.Smalyshev added projects: Operations, EventBus, Wikidata-Query-Service.Restricted Application added a subscriber: Aklapper.Restricted Application added projects: Wikidata, Analytics.
TASK DESCRIPTIONNo deletions are being reported to eqiad.mediawiki.page-delete topic
Smalyshev created this task.Smalyshev added projects: Wikidata-Query-Service, Operations.Restricted Application added a subscriber: Aklapper.Restricted Application added a project: Wikidata.
TASK DESCRIPTIONRight now, to change some value on WDQS cluster, we need to edit at least 5 hiera files
Smalyshev edited projects, added Wikidata Query UI; removed Wikidata-Query-Service.
TASK DETAILhttps://phabricator.wikimedia.org/T210139EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Lucas_Werkmeister_WMDE, Aklapper, Salgo60, Nandana, Lahi, Gq86
Smalyshev added a comment.
Check out this query: http://tinyurl.com/y8y3nmq8
Most currencies have rates from 2016 (including euro, which is one of the most common currencies), and that's those that have conversion to USD, which is 39 out of 946.TASK DETAILhttps://phabricator.wikimedia.org
Smalyshev added a comment.
We have quantity normalization, but here's a problem: exchange rates fluctuate a lot. Even if we implement it as a service - do we have up-to-date enough data to convert currencies? I checked some:
https://www.wikidata.org/wiki/Q81893 - has conversion rates from Feb
Smalyshev added a comment.
As T206189 is done, do we want to do anything else here?TASK DETAILhttps://phabricator.wikimedia.org/T206108EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Smalyshev, Aklapper, Gehel, Nandana, Lahi, Gq86
Smalyshev added a project: Technical-Debt.
TASK DETAILhttps://phabricator.wikimedia.org/T201354EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Gehel, Aklapper, Smalyshev, Nandana, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic
Smalyshev added a comment.
timings for the last one:
wdq5: 2018-11-21T23:35:56Z
wdq4: 2018-11-21T23:35:04Z
wdq6: 2018-11-21T23:34:44Z
wdq21: 2018-11-21T23:34:55Z
wdq22: 2018-11-21T23:34:49Z
wdq23: 2018-11-21T23:35:07Z
wdq3: 2018-11-21T23:35:03Z
wdq7: 2018-11-21T23:34:51Z
wdq8: 2018-11-21T23:34
1001 - 1100 of 6330 matches
Mail list logo
