[Wikidata-bugs] [Maniphest] [Updated] T1211: Create team projects for all teams participating in scrum of scrums
Yurik added a project: Zero-Team. TASK DETAIL https://phabricator.wikimedia.org/T1211 REPLY HANDLER ACTIONS Reply to comment or attach files, or !close, !claim, !unsubscribe or !assign username. EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Qgil, Yurik Cc: Jsahleen, Qgil, bd808, Aklapper, chasemp, Eevans, mobrovac, DFoy, Hardikj, Wikidata-bugs, RobH, Ryasmeen, aude, marcoil, Deskana, Gryllida, Jalexander, mark, Fabrice_Florin, Yurik, EBernhardson, Parent5446, Anomie, faidon, Gilles, Nikerabbit, Arrbee, santhosh, KartikMistry, Arlolra, jhobs, csteipp, Rfarrand, Krenair, fgiunchedi, Joe, Dzahn, jeremyb, Quiddity, Legoktm, greg, Tgr ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T1211: Create team projects for all teams participating in scrum of scrums
Yurik removed a project: Zero-Archive. TASK DETAIL https://phabricator.wikimedia.org/T1211 REPLY HANDLER ACTIONS Reply to comment or attach files, or !close, !claim, !unsubscribe or !assign username. EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Qgil, Yurik Cc: Jsahleen, Qgil, bd808, Aklapper, chasemp, Eevans, mobrovac, Hardikj, Wikidata-bugs, RobH, Ryasmeen, aude, marcoil, Deskana, Gryllida, Jalexander, mark, Fabrice_Florin, EBernhardson, Parent5446, Anomie, faidon, Gilles, Nikerabbit, Arrbee, santhosh, KartikMistry, Arlolra, csteipp, Rfarrand, Krenair, fgiunchedi, Joe, Dzahn, jeremyb, Quiddity, Legoktm, greg, Tgr ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Changed Subscribers] T107602: Set up a public interface to the wikidata query service
Yurik added a subscriber: Yurik. TASK DETAIL https://phabricator.wikimedia.org/T107602 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Joe, Yurik Cc: Yurik, JohnLewis, hoo, GWicke, greg, Lydia_Pintscher, csteipp, jcrespo, Legoktm, gerritbot, Smalyshev, BBlack, Joe, daniel, RobLa-WMF, Aklapper, aude, JanZerebecki, JeroenDeDauw, MrStradivarius, waldyrious, Krenair, MBlissett, bd808, Laddo, Addshore, Matanya, jkroll, Wikidata-bugs, Jdouglas, RobH, Manybubbles, mark, faidon, fgiunchedi, Dzahn, chasemp, Malyacko ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T122888: "Edit links" is not shown on wiktionary
Yurik created this task. Yurik added a subscriber: Yurik. Yurik added a project: Wikidata. Herald added subscribers: StudiesWorld, Aklapper. TASK DESCRIPTION E.g. https://en.wiktionary.org/wiki/map -- i cannot jump to wikidata to edit/view the wikidata item. I had to switch to wikipedia to see it. TASK DETAIL https://phabricator.wikimedia.org/T122888 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: Aklapper, Yurik, StudiesWorld, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Block] T134426: Review shared data namespace (tabular data) implementation
Yurik created blocking task T137026: Configure Commons CC0 licensing for the Data namespace. TASK DETAIL https://phabricator.wikimedia.org/T134426 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: Danny_B, DannyH, StudiesWorld, Steinsplitter, Aklapper, Lydia_Pintscher, ekkis, Matanya, MarkTraceur, JEumerus, Thryduulf, Milimetric, MZMcBride, Bawolff, -jem-, gerritbot, Pokefan95, TerraCodes, intracer, ThurnerRupert, brion, Jdforrester-WMF, Eloy, TheDJ, Yurik, Zppix, Riley_Huntley, D3r1ck01, Izno, Luke081515, JAllemandou, Wikidata-bugs, aude, El_Grafo, Ricordisamoa, Shizhao, fbstj, Fabrice_Florin, Mbch331, Jay8g, Krenair, jeremyb ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T134426: Review shared data namespace (tabular data) implementation
Yurik added a comment.
@RobLa-WMF, thanks for putting all the links together. I have seen some of
them, and will email the authors.
Row objects vs arrays
-
I feel that other formats are optimized towards parsing and processing,
rather than storage and ease of use. Repeating column names for each row seems
overly verbose, and, in case of raw-text editing, makes it less readable and
harder not to make mistakes. On the other hand, their system benefits sparse
tables - missing values may simply be omitted, whereas in my proposal one would
have to use "null". Also, for some use cases like graphs, parsing would require
an extra step - converting arrays into objects on the client (could be done
with auto-generated code for higher efficiency).
"rows": [
{"column1":"foo", "column2":42, "optColumn3": true}, // rows as objects
{"column1":"bar", "column2":13},
]
"columns": ["column1", "column2", "optColumn3"],
"rows": [
["foo", 42, true], // rows as arrays
["bar", 13, null]
]
Target audience
---
Other formats, especially W3C, seem to only target
machine-generation/consumption, and thus become extremely verbose and complex.
They only need very few developers to fully understand and implement them.
While I hope that we will quickly introduce good data editing tools, I think
our format needs to be widely understood on its own by the same community that
uses wiki markup, so that it can be easily consumed by developers of Lua
modules and Graphs.
Data types, constrains, ...
---
I do not have very strong feelings either way about how to declare data
types. I foresee the basic data types like `number`,`string`,`bool`, plus some
more exotic ones like multi-lingual string (one string per language). Hard to
define types like Wikidata ID, datetime, and URL could be stored as a string
until we can reuse Wikidata's type system. Another needed feature is to reuse
metadata from another page, thus allowing multiple pages to have the same
structure.
TASK DETAIL
https://phabricator.wikimedia.org/T134426
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Yurik
Cc: RobLa-WMF, Danny_B, DannyH, StudiesWorld, Steinsplitter, Aklapper,
Lydia_Pintscher, ekkis, Matanya, MarkTraceur, JEumerus, Thryduulf, Milimetric,
MZMcBride, Bawolff, -jem-, gerritbot, Pokefan95, TerraCodes, intracer,
ThurnerRupert, brion, Jdforrester-WMF, Eloy, TheDJ, Yurik, Zppix,
Riley_Huntley, D3r1ck01, Izno, Luke081515, JAllemandou, Wikidata-bugs, aude,
El_Grafo, Ricordisamoa, Shizhao, fbstj, Fabrice_Florin, Mbch331, Jay8g,
Krenair, jeremyb
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T134426: Review shared data namespace (tabular data) implementation
Yurik added a comment.
- I keep wondering if we can use Wikidata/Wikibase more for this. Wikidata
IDs for the license might be much more convenient for computer consumption,
even though "CC BY 2.5" is by far more readable than Q18810333
<http://tools.wmflabs.org/sqid/#/view?id=Q18810333>, but it allows us not to
maintain a separate database of licenses, or deal with translations.
- Wikibase may be a good future metadata store, once it gets deployed on
Commons. It will simplify localized storage of title/description, plus other
arbitrary metadata/tags/categories/...
- Until Wikibase is ready, we should support absolute minimum - title
(localized), description (localized), source (string). Source will be freetext
notes area for now, because we are not yet sure what's needed, and it will have
to be reworked later. We could even name it `notes` as to highlight this fact.
- Do we want to support multiple datasets, possibly with different schemas,
per page? I can certainly think of use cases, but would this overcomplicate
things? I guess we could say that if page contains `"resources"` key, it's a
data package <http://dataprotocols.org/data-packages/#resource-information>,
and otherwise its a simple one table per page page. Resource support won't be
implemented at first.
- Schema - calling them `name` and `type` is fine, but we should also have
localized label:
"schema": {
"fields": [ {
"name": "fieldId",
"type": "string",
"label": { "en": "Field in English", "es": "field is Spanish", ... }
}, ...
]}
For external schema, we can reference a different page. `.tabschema` format
is TBD (@rufuspollock ?)
"schema": "Data:Shared Schema.tabschema"
@rufuspollock thanks for your feedback! I did not realize your schema
supported array of array format. Btw, did you make a typo in "data" - being
array of array of array instead of array of array? (both examples). What do
you think about referencing Wikidata? I am not sure i like the "title@es"
format. It implies that there is one "main" title, and other title that are
less so. Considering that this data could be just for some small language wiki,
having a mandatory "title" looses its meaning. Having a "localized" type with a
dictionary allows any languages with an automatic fallback into whatever the
reader may understand.
CC @Lydia_Pintscher
TASK DETAIL
https://phabricator.wikimedia.org/T134426
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Yurik
Cc: rufuspollock, RobLa-WMF, Danny_B, DannyH, StudiesWorld, Steinsplitter,
Aklapper, Lydia_Pintscher, ekkis, Matanya, MarkTraceur, JEumerus, Thryduulf,
Milimetric, MZMcBride, Bawolff, -jem-, gerritbot, Pokefan95, TerraCodes,
intracer, ThurnerRupert, brion, Jdforrester-WMF, Eloy, TheDJ, Yurik, Zppix,
Riley_Huntley, D3r1ck01, Izno, Luke081515, JAllemandou, Wikidata-bugs, aude,
El_Grafo, jayvdb, Ricordisamoa, Shizhao, fbstj, Fabrice_Florin, Mbch331, Jay8g,
Krenair, jeremyb
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T134426: Review shared data namespace (tabular data) implementation
Yurik added a comment. @Milimetric, lets do it online - most interested parties are all over the globe, hard to pick a time. TASK DETAIL https://phabricator.wikimedia.org/T134426 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: RobLa-WMF, Danny_B, DannyH, StudiesWorld, Steinsplitter, Aklapper, Lydia_Pintscher, ekkis, Matanya, MarkTraceur, JEumerus, Thryduulf, Milimetric, MZMcBride, Bawolff, -jem-, gerritbot, Pokefan95, TerraCodes, intracer, ThurnerRupert, brion, Jdforrester-WMF, Eloy, TheDJ, Yurik, Zppix, Riley_Huntley, D3r1ck01, Izno, Luke081515, JAllemandou, Wikidata-bugs, aude, El_Grafo, Ricordisamoa, Shizhao, fbstj, Fabrice_Florin, Mbch331, Jay8g, Krenair, jeremyb ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T120452: Allow tabular datasets on Commons (or some similar central repository) (CSV, TSV, JSON, XML)
Yurik added a comment.Yep, sounds good.TASK DETAILhttps://phabricator.wikimedia.org/T120452EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: YurikCc: RobLa-WMF, TheDJ, Eloy, Jdforrester-WMF, brion, ThurnerRupert, intracer, TerraCodes, Pokefan95, gerritbot, -jem-, Bawolff, MZMcBride, Milimetric, Thryduulf, JEumerus, MarkTraceur, Yurik, Matanya, ekkis, matmarex, Lydia_Pintscher, Aklapper, Steinsplitter, StudiesWorld, DannyH, Riley_Huntley, D3r1ck01, Izno, JAllemandou, Wikidata-bugs, aude, El_Grafo, jayvdb, Ricordisamoa, Shizhao, Fabrice_Florin, Mbch331, Jay8g, Krenair, jeremyb ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Edited] T134426: Review shared data namespace (tabular data) implementation
Yurik edited the task description. TASK DETAIL https://phabricator.wikimedia.org/T134426 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: Danny_B, DannyH, StudiesWorld, Steinsplitter, Aklapper, Lydia_Pintscher, ekkis, Matanya, MarkTraceur, JEumerus, Thryduulf, Milimetric, MZMcBride, Bawolff, -jem-, gerritbot, Pokefan95, TerraCodes, intracer, ThurnerRupert, brion, Jdforrester-WMF, Eloy, TheDJ, Yurik, Zppix, Riley_Huntley, D3r1ck01, Izno, Luke081515, JAllemandou, Wikidata-bugs, aude, El_Grafo, Ricordisamoa, Shizhao, fbstj, Fabrice_Florin, Mbch331, Jay8g, Krenair, jeremyb ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T138030: Enable maps on Wikidata
Yurik created this task.Yurik added projects: Maps, Discovery, Kartographer, Wikidata. TASK DESCRIPTIONEnable access to and tags in Wikidata. Also allow Wikidata devs to programmatically add maps. Please experiment first, don't massively add it to every item at once :)TASK DETAILhttps://phabricator.wikimedia.org/T138030EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: YurikCc: Zppix, Aklapper, Yurik, Avner, Ddproxy, debt, Gehel, JGirault, D3r1ck01, phabyogi, FloNight, Susannaanas, Izno, ferdbold, lxbarth, Planemad, Wikidata-bugs, aude, Deskana, Mbch331, Jay8g___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T138030: Enable maps on Wikidata
Yurik added a blocked task: T134816: Show wikidata query results as map markers. TASK DETAILhttps://phabricator.wikimedia.org/T138030EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MaxSem, YurikCc: gerritbot, Zppix, Aklapper, Yurik, Avner, Lewizho99, Ddproxy, Maathavan, debt, Gehel, JGirault, D3r1ck01, phabyogi, FloNight, Susannaanas, Izno, ferdbold, lxbarth, Planemad, Wikidata-bugs, aude, Deskana, Mbch331, Jay8g___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T115966: Show map for coordinate diffs
Yurik added a comment. Maps has been enabled on Wikidata. Enjoy. T138030TASK DETAILhttps://phabricator.wikimedia.org/T115966EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: YurikCc: Yurik, Lydia_Pintscher, Sjoerddebruin, Ricordisamoa, Nikki, Aklapper, D3r1ck01, Izno, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Retitled] T120452: Allow structured datasets on a central repository (CSV, TSV, JSON, GeoJSON, XML, ...)
Yurik changed the title from "Allow tabular datasets on Commons (or some similar central repository) (CSV, TSV, JSON, XML)" to "Allow structured datasets on a central repository (CSV, TSV, JSON, GeoJSON, XML, ...)". TASK DETAILhttps://phabricator.wikimedia.org/T120452EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: YurikCc: RobLa-WMF, TheDJ, Eloy, Jdforrester-WMF, brion, ThurnerRupert, intracer, TerraCodes, Pokefan95, gerritbot, -jem-, Bawolff, MZMcBride, Milimetric, Thryduulf, JEumerus, MarkTraceur, Yurik, Matanya, ekkis, matmarex, Lydia_Pintscher, Aklapper, Steinsplitter, StudiesWorld, DannyH, Riley_Huntley, D3r1ck01, Izno, JAllemandou, Wikidata-bugs, aude, El_Grafo, jayvdb, Ricordisamoa, Shizhao, Fabrice_Florin, Mbch331, Jay8g, Krenair, jeremyb___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T120452: Allow structured datasets on a central repository (CSV, TSV, JSON, GeoJSON, XML, ...)
Yurik edited blocking tasks, added: T137929: RFC (WIP): Enable shared tabular data storage on a central wiki, T137930: Enable shared geojson data storage on a shared wiki; removed: T134426: Review shared data namespace (tabular data) implementation. TASK DETAILhttps://phabricator.wikimedia.org/T120452EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: YurikCc: RobLa-WMF, TheDJ, Eloy, Jdforrester-WMF, brion, ThurnerRupert, intracer, TerraCodes, Pokefan95, gerritbot, -jem-, Bawolff, MZMcBride, Milimetric, Thryduulf, JEumerus, MarkTraceur, Yurik, Matanya, ekkis, matmarex, Lydia_Pintscher, Aklapper, Steinsplitter, StudiesWorld, DannyH, Riley_Huntley, D3r1ck01, Izno, JAllemandou, Wikidata-bugs, aude, El_Grafo, jayvdb, Ricordisamoa, Shizhao, Fabrice_Florin, Mbch331, Jay8g, Krenair, jeremyb___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T134426: Review shared data namespace (tabular data) implementation
Yurik removed a blocked task: T120452: Allow structured datasets on a central repository (CSV, TSV, JSON, GeoJSON, XML, ...). TASK DETAILhttps://phabricator.wikimedia.org/T134426EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: YurikCc: pwalsh, rufuspollock, RobLa-WMF, Danny_B, DannyH, StudiesWorld, Steinsplitter, Aklapper, Lydia_Pintscher, ekkis, Matanya, MarkTraceur, JEumerus, Thryduulf, Milimetric, MZMcBride, Bawolff, -jem-, gerritbot, Pokefan95, TerraCodes, intracer, ThurnerRupert, brion, Jdforrester-WMF, Eloy, TheDJ, Yurik, Zppix, Riley_Huntley, D3r1ck01, Izno, Luke081515, JAllemandou, Wikidata-bugs, aude, El_Grafo, jayvdb, Ricordisamoa, Shizhao, fbstj, Fabrice_Florin, Mbch331, Jay8g, Krenair, jeremyb___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Changed Project Column] T106094: Add support for wikidata tag to iD (OpenStreetMap)
Yurik moved this task to Tracking on the Maps workboard. TASK DETAIL https://phabricator.wikimedia.org/T106094 WORKBOARD https://phabricator.wikimedia.org/project/board/1127/ EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: mxn, Yurik Cc: StudiesWorld, Qgil, phabyogi, Lydia_Pintscher, Pigsonthewing, mxn, Aklapper, debt, Gehel, Lynhg, Izno, lxbarth, Wikidata-bugs, Malyacko, aude, Deskana, Yurik, scfc, Mbch331, Jay8g ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Changed Project Column] T106094: Add support for wikidata tag to iD (OpenStreetMap)
Yurik moved this task to Related on the Maps workboard. Herald added a subscriber: StudiesWorld. TASK DETAIL https://phabricator.wikimedia.org/T106094 WORKBOARD https://phabricator.wikimedia.org/project/board/1127/ EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: mxn, Yurik Cc: StudiesWorld, Qgil, phabyogi, Lydia_Pintscher, Pigsonthewing, mxn, Aklapper, debt, Gehel, Lynhg, Izno, lxbarth, Wikidata-bugs, Malyacko, aude, Deskana, Yurik, scfc, Mbch331, Jay8g ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T126730: Caching for results of wikidatasparql queries for Graphs
Yurik added a comment. I think Graph extension was shown as an example that can easily overwhelm the system without proper caching. More elaborate, research-oriented usages are usually different because they are being done interactively by the query developer. TASK DETAIL https://phabricator.wikimedia.org/T126730 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: Christopher, Yurik, hoo, Aklapper, aude, Izno, Wikidata-bugs, Mbch331, Jay8g, Ltrlg ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T126730: Caching for results of wikidatasparql queries for Graphs
Yurik added a subscriber: Yurik. Yurik added a comment. I agree that the query should go through varnish, but as usual - what is the purging policy? It will be very complicated to track each piece of data that appears in the result back to the original, and to invalidate it when original changes. We could introduce "its ok to be stale" argument, and allow manual cache flushing. - In VCL, check if request headers `Allow-Stale` is set, return the cached value. Or use some max age setting. - If request has no special headers, treat it as "cache for a minute maximum" - to prevent DOSing TASK DETAIL https://phabricator.wikimedia.org/T126730 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: Yurik, hoo, Aklapper, aude, Izno, Wikidata-bugs, Mbch331, Jay8g, Ltrlg ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T126741: Add support for the wikidata's Sparql queries to graphs
Yurik added a project: Wikidata-Query-Service. Yurik set Security to None. Herald added projects: Wikidata, Discovery. TASK DETAIL https://phabricator.wikimedia.org/T126741 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: Ricordisamoa, Smalyshev, aude, Aklapper, Yurik, StudiesWorld, debt, Gehel, Izno, jkroll, Wikidata-bugs, Jdouglas, Deskana, Manybubbles, Mbch331, Jay8g, Ltrlg ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T124569: RFC: Data namespace blob storage on wikidata.org
Yurik added a comment. Lydia, do all the raised issues get resolved if this was not wikidata.org ? TASK DETAIL https://phabricator.wikimedia.org/T124569 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: Addshore, aude, hoo, JanZerebecki, MZMcBride, Lydia_Pintscher, tstarling, daniel, MaxSem, Tfinc, Milimetric, Aklapper, Yurik, StudiesWorld, Izno, Luke081515, Wikidata-bugs, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T126730: [RFC] Caching for results of wikidatasparql queries for Graphs
Yurik added a comment. @smalyshev, I think the question is what to make "default": - should query results be cached by default, and not cached when a certain parameter is given, or the other way around? - should that parameter be part of the query, or should it be a header? - do we want to treat identical queries sent with and without "force" as being the same, so that if I force a query, it updates the cache for the non-forced ones? If so, will we need special varnish handling of this? - should non-cached queries still be cached for a much shorter period, like 5 seconds? TASK DETAIL https://phabricator.wikimedia.org/T126730 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: Ricordisamoa, daniel, Lydia_Pintscher, Smalyshev, Jonas, Christopher, Yurik, hoo, Aklapper, aude, debt, Gehel, Izno, Luke081515, jkroll, Wikidata-bugs, Jdouglas, Deskana, Manybubbles, Mbch331, Jay8g, Ltrlg ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T126730: [RFC] Caching for results of wikidatasparql queries for Graphs
Yurik added a comment. Clarification: there is a graph design sandbox <https://en.wikipedia.org/wiki/Special:GraphSandbox>, which re-renders the graph on every change. In production, the data is pulled by graphoid service (rarely, as it is behind varnish cache), and by client browsers (when users click the graph to make them interactive). TASK DETAIL https://phabricator.wikimedia.org/T126730 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: GWicke, Bene, Ricordisamoa, daniel, Lydia_Pintscher, Smalyshev, Jonas, Christopher, Yurik, hoo, Aklapper, aude, debt, Gehel, Izno, Luke081515, jkroll, Wikidata-bugs, Jdouglas, Deskana, Manybubbles, Mbch331, Jay8g, Ltrlg ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Retitled] T126730: [RFC] Caching for results of wikidata Sparql queries
Yurik changed the title from "[RFC] Caching for results of wikidatasparql queries for Graphs" to "[RFC] Caching for results of wikidata Sparql queries". Yurik edited the task description. TASK DETAIL https://phabricator.wikimedia.org/T126730 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: GWicke, Bene, Ricordisamoa, daniel, Lydia_Pintscher, Smalyshev, Jonas, Christopher, Yurik, hoo, Aklapper, aude, debt, Gehel, Izno, Luke081515, jkroll, Wikidata-bugs, Jdouglas, Deskana, Manybubbles, Mbch331, Jay8g, Ltrlg ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Changed Subscribers] T126730: [RFC] Caching for results of wikidata Sparql queries
Yurik added a subscriber: BBlack. Yurik added a comment. Adding @bblack as he is our Varnish guru TASK DETAIL https://phabricator.wikimedia.org/T126730 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: BBlack, GWicke, Bene, Ricordisamoa, daniel, Lydia_Pintscher, Smalyshev, Jonas, Christopher, Yurik, hoo, Aklapper, aude, debt, Gehel, Izno, Luke081515, jkroll, Wikidata-bugs, Jdouglas, Deskana, Manybubbles, Mbch331, Jay8g, Ltrlg ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T126730: [RFC] Caching for results of wikidata Sparql queries
Yurik added a comment. @bblack, for some unknown reason our SPARQL installation uses GET. TASK DETAIL https://phabricator.wikimedia.org/T126730 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: BBlack, GWicke, Bene, Ricordisamoa, daniel, Lydia_Pintscher, Smalyshev, Jonas, Christopher, Yurik, hoo, Aklapper, aude, debt, Gehel, Izno, Luke081515, jkroll, Wikidata-bugs, Jdouglas, Deskana, Manybubbles, Mbch331, Jay8g, Ltrlg ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Slowvote] [Commented On] V8: Should Wikidata Query Service SPARQL endpoint be cached by default?
Yurik added a subscriber: Yurik. Yurik added a comment. Users who need uncached data will always do an extra step (like adding an extra parameter to the query) to make sure it is not cached. But if we make caching non-default, fewer developers will bother to check if is cached or not, either because they might be inexperienced, or because they simply assumed that the service is already being cached. SLOWVOTE DESCRIPTION With raising usage for Wikidata we need to have a solution for caching SPARQL query results. Which should be the default mode for SPARQL endpoint? SLOWVOTE DETAIL https://phabricator.wikimedia.org/V8 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev, Yurik Cc: Yurik, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Manybubbles ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Slowvote] [Commented On] V8: Should Wikidata Query Service SPARQL endpoint be cached by default?
Yurik added a comment. @Bene, the developer of the tool will have an ability to control caching - by either forcing freshed data, or being ok with the stale data. The real question is what is more likely - developer reading documentation to make sure they add "stale is ok" parameter, or developer seeing that their tool produces stale result and adding "stale is not ok" parameter. I think developers are more likely to fix the second problem than to notice that their query is always forcing server to regenerate. SLOWVOTE DESCRIPTION With raising usage for Wikidata we need to have a solution for caching SPARQL query results. Which should be the default mode for SPARQL endpoint? SLOWVOTE DETAIL https://phabricator.wikimedia.org/V8 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev, Yurik Cc: Bene, Yurik, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Manybubbles ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Edited] T126730: [RFC] Caching for results of wikidata Sparql queries
Yurik edited the task description. TASK DETAIL https://phabricator.wikimedia.org/T126730 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: BBlack, GWicke, Bene, Ricordisamoa, daniel, Lydia_Pintscher, Smalyshev, Jonas, Christopher, Yurik, hoo, Aklapper, aude, debt, Gehel, Izno, Luke081515, jkroll, Wikidata-bugs, Jdouglas, Deskana, Manybubbles, Mbch331, Jay8g, Ltrlg ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T126730: [RFC] Caching for results of wikidata Sparql queries
Yurik added a comment. @smalyshev, I agree - it would be much better to have a stable mature caching technology for this - makes things much simpler. TASK DETAIL https://phabricator.wikimedia.org/T126730 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: BBlack, GWicke, Bene, Ricordisamoa, daniel, Lydia_Pintscher, Smalyshev, Jonas, Christopher, Yurik, hoo, Aklapper, aude, debt, Gehel, Izno, Luke081515, jkroll, Wikidata-bugs, Jdouglas, Deskana, Manybubbles, Mbch331, Jay8g, Ltrlg ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T124569: RFC: Data namespace blob storage on wikidata.org
Yurik added a comment. I listed PROs and CONs for each domain. Did I miss anything? https://meta.wikimedia.org/wiki/User:Yurik/Storing_data TASK DETAIL https://phabricator.wikimedia.org/T124569 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: Addshore, aude, hoo, JanZerebecki, MZMcBride, Lydia_Pintscher, tstarling, daniel, MaxSem, Tfinc, Milimetric, Aklapper, Yurik, StudiesWorld, Izno, Luke081515, Wikidata-bugs, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Changed Subscribers] T126730: [RFC] Caching for results of wikidata Sparql queries
Yurik added a subscriber: Milimetric. Yurik added a comment. I am not sure we should mix response caching and stored procedures (named queries) in the same task. Stored proc could add additional settings for cache, but I feel this is outside of the scope of this ticket. @bblack, my understanding is that Wikidata has almost no "timeseries" - requested with `before <= X < after`. Time-based filters rarely relate to `"now"`. For example, it could be a query to get all the generals who were involved in a war of 1812 - fixed dates. Of course there could be a query like `"current president"`, but that's not time, that's preferred value, i.e. regular stale cache problem that's common to all queries. It seems there are two types of queries - "viewers" that draw pretty pictures, and "editors" that are used for editing wikidata and finding errors. While "viewers" can get stale data (hours/days), "editors" need more recent data (minutes). "editors" do not need absolutely latest data, because if you run a query and it gives you that Q55 has bad data, you will still load Q55 to see what it has, and edit it. And even then, there could be a race condition. Btw, with ETag, even if something is cached in Varnish for a minute, client may not have to re-download several hours later if the new result has the same ETag as the last one -- Varnish should take care of that. We can distinguish between "editor" and "viewer" queries with an extra URL param, or with a header (can support both). The query param could be handled and removed in VCL. My concern - should the result be cached by default for "viewer" usecase, and require "editors" to supply an extra param, or the other way around? My opinion is that developers will go out of their way to make sure it works right (e.g. by adding a "no-caching" parameter), but in general will not deal with performance (it already works fast enough, I don't see a problem, I won't look closely at the documentation to discover the "caching is ok" parameter). @SMalyshev, i just spoke with @milimetric in analytics - he has a similar problem in the sense that external api is used by graphs. And we agreed that its not really a problem, and does not even need that much caching. The reason for it is because there will be very few graphs (relatively) that will query backend, and when they do, they will be cached in the Varnish that handles graph images. So I suspect this is won't be a problem any time soon in here as well. TASK DETAIL https://phabricator.wikimedia.org/T126730 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: Milimetric, Gehel, BBlack, GWicke, Bene, Ricordisamoa, daniel, Lydia_Pintscher, Smalyshev, Jonas, Christopher, Yurik, hoo, Aklapper, aude, debt, Izno, Luke081515, jkroll, Wikidata-bugs, Jdouglas, Deskana, Manybubbles, Mbch331, Jay8g, Ltrlg ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T126730: [RFC] Caching for results of wikidata Sparql queries
Yurik added a comment. Data is requested in these cases: - user views a page with a graph -> request to graphoid -> varnish cache miss -> graphoid re-renders the graph - user views a page with an interactive graph and clicks it to interact with it - editor clicks "page preview" - editor changes a graph and saves -> graph has a new hash -> (same as first bullet because it's a cache miss) Data is NOT requested: - during the page save - after page save that did not change the graph itself - if graph is part of a template, and tons of pages get updated until that page is visited by some user TASK DETAIL https://phabricator.wikimedia.org/T126730 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: Milimetric, Gehel, BBlack, GWicke, Bene, Ricordisamoa, daniel, Lydia_Pintscher, Smalyshev, Jonas, Christopher, Yurik, hoo, Aklapper, aude, debt, Izno, Luke081515, jkroll, Wikidata-bugs, Jdouglas, Deskana, Manybubbles, Mbch331, Jay8g, Ltrlg ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T126730: [RFC] Caching for results of wikidata Sparql queries
Yurik added a comment. That's relatively easy - I could disable wikidataquery: protocol in the client, while still allowing it on the backend. Thing is, I highly doubt there are that many people who will click on an interactive graph - simply because it requires programming skills to create an interactive graph, plus most of the time users will not click on it even when reading a page. So I think we are being overly cautious here without a reason. TASK DETAIL https://phabricator.wikimedia.org/T126730 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: Milimetric, Gehel, BBlack, GWicke, Bene, Ricordisamoa, daniel, Lydia_Pintscher, Smalyshev, Jonas, Christopher, Yurik, hoo, Aklapper, aude, debt, Izno, Luke081515, jkroll, Wikidata-bugs, Jdouglas, Deskana, Manybubbles, Mbch331, Jay8g, Ltrlg ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Changed Subscribers] T96490: [Story] Blazegraph support for owl:sameAs and redirects
Yurik added a subscriber: Yurik. TASK DETAIL https://phabricator.wikimedia.org/T96490 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: Yurik, JanZerebecki, Denny, mkroetzsch, Lydia_Pintscher, M.schmidt00, Beebs.systap, Haasepeter, Thompsonbry.systap, Thompsonbry, daniel, Manybubbles, Aklapper, Smalyshev, debt, Gehel, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Deskana, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Changed Project Column] T126741: Add support for the wikidata's Sparql queries to graphs
Yurik moved this task to Tracking on the Graph workboard. TASK DETAIL https://phabricator.wikimedia.org/T126741 WORKBOARD https://phabricator.wikimedia.org/project/board/816/ EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: Ricordisamoa, Smalyshev, aude, Aklapper, Yurik, StudiesWorld, debt, Gehel, Izno, jkroll, Wikidata-bugs, Jdouglas, Deskana, Manybubbles, Mbch331, Jay8g, Ltrlg ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Changed Project Column] T126730: [RFC] Caching for results of wikidata Sparql queries
Yurik moved this task to Tracking on the Graph workboard. TASK DETAIL https://phabricator.wikimedia.org/T126730 WORKBOARD https://phabricator.wikimedia.org/project/board/816/ EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: Milimetric, Gehel, BBlack, GWicke, Bene, Ricordisamoa, daniel, Lydia_Pintscher, Smalyshev, Jonas, Christopher, Yurik, hoo, Aklapper, aude, debt, Izno, Luke081515, jkroll, Wikidata-bugs, Jdouglas, Deskana, Manybubbles, Mbch331, Jay8g, Ltrlg ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T120452: Allow tabular datasets on Commons (or some similar central repository) (CSV, TSV, JSON, XML)
Yurik added a comment. I think the best way forward is to post on commons proposing to add a new namespace there. Also, to email all the relevant mailing lists, including various ambasadors, etc, and post on wikitech news for the next week, all linking to the proposal to host it on commons, and to the various options proposed. I think that will get people to express their opinion faster. Subject - something like "sharing commons as data storage", and text that links to all the relevant discussions, with a clearly stated location for where the discussion should take place. TASK DETAIL https://phabricator.wikimedia.org/T120452 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: MZMcBride, Alkamid, Milimetric, Thryduulf, JEumerus, MarkTraceur, Yurik, Matanya, ekkis, matmarex, Lydia_Pintscher, Aklapper, Steinsplitter, StudiesWorld, DannyH, D3r1ck01, Izno, Wikidata-bugs, aude, Bawolff, El_Grafo, Ricordisamoa, Fabrice_Florin, Mbch331, Jay8g, Krenair ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T120452: Allow tabular datasets on Commons (or some similar central repository) (CSV, TSV, JSON, XML)
Yurik added a comment.
@Bawolff Lua supports mw.text.jsonDecode(), which is great for these pages -
if we keep TSV in a schema like
{
"columns": ...
"data":[
[1,2,3],
[4,5,6],
...
]
}
TASK DETAIL
https://phabricator.wikimedia.org/T120452
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Milimetric, Yurik
Cc: Bawolff, MZMcBride, Alkamid, Milimetric, Thryduulf, JEumerus, MarkTraceur,
Yurik, Matanya, ekkis, matmarex, Lydia_Pintscher, Aklapper, Steinsplitter,
StudiesWorld, DannyH, D3r1ck01, Izno, Wikidata-bugs, aude, El_Grafo,
Ricordisamoa, Fabrice_Florin, Mbch331, Jay8g, Krenair
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T93878: Property suggester broken on Wikidata
Yurik added a comment. I am not sure if this is the same issue, but when i tried to fill in the fairly rare https://phabricator.wikimedia.org/P1410 for California, which has "required qualifier", it showed me options like "image source", which obviously has nothing to do with https://phabricator.wikimedia.org/P1410. It would be a great help if when I fill out the property, it would automatically show first required, and later - optional qualifiers, so that I don't have to search for them. TASK DETAIL https://phabricator.wikimedia.org/T93878 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Lydia_Pintscher, Yurik Cc: Yurik, Aklapper, aude, D3r1ck01, Izno, Wikidata-bugs, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T120452: Allow tabular datasets on Commons (or some similar central repository) (CSV, TSV, JSON, XML)
Yurik added a comment. @MZMcBride agree that this is highly needed, especially now with graphs. Deciding which wiki <https://meta.wikimedia.org/wiki/User:Yurik/Storing_data> to host it seems to be the hardest problem (i can easily do the rest with content handler in jsonconfig extension). TASK DETAIL https://phabricator.wikimedia.org/T120452 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: MZMcBride, Alkamid, Milimetric, Thryduulf, JEumerus, MarkTraceur, Yurik, Matanya, ekkis, matmarex, Lydia_Pintscher, Aklapper, Steinsplitter, StudiesWorld, DannyH, D3r1ck01, Izno, Wikidata-bugs, aude, Bawolff, El_Grafo, Ricordisamoa, Fabrice_Florin, Mbch331, Jay8g, Krenair ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Slowvote] [Commented On] V8: Should Wikidata Query Service SPARQL endpoint be cached by default?
Yurik added a comment. @Dereckson, this question is only about the default behavior - we obviously should allow for some "force refresh" method for bots, but it could be some extra flag like "force=1". My biggest concern is that developers won't use "allowcaching=1" because they might not know about it, thus we won't know when its ok to cache and when its not, and will start to cache for everything. Whereas if we allow "force=1", the devs who need it will find it and use it, and those who don't care will get the proper cached results. SLOWVOTE DESCRIPTION With raising usage for Wikidata we need to have a solution for caching SPARQL query results. Which should be the default mode for SPARQL endpoint? See also: https://phabricator.wikimedia.org/T126730 SLOWVOTE DETAIL https://phabricator.wikimedia.org/V8 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev, Yurik Cc: Dereckson, MichaelSchoenitzer, Snipre, nichtich, Bene, Yurik, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Manybubbles ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T107595: [RFC] Multi-Content Revisions
Yurik added a comment.
Can we solve some of the proposed usecases by simply wraping "content" into a
higher level structure, e.g. json, to store multiple streams? For example, for
a hypothetical "tabular data", we could have
{
"license": "...",
"headers": [...],
"rows": [ [...], [...], ... ]
}
TASK DETAIL
https://phabricator.wikimedia.org/T107595
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: daniel, Yurik
Cc: Yurik, ArielGlenn, APerson, TomT0m, Krenair, intracer, Tgr, Qgil,
Tobi_WMDE_SW, Addshore, Lydia_Pintscher, cscott, PleaseStand, awight,
Ricordisamoa, GWicke, MarkTraceur, waldyrious, Legoktm, Aklapper,
Jdforrester-WMF, Ltrlg, brion, Spage, MZMcBride, daniel, D3r1ck01, Izno,
Wikidata-bugs, aude, jayvdb, fbstj, RobLa-WMF, Mbch331, Jay8g, bd808
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Edited] T124569: RFC: Data namespace blob storage on wikidata.org
Yurik edited the task description. TASK DETAIL https://phabricator.wikimedia.org/T124569 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: Ricordisamoa, Bene, Micru, Yair_rand, Addshore, aude, hoo, JanZerebecki, MZMcBride, Lydia_Pintscher, tstarling, daniel, MaxSem, Tfinc, Milimetric, Aklapper, Yurik, StudiesWorld, D3r1ck01, Izno, Luke081515, Wikidata-bugs, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Edited] T120452: Allow tabular datasets on Commons (or some similar central repository) (CSV, TSV, JSON, XML)
Yurik edited the task description. TASK DETAIL https://phabricator.wikimedia.org/T120452 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: Thryduulf, JEumerus, MarkTraceur, Yurik, Matanya, ekkis, matmarex, Lydia_Pintscher, Aklapper, Steinsplitter, StudiesWorld, DannyH, D3r1ck01, Izno, Wikidata-bugs, aude, Bawolff, El_Grafo, Ricordisamoa, Fabrice_Florin, Mbch331, Jay8g, Krenair ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Changed Subscribers] T120452: Allow tabular datasets on Commons (or some similar central repository) (CSV, TSV, JSON, XML)
Yurik added a subscriber: Milimetric.
Yurik added a comment.
Some of this functionality is already supported by JsonConfig extension, and
I will be happy to guide that approach. Also, I would advise against too many
data formats - we got burnt by it with the API. TSV/CSV are great for
representing tables, but their storage format is poorly defined when it comes
to escaping. So I would suggest TSV stored as JSON, e.g.
col1,col2,col3
10,20,30
50,60,70
to be stored as
{
"columns": ["col1", "col2", "col3"],
"data": [
[10, 20, 30],
[50, 60, 70]
]
}
There can be an api that handles this specific format and returns it as a TSV
for easier processing by graphs.
TASK DETAIL
https://phabricator.wikimedia.org/T120452
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Yurik
Cc: Milimetric, Thryduulf, JEumerus, MarkTraceur, Yurik, Matanya, ekkis,
matmarex, Lydia_Pintscher, Aklapper, Steinsplitter, StudiesWorld, DannyH,
D3r1ck01, Izno, Wikidata-bugs, aude, Bawolff, El_Grafo, Ricordisamoa,
Fabrice_Florin, Mbch331, Jay8g, Krenair
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T124569: RFC: Data namespace blob storage on wikidata.org
Yurik added a comment. Patch https://gerrit.wikimedia.org/r/#/c/281331/ implements support for on-wiki tabular storage. TASK DETAIL https://phabricator.wikimedia.org/T124569 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: Thryduulf, Ricordisamoa, Bene, Micru, Yair_rand, Addshore, aude, hoo, JanZerebecki, MZMcBride, Lydia_Pintscher, tstarling, daniel, MaxSem, Tfinc, Milimetric, Aklapper, Yurik, StudiesWorld, D3r1ck01, Izno, Luke081515, Wikidata-bugs, fbstj, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T120452: Allow tabular datasets on Commons (or some similar central repository) (CSV, TSV, JSON, XML)
Yurik added a comment. More important semi-bikeshed questions: - How should we store licenses? Is there a license ID of any sorts? I wouldn't want free form license field text if possible. - Are there any other metadata fields required? - Should we support datetime fields in mediawiki datetime format? (I would love to re-use all the Wikidata data types, but apparently it is not easy to refactor them out) TASK DETAIL https://phabricator.wikimedia.org/T120452 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: Eloy, Jdforrester-WMF, brion, ThurnerRupert, intracer, TerraCodes, Pokefan95, gerritbot, -jem-, Bawolff, MZMcBride, Milimetric, Thryduulf, JEumerus, MarkTraceur, Yurik, Matanya, ekkis, matmarex, Lydia_Pintscher, Aklapper, Steinsplitter, StudiesWorld, DannyH, Riley_Huntley, D3r1ck01, Izno, JAllemandou, Wikidata-bugs, aude, El_Grafo, Ricordisamoa, Shizhao, Fabrice_Florin, Mbch331, Jay8g, Krenair, jeremyb ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T120452: Allow tabular datasets on Commons (or some similar central repository) (CSV, TSV, JSON, XML)
Yurik added a comment.
JsonConfig can easily allow us to store all allowed licenses as a "config"
page - a JSON with a custom schema for licenses. This way we could have a wiki
page named **Config:Licenses.json** (bikesheding is welcome):
{
// License ID
"CC0-1.0": {
// Localized official name of the license. Do we need some 'short name'?
"name": {
"en": "Creative Commons Zero v1.0 Universal",
...
},
// Link to more information. Do we need multiple urls, e.g. FAQ vs
Legal Code?
"url": {
"en": "http://creativecommons.org/publicdomain/zero/1.0/;
},
// https://commons.wikimedia.org/wiki/File:Cc-zero.svg
"icon": "Cc-zero.svg",
// https://commons.wikimedia.org/wiki/File:CC0_button.svg
"button": "CC0_button.svg",
// if has a value, this license will be shown at the top before all
other licenses
// The license with the lowest number will be shown as the default
choice
"prefered": 1
},
...
}
TASK DETAIL
https://phabricator.wikimedia.org/T120452
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Yurik
Cc: TheDJ, Eloy, Jdforrester-WMF, brion, ThurnerRupert, intracer, TerraCodes,
Pokefan95, gerritbot, -jem-, Bawolff, MZMcBride, Milimetric, Thryduulf,
JEumerus, MarkTraceur, Yurik, Matanya, ekkis, matmarex, Lydia_Pintscher,
Aklapper, Steinsplitter, StudiesWorld, DannyH, Riley_Huntley, D3r1ck01, Izno,
JAllemandou, Wikidata-bugs, aude, El_Grafo, Ricordisamoa, Shizhao,
Fabrice_Florin, Mbch331, Jay8g, Krenair, jeremyb
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T120452: Allow tabular datasets on Commons (or some similar central repository) (CSV, TSV, JSON, XML)
Yurik added a comment. Another alternative is to actually reuse `.tabular` for storing this data, instead of creating a custom format. Also, .tabular could benefit from `"ordered"` meta tag to automatically resort values on save. No sorting is allowed on the fields of "localized" data type. "ordered": "id" // or "ordered": ["prefered", "id"] TASK DETAIL https://phabricator.wikimedia.org/T120452 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: TheDJ, Eloy, Jdforrester-WMF, brion, ThurnerRupert, intracer, TerraCodes, Pokefan95, gerritbot, -jem-, Bawolff, MZMcBride, Milimetric, Thryduulf, JEumerus, MarkTraceur, Yurik, Matanya, ekkis, matmarex, Lydia_Pintscher, Aklapper, Steinsplitter, StudiesWorld, DannyH, Riley_Huntley, D3r1ck01, Izno, JAllemandou, Wikidata-bugs, aude, El_Grafo, Ricordisamoa, Shizhao, Fabrice_Florin, Mbch331, Jay8g, Krenair, jeremyb ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T120452: Allow tabular datasets on Commons (or some similar central repository) (CSV, TSV, JSON, XML)
Yurik added a comment. Can the talk pages be used for deletion requests? TASK DETAIL https://phabricator.wikimedia.org/T120452 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: TheDJ, Eloy, Jdforrester-WMF, brion, ThurnerRupert, intracer, TerraCodes, Pokefan95, gerritbot, -jem-, Bawolff, MZMcBride, Milimetric, Thryduulf, JEumerus, MarkTraceur, Yurik, Matanya, ekkis, matmarex, Lydia_Pintscher, Aklapper, Steinsplitter, StudiesWorld, DannyH, Riley_Huntley, D3r1ck01, Izno, JAllemandou, Wikidata-bugs, aude, El_Grafo, Ricordisamoa, Shizhao, Fabrice_Florin, Mbch331, Jay8g, Krenair, jeremyb ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T120452: Allow tabular datasets on Commons (or some similar central repository) (CSV, TSV, JSON, XML)
Yurik added a comment. I'm totally ok to bikeshed about the naming: - for ID, it will be a list of strings named: "headers", "ids", "columns", "header_id", ... - for localized column name, it's a list of objects, each object having (language id -> string). We can call it "columns", "labels", "headers", ... ? TASK DETAIL https://phabricator.wikimedia.org/T120452 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: Eloy, Jdforrester-WMF, brion, ThurnerRupert, intracer, TerraCodes, Pokefan95, gerritbot, -jem-, Bawolff, MZMcBride, Alkamid, Milimetric, Thryduulf, JEumerus, MarkTraceur, Yurik, Matanya, ekkis, matmarex, Lydia_Pintscher, Aklapper, Steinsplitter, StudiesWorld, DannyH, Riley_Huntley, D3r1ck01, Izno, JAllemandou, Wikidata-bugs, aude, El_Grafo, Ricordisamoa, Shizhao, Fabrice_Florin, Mbch331, Jay8g, Krenair, jeremyb ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Changed Subscribers] T120452: Allow tabular datasets on Commons (or some similar central repository) (CSV, TSV, JSON, XML)
Yurik added a subscriber: Eloy.
Yurik added a comment.
@brion, the pretty printing is for diffs - makes them much easier to digest.
A while ago I also tried to make the actual storage use a non-pretty-printed
version, but I guess I never finished that part.
@brion, re spaces in headers - I want header names to be identifiers - after
all, the target audience is Lua scripts and Graphs - both are programming
languages. It makes it much easier to use, because i can simply say
`datum.buildingHeight` instead of `datum["building height"]` in vega or in Lua.
@Eloy has made some suggestions <http://data.wmflabs.org/wiki/Testwiki:Coffee>
on how to localize them, and I think we should go with the second option -
"headers.i18n": [ { "en":"blah", "fr": "blah", ...}, ...] for header
localization.
@matmarex, exactly - the page-size limitation restricts how these datasets
are used. In a way, this is a much easier to implement and more flexible
"multi-stream" proposal, that will allow editors to create shared lists and
tables. The giant dataset storage with the proper query interface is a
separate task all together. We want to have it, but it is a much bigger target
with a much bigger resource requirements.
P.S. For some reason I don't get email notifications from phab anymore :(
TASK DETAIL
https://phabricator.wikimedia.org/T120452
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Yurik
Cc: Eloy, Jdforrester-WMF, brion, ThurnerRupert, intracer, TerraCodes,
Pokefan95, gerritbot, -jem-, Bawolff, MZMcBride, Alkamid, Milimetric,
Thryduulf, JEumerus, MarkTraceur, Yurik, Matanya, ekkis, matmarex,
Lydia_Pintscher, Aklapper, Steinsplitter, StudiesWorld, DannyH, Riley_Huntley,
D3r1ck01, Izno, JAllemandou, Wikidata-bugs, aude, El_Grafo, Ricordisamoa,
Shizhao, Fabrice_Florin, Mbch331, Jay8g, Krenair, jeremyb
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T120452: Allow tabular datasets on Commons (or some similar central repository) (CSV, TSV, JSON, XML)
Yurik added a comment. Name game: "inheritFrom", "deriveFrom", "ref", "link", "metadata", ...? Still open question: where to get the license ids and their descriptions :) TASK DETAIL https://phabricator.wikimedia.org/T120452 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: TheDJ, Eloy, Jdforrester-WMF, brion, ThurnerRupert, intracer, TerraCodes, Pokefan95, gerritbot, -jem-, Bawolff, MZMcBride, Milimetric, Thryduulf, JEumerus, MarkTraceur, Yurik, Matanya, ekkis, matmarex, Lydia_Pintscher, Aklapper, Steinsplitter, StudiesWorld, DannyH, Riley_Huntley, D3r1ck01, Izno, JAllemandou, Wikidata-bugs, aude, El_Grafo, Ricordisamoa, Shizhao, Fabrice_Florin, Mbch331, Jay8g, Krenair, jeremyb ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T120452: Allow tabular datasets on Commons (or some similar central repository) (CSV, TSV, JSON, XML)
Yurik added a comment.
@jeumerus, adding a tag to the structured content (json) is not as obvious as
for free form wiki markup. We could interpret some meta fields as wiki
markup...
So far this is the the structure I'm going for:
{
"license": "licence-id", // do we have these IDs in core somewhere?
"info": {
"lang-id": "description in that language", // plain text, localized
...
},
"wikimarkup": "Any wiki markup, including [[category:my category]] and
{{delete|me}}", // better name?
"headers": [ "header1", ... ], // non-localized
"titles": [
{ "en": "header one", "ru": "первая колонка", ... }, // plain text,
localized
...
],
"types": [ "string", "localized", "number", "boolean" ],
"rows": [ [...], [...], [...] ]
}
TASK DETAIL
https://phabricator.wikimedia.org/T120452
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Yurik
Cc: TheDJ, Eloy, Jdforrester-WMF, brion, ThurnerRupert, intracer, TerraCodes,
Pokefan95, gerritbot, -jem-, Bawolff, MZMcBride, Milimetric, Thryduulf,
JEumerus, MarkTraceur, Yurik, Matanya, ekkis, matmarex, Lydia_Pintscher,
Aklapper, Steinsplitter, StudiesWorld, DannyH, Riley_Huntley, D3r1ck01, Izno,
JAllemandou, Wikidata-bugs, aude, El_Grafo, Ricordisamoa, Shizhao,
Fabrice_Florin, Mbch331, Jay8g, Krenair, jeremyb
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T120452: Allow tabular datasets on Commons (or some similar central repository) (CSV, TSV, JSON, XML)
Yurik added a comment. An extra feature could be `"headersRef": "Some other table.tabular"` instead of "headers" and "titles", allowing headers to be defined in another table. This way many identically structured tables can benefit from the shared localization. TASK DETAIL https://phabricator.wikimedia.org/T120452 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: TheDJ, Eloy, Jdforrester-WMF, brion, ThurnerRupert, intracer, TerraCodes, Pokefan95, gerritbot, -jem-, Bawolff, MZMcBride, Milimetric, Thryduulf, JEumerus, MarkTraceur, Yurik, Matanya, ekkis, matmarex, Lydia_Pintscher, Aklapper, Steinsplitter, StudiesWorld, DannyH, Riley_Huntley, D3r1ck01, Izno, JAllemandou, Wikidata-bugs, aude, El_Grafo, Ricordisamoa, Shizhao, Fabrice_Florin, Mbch331, Jay8g, Krenair, jeremyb ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T120452: Allow tabular datasets on Commons (or some similar central repository) (CSV, TSV, JSON, XML)
Yurik added a comment. I found MediaWiki:Licenses <https://commons.wikimedia.org/wiki/MediaWiki:Licenses> - I am not sure what it is used for. There are translations in the subpages. Also, there is a list in preferences <https://commons.wikimedia.org/wiki/Special:Preferences#mw-prefsection-uploads> that I don't know what code controls. I don't want to create a separate licensing system for this, so looking for some ideas. TASK DETAIL https://phabricator.wikimedia.org/T120452 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: TheDJ, Eloy, Jdforrester-WMF, brion, ThurnerRupert, intracer, TerraCodes, Pokefan95, gerritbot, -jem-, Bawolff, MZMcBride, Milimetric, Thryduulf, JEumerus, MarkTraceur, Yurik, Matanya, ekkis, matmarex, Lydia_Pintscher, Aklapper, Steinsplitter, StudiesWorld, DannyH, Riley_Huntley, D3r1ck01, Izno, JAllemandou, Wikidata-bugs, aude, El_Grafo, Ricordisamoa, Shizhao, Fabrice_Florin, Mbch331, Jay8g, Krenair, jeremyb ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T124569: RFC: Data namespace blob storage on wikidata.org
Yurik added a comment. There is a big discussion on Commons <https://commons.wikimedia.org/wiki/Commons:Village_pump/Proposals#Tabular_data_storage_for_Commons.21> related to this issue. @Lydia_Pintscher and @daniel, you might want to elaborate there why Wikidata is not the right place. The overwhelming majority so far are in favor of putting data on Commons, but few opposing votes do bring valid concerns. TASK DETAIL https://phabricator.wikimedia.org/T124569 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: Thryduulf, Ricordisamoa, Bene, Micru, Yair_rand, Addshore, aude, hoo, JanZerebecki, MZMcBride, Lydia_Pintscher, tstarling, daniel, MaxSem, Tfinc, Milimetric, Aklapper, Yurik, StudiesWorld, D3r1ck01, Izno, Luke081515, Wikidata-bugs, fbstj, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T135222: Add Timeline display to visualize query results
Yurik added a comment. Lol, seems like this is really peaking up :) I have been trying to formalize it for the past several years, and finally wrote a blog post <https://meta.wikimedia.org/wiki/User:Yurik/Facebooking_Wikidata> about it. I think this should not be a query result view, but rather a regular wikidata page view. TASK DETAIL https://phabricator.wikimedia.org/T135222 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: Yurik, Lydia_Pintscher, Jonas, Aklapper, Zppix, WikidataFacts, Avner, debt, Gehel, D3r1ck01, FloNight, Izno, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Deskana, Manybubbles, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Closed] T126741: Add support for the wikidata's Sparql queries to graphs
Yurik closed this task as "Resolved". Yurik added a comment. yep TASK DETAIL https://phabricator.wikimedia.org/T126741 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: Stashbot, JanZerebecki, gerritbot, Yair_rand, Ricordisamoa, Smalyshev, aude, Aklapper, Yurik, StudiesWorld, Avner, debt, Gehel, D3r1ck01, FloNight, Izno, jkroll, Wikidata-bugs, Jdouglas, Deskana, Manybubbles, fbstj, Mbch331, Jay8g, Ltrlg ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T120452: Allow tabular datasets on Commons (or some similar central repository) (CSV, TSV, JSON, XML)
Yurik removed a blocking task: T124569: RFC: Data namespace blob storage on wikidata.org. TASK DETAIL https://phabricator.wikimedia.org/T120452 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: TheDJ, Eloy, Jdforrester-WMF, brion, ThurnerRupert, intracer, TerraCodes, Pokefan95, gerritbot, -jem-, Bawolff, MZMcBride, Milimetric, Thryduulf, JEumerus, MarkTraceur, Yurik, Matanya, ekkis, matmarex, Lydia_Pintscher, Aklapper, Steinsplitter, StudiesWorld, DannyH, Riley_Huntley, D3r1ck01, Izno, JAllemandou, Wikidata-bugs, aude, El_Grafo, Ricordisamoa, Shizhao, Fabrice_Florin, Mbch331, Jay8g, Krenair, jeremyb ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T124569: RFC: Data namespace blob storage on wikidata.org
Yurik removed a blocked task: T120452: Allow tabular datasets on Commons (or some similar central repository) (CSV, TSV, JSON, XML). TASK DETAIL https://phabricator.wikimedia.org/T124569 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: Thryduulf, Ricordisamoa, Bene, Micru, Yair_rand, Addshore, aude, hoo, JanZerebecki, MZMcBride, Lydia_Pintscher, tstarling, daniel, MaxSem, Tfinc, Milimetric, Aklapper, Yurik, StudiesWorld, D3r1ck01, Izno, Luke081515, Wikidata-bugs, fbstj, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T120452: Allow tabular datasets on Commons (or some similar central repository) (CSV, TSV, JSON, XML)
Yurik added a comment. I removed https://phabricator.wikimedia.org/T124569 because with https://phabricator.wikimedia.org/T134426 this task could be marked as done (unless we want to keep it open for non-tabular - json/xml data) TASK DETAIL https://phabricator.wikimedia.org/T120452 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: TheDJ, Eloy, Jdforrester-WMF, brion, ThurnerRupert, intracer, TerraCodes, Pokefan95, gerritbot, -jem-, Bawolff, MZMcBride, Milimetric, Thryduulf, JEumerus, MarkTraceur, Yurik, Matanya, ekkis, matmarex, Lydia_Pintscher, Aklapper, Steinsplitter, StudiesWorld, DannyH, Riley_Huntley, D3r1ck01, Izno, JAllemandou, Wikidata-bugs, aude, El_Grafo, Ricordisamoa, Shizhao, Fabrice_Florin, Mbch331, Jay8g, Krenair, jeremyb ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T134426: Review shared data namespace (tabular data) implementation
Yurik added a comment. My apologies to anyone who is not interested in the implementation review of this feature - please unsubscribe. I am hoping to deploy this fairly soon, as there is clearly a huge demand for this functionality, so any feedback would be great. Thanks! TASK DETAIL https://phabricator.wikimedia.org/T134426 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: DannyH, StudiesWorld, Steinsplitter, Aklapper, Lydia_Pintscher, ekkis, Matanya, MarkTraceur, JEumerus, Thryduulf, Milimetric, MZMcBride, Bawolff, -jem-, gerritbot, Pokefan95, TerraCodes, intracer, ThurnerRupert, brion, Jdforrester-WMF, Eloy, TheDJ, Yurik, Zppix, Riley_Huntley, D3r1ck01, Izno, Luke081515, JAllemandou, Wikidata-bugs, aude, El_Grafo, Ricordisamoa, Shizhao, fbstj, Fabrice_Florin, Mbch331, Jay8g, Krenair, jeremyb ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T134238: Query service fails with "Too many open files"
Yurik added a comment. Probably 0 at the moment - I don't think there are any interactive graphs out there that use sparql yet. Only a few non-interactive samples <https://www.mediawiki.org/wiki/Extension:Graph/Demo/Sparql> (btw, there is another bug there - the order of latitude & longitude seemed to have switched.) TASK DETAIL https://phabricator.wikimedia.org/T134238 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel, Yurik Cc: Yurik, Smalyshev, Joe, Stashbot, Envlh, JanZerebecki, hoo, Frog23, Karima, Aklapper, Yair_rand, Zppix, Avner, debt, Gehel, D3r1ck01, FloNight, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Deskana, Manybubbles, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T134426: Review shared data namespace (tabular data) implementation
Yurik added a comment. In https://phabricator.wikimedia.org/T134426#2268988, @Danny_B wrote: > Please use class="wikitable" as default formatting. Already done <https://github.com/wikimedia/mediawiki-extensions-JsonConfig/blob/afca31c4ad2d71a513421ed58d1d2a26dc42d794/includes/JCTabularContent.php#L38> In https://phabricator.wikimedia.org/T134426#2268991, @Danny_B wrote: > Please use `.tab` extension instead of `.tabular` (more language independent). Agree, `.tab` might sound better. As long as its not `.tsv` which has a very specific meaning. TASK DETAIL https://phabricator.wikimedia.org/T134426 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: Danny_B, DannyH, StudiesWorld, Steinsplitter, Aklapper, Lydia_Pintscher, ekkis, Matanya, MarkTraceur, JEumerus, Thryduulf, Milimetric, MZMcBride, Bawolff, -jem-, gerritbot, Pokefan95, TerraCodes, intracer, ThurnerRupert, brion, Jdforrester-WMF, Eloy, TheDJ, Yurik, Zppix, Riley_Huntley, D3r1ck01, Izno, Luke081515, JAllemandou, Wikidata-bugs, aude, El_Grafo, Ricordisamoa, Shizhao, fbstj, Fabrice_Florin, Mbch331, Jay8g, Krenair, jeremyb ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T134426: Review shared data namespace (tabular data) implementation
Yurik added a comment. I will create a new project with all related tasks. Waiting for my approval to be able to create new projects myself - I seem to be doing it too often. Will post it here once its created. TASK DETAIL https://phabricator.wikimedia.org/T134426 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: Danny_B, DannyH, StudiesWorld, Steinsplitter, Aklapper, Lydia_Pintscher, ekkis, Matanya, MarkTraceur, JEumerus, Thryduulf, Milimetric, MZMcBride, Bawolff, -jem-, gerritbot, Pokefan95, TerraCodes, intracer, ThurnerRupert, brion, Jdforrester-WMF, Eloy, TheDJ, Yurik, Zppix, Riley_Huntley, D3r1ck01, Izno, Luke081515, JAllemandou, Wikidata-bugs, aude, El_Grafo, Ricordisamoa, Shizhao, fbstj, Fabrice_Florin, Mbch331, Jay8g, Krenair, jeremyb ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T134426: Review shared data namespace (tabular data) implementation
Yurik added a comment. Ah, sorry, that's for transclusions that will only work on the same wiki. So are you proposing the whole table use wikitable style without any additional styles for the cells? or green cells are ok? TASK DETAIL https://phabricator.wikimedia.org/T134426 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: Danny_B, DannyH, StudiesWorld, Steinsplitter, Aklapper, Lydia_Pintscher, ekkis, Matanya, MarkTraceur, JEumerus, Thryduulf, Milimetric, MZMcBride, Bawolff, -jem-, gerritbot, Pokefan95, TerraCodes, intracer, ThurnerRupert, brion, Jdforrester-WMF, Eloy, TheDJ, Yurik, Zppix, Riley_Huntley, D3r1ck01, Izno, Luke081515, JAllemandou, Wikidata-bugs, aude, El_Grafo, Ricordisamoa, Shizhao, fbstj, Fabrice_Florin, Mbch331, Jay8g, Krenair, jeremyb ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Changed Project Column] T120452: Allow tabular datasets on Commons (or some similar central repository) (CSV, TSV, JSON, XML)
Yurik moved this task from Backlog to Tracking on the Tabular-Data board. TASK DETAIL https://phabricator.wikimedia.org/T120452 WORKBOARD https://phabricator.wikimedia.org/project/board/1986/ EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: TheDJ, Eloy, Jdforrester-WMF, brion, ThurnerRupert, intracer, TerraCodes, Pokefan95, gerritbot, -jem-, Bawolff, MZMcBride, Milimetric, Thryduulf, JEumerus, MarkTraceur, Yurik, Matanya, ekkis, matmarex, Lydia_Pintscher, Aklapper, Steinsplitter, StudiesWorld, DannyH, Riley_Huntley, D3r1ck01, Izno, JAllemandou, Wikidata-bugs, aude, El_Grafo, Ricordisamoa, Shizhao, Fabrice_Florin, Mbch331, Jay8g, Krenair, jeremyb ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T134426: Review shared data namespace (tabular data) implementation
Yurik added a project: Tabular-Data. Yurik added a comment. New project tag: https://phabricator.wikimedia.org/tag/tabular-data/ TASK DETAIL https://phabricator.wikimedia.org/T134426 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: Danny_B, DannyH, StudiesWorld, Steinsplitter, Aklapper, Lydia_Pintscher, ekkis, Matanya, MarkTraceur, JEumerus, Thryduulf, Milimetric, MZMcBride, Bawolff, -jem-, gerritbot, Pokefan95, TerraCodes, intracer, ThurnerRupert, brion, Jdforrester-WMF, Eloy, TheDJ, Yurik, Zppix, Riley_Huntley, D3r1ck01, Izno, Luke081515, JAllemandou, Wikidata-bugs, aude, El_Grafo, Ricordisamoa, Shizhao, fbstj, Fabrice_Florin, Mbch331, Jay8g, Krenair, jeremyb ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T120452: Allow tabular datasets on Commons (or some similar central repository) (CSV, TSV, JSON, XML)
Yurik added a project: Tabular-Data. TASK DETAIL https://phabricator.wikimedia.org/T120452 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: TheDJ, Eloy, Jdforrester-WMF, brion, ThurnerRupert, intracer, TerraCodes, Pokefan95, gerritbot, -jem-, Bawolff, MZMcBride, Milimetric, Thryduulf, JEumerus, MarkTraceur, Yurik, Matanya, ekkis, matmarex, Lydia_Pintscher, Aklapper, Steinsplitter, StudiesWorld, DannyH, Riley_Huntley, D3r1ck01, Izno, JAllemandou, Wikidata-bugs, aude, El_Grafo, Ricordisamoa, Shizhao, Fabrice_Florin, Mbch331, Jay8g, Krenair, jeremyb ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T134426: Review shared data namespace (tabular data) implementation
Yurik created this task. Herald added a subscriber: Zppix. TASK DESCRIPTION Please review implementation details of the cross-wiki sharable data namespace implementation for tabular data: - usage and technical description <https://www.mediawiki.org/wiki/Extension:JsonConfig/Tabular> - demo <http://data.wmflabs.org/wiki/Data:Sample.tabular> - community discussion <https://commons.wikimedia.org/wiki/Commons:Village_pump/Proposals#Tabular_data_storage_for_Commons.21> TASK DETAIL https://phabricator.wikimedia.org/T134426 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: DannyH, StudiesWorld, Steinsplitter, Aklapper, Lydia_Pintscher, matmarex, ekkis, Matanya, MarkTraceur, JEumerus, Thryduulf, Milimetric, MZMcBride, Bawolff, -jem-, gerritbot, Pokefan95, TerraCodes, intracer, ThurnerRupert, brion, Jdforrester-WMF, Eloy, TheDJ, Yurik, Zppix, Riley_Huntley, D3r1ck01, Izno, Luke081515, JAllemandou, Wikidata-bugs, aude, El_Grafo, Ricordisamoa, Shizhao, fbstj, Fabrice_Florin, Mbch331, Jay8g, Krenair, jeremyb ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Block] T120452: Allow tabular datasets on Commons (or some similar central repository) (CSV, TSV, JSON, XML)
Yurik created blocking task T134426: Review shared data namespace (tabular data) implementation. TASK DETAIL https://phabricator.wikimedia.org/T120452 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: TheDJ, Eloy, Jdforrester-WMF, brion, ThurnerRupert, intracer, TerraCodes, Pokefan95, gerritbot, -jem-, Bawolff, MZMcBride, Milimetric, Thryduulf, JEumerus, MarkTraceur, Yurik, Matanya, ekkis, matmarex, Lydia_Pintscher, Aklapper, Steinsplitter, StudiesWorld, DannyH, Riley_Huntley, D3r1ck01, Izno, JAllemandou, Wikidata-bugs, aude, El_Grafo, Ricordisamoa, Shizhao, Fabrice_Florin, Mbch331, Jay8g, Krenair, jeremyb ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T120452: Allow tabular datasets on Commons (or some similar central repository) (CSV, TSV, JSON, XML)
Yurik added a comment. merged, please take a look at https://commons.wikimedia.org/wiki/Commons:Village_pump/Proposals#Tabular_data_storage_for_Commons.21 @matmarex , JsonConfig is an extension I built a while ago for storing structured data on wiki and making it available from another wiki. Basically it was a refactoring of my Zero code, to allow this functionality to be shared. It was already used for data namespace for storing JSON (for a limited deployment), but I decided to make some more improvements before promoting it for a wider audience. JsonConfig is a misnomer - because it was initially thought to be for configurations rather any data, even though the code is actually identical. We could of course rename it, but I don't think it is worth the hassle. TASK DETAIL https://phabricator.wikimedia.org/T120452 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: TerraCodes, Pokefan95, gerritbot, -jem-, Bawolff, MZMcBride, Alkamid, Milimetric, Thryduulf, JEumerus, MarkTraceur, Yurik, Matanya, ekkis, matmarex, Lydia_Pintscher, Aklapper, Steinsplitter, StudiesWorld, DannyH, Riley_Huntley, D3r1ck01, Izno, JAllemandou, Wikidata-bugs, aude, El_Grafo, Ricordisamoa, Shizhao, Fabrice_Florin, Mbch331, Jay8g, Krenair, jeremyb ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T120452: Allow tabular datasets on Commons (or some similar central repository) (CSV, TSV, JSON, XML)
Yurik added a comment.
@brion, could you think of use cases for partial data reads? I think it will
be mostly "draw data as a wiki list or a table with some magical
highlighting/string concatenation/...", or "draw a graph with all the data".
That's why at this point I simply provide Lua's
`mw.data.getData("page_name.tabular")`, which returns the whole thing as JSON
decoded into a Lua table structure. I see no reason not to provide
`mw.data.query("SELECT field1 FROM page_name WHERE field2 > 10")`, but that's a
whole other ball game :)
Also, adding JSON storage should provide an easy solution for lookups, e.g.
`mw.data.lookup("page_name.json", "top-level-field-value")`, which could be
very efficient for large but shallow jsons.
TASK DETAIL
https://phabricator.wikimedia.org/T120452
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Yurik
Cc: Jdforrester-PERSONAL, Jdforrester-WMF, brion, ThurnerRupert, intracer,
TerraCodes, Pokefan95, gerritbot, -jem-, Bawolff, MZMcBride, Alkamid,
Milimetric, Thryduulf, JEumerus, MarkTraceur, Yurik, Matanya, ekkis, matmarex,
Lydia_Pintscher, Aklapper, Steinsplitter, StudiesWorld, DannyH, Riley_Huntley,
D3r1ck01, Izno, JAllemandou, Wikidata-bugs, aude, El_Grafo, Ricordisamoa,
Shizhao, Fabrice_Florin, Mbch331, Jay8g, Krenair, jeremyb
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Changed Subscribers] T120452: Allow tabular datasets on Commons (or some similar central repository) (CSV, TSV, JSON, XML)
Yurik added subscribers: Jdforrester-WMF, Jdforrester-PERSONAL. Yurik added a comment. Juts wrote in-depth implementation details at https://www.mediawiki.org/wiki/Extension:JsonConfig/Tabular TASK DETAIL https://phabricator.wikimedia.org/T120452 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: Jdforrester-PERSONAL, Jdforrester-WMF, brion, ThurnerRupert, intracer, TerraCodes, Pokefan95, gerritbot, -jem-, Bawolff, MZMcBride, Alkamid, Milimetric, Thryduulf, JEumerus, MarkTraceur, Yurik, Matanya, ekkis, matmarex, Lydia_Pintscher, Aklapper, Steinsplitter, StudiesWorld, DannyH, Riley_Huntley, D3r1ck01, Izno, JAllemandou, Wikidata-bugs, aude, El_Grafo, Ricordisamoa, Shizhao, Fabrice_Florin, Mbch331, Jay8g, Krenair, jeremyb ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T124569: RFC: Data namespace blob storage on wikidata.org
Yurik added a comment. @Milimetric the new board is at https://phabricator.wikimedia.org/tag/tabular-data/. I agree with the concerns you raise, and I see a significant portion of the community has raised them on wiki. I think we should continue the discussion there, because otherwise we risk splintering the discussion into multiple unrelated and unconnected branches. Also, lets start putting down some ideas that have been floating around to the help page <https://www.mediawiki.org/wiki/Help:Tabular_data> I just created. Any changes are welcome :) TASK DETAIL https://phabricator.wikimedia.org/T124569 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Yurik Cc: Danny_B, Thryduulf, Ricordisamoa, Bene, Micru, Yair_rand, Addshore, aude, hoo, JanZerebecki, MZMcBride, Lydia_Pintscher, tstarling, daniel, MaxSem, Tfinc, Milimetric, Aklapper, Yurik, StudiesWorld, D3r1ck01, Izno, Luke081515, Wikidata-bugs, fbstj, Mbch331, Jay8g ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T110683: [Story] Add convenience method in lua that gives the ItemId of the connected page
Yurik added a comment. @hoo did you add a parser function as well, or should I create a new task?TASK DETAILhttps://phabricator.wikimedia.org/T110683EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, YurikCc: Yurik, gerritbot, Ricordisamoa, Aklapper, aude, D3r1ck01, Izno, Wikidata-bugs, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T141864: Add parser function for associated wikidata item ID
Yurik added a comment.
I think we should do the parser function, not a magic keyword. This way we can expand it to do a page lookup. For example, {{ ENTITYID | United States }} is replaced with Q30. The optional first parameter would be the valid page title, as parsed by the local wiki. This will also allow us to easily do {{ ENTITYID | en:United States }} in another Wikipedia language, and still get Q30.TASK DETAILhttps://phabricator.wikimedia.org/T141864EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: YurikCc: Zppix, Steenth, Metalindustrien, Sjoerddebruin, matej_suchanek, Lydia_Pintscher, hoo, Aklapper, Yurik, D3r1ck01, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T110683: [Story] Add convenience method in lua that gives the ItemId of the connected page
Yurik added a comment. I think this should be extended to wiki markup parser function - there are cases when i need the wikidata id of the current pageTASK DETAILhttps://phabricator.wikimedia.org/T110683EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: YurikCc: Yurik, gerritbot, Ricordisamoa, Aklapper, aude, Lewizho99, Maathavan, D3r1ck01, Izno, Wikidata-bugs, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T115966: Show map for coordinate diffs
Yurik added a comment. Please do not load Leaflet. Use Kartographer extension (already enabled on Wikidata) to show the map as needed. @JGirault has been working on building a proper internal interface for it, which is already customized with the proper attribution, settings, etc. We should work in sync on this.TASK DETAILhttps://phabricator.wikimedia.org/T115966EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: YurikCc: JGirault, Yurik, Lydia_Pintscher, Sjoerddebruin, Ricordisamoa, Nikki, Aklapper, Ddproxy, D3r1ck01, Susannaanas, Izno, ferdbold, Wikidata-bugs, aude, Mbch331, Jay8g___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T115966: Show map for coordinate diffs
Yurik added a subscriber: JGirault.Yurik added a project: Kartographer. TASK DETAILhttps://phabricator.wikimedia.org/T115966EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: YurikCc: JGirault, Yurik, Lydia_Pintscher, Sjoerddebruin, Ricordisamoa, Nikki, Aklapper, Ddproxy, D3r1ck01, Susannaanas, Izno, ferdbold, Wikidata-bugs, aude, Mbch331, Jay8g___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T138868: Create integrated GeoShapes + Wikidata Query service
Yurik created this task.Yurik added projects: Kartotherian, Wikidata.Herald added subscribers: Zppix, Aklapper. TASK DESCRIPTIONKartotherian is now capable of retrieving outlines of geographical objects based on a list Wikidata IDs. This is great when the list of IDs is small and constant or easy to calculate by using wiki markup (example) geoshape:///?ids=Q99,Q173,Q724,Q759,Q771,Q779,... -- gets all US states as one topojson Yet clearly it would be better to have a query-based service, where user would supply a SPARQL query (e.g. "get all US states, with their names and population"), and plot that as the result. We should also consider how the proposed Wikidata Query pages would work with this capability (e.g. another parameter to get a list of data?)TASK DETAILhttps://phabricator.wikimedia.org/T138868EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: YurikCc: Lydia_Pintscher, daniel, Smalyshev, Aklapper, MaxSem, Yurik, Zppix, D3r1ck01, Izno, Wikidata-bugs, aude, Mbch331, Jay8g___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T138868: Create integrated GeoShapes + Wikidata Query service
Yurik added a project: Maps.Yurik added a comment.Herald added a project: Discovery. geoshape:///?sparql=SELECT%20... (string after "#" in Wikidata Query Service) The service will attach geoshapes for the first N itemsTASK DETAILhttps://phabricator.wikimedia.org/T138868EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: YurikCc: Lydia_Pintscher, daniel, Smalyshev, Aklapper, MaxSem, Yurik, Zppix, Avner, debt, Gehel, JGirault, D3r1ck01, phabyogi, FloNight, Susannaanas, Izno, lxbarth, Planemad, Wikidata-bugs, aude, Deskana, Mbch331, Jay8g___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T157182: Duplicate language codes in labeling service cause unexpected result
Yurik created this task.Yurik added a project: Wikidata-Query-Service.Herald added a subscriber: Aklapper.Herald added projects: Wikidata, Discovery.
TASK DESCRIPTIONThis query produces French label/description, even though one would expect English
SELECT ?id ?idLabel ?idDescription
WHERE {
VALUES ?id { wd:Q4167410 }
SERVICE wikibase:label { bd:serviceParam wikibase:language "en,fr,en" . }
}TASK DETAILhttps://phabricator.wikimedia.org/T157182EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: YurikCc: Smalyshev, Aklapper, Yurik, EBjune, merbst, Avner, debt, Gehel, D3r1ck01, Jonas, FloNight, Xmlizer, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Deskana, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Edited] T156220: Wikidata autocomplete breaks with URL ...?uselang=en-US
Yurik edited the task description. (Show Details) EDIT DETAILSFor some reason, I ended up with several browser tabs that all had `?uselang=en-US` query param. Attempting to add a statement failed to show any suggestions until I manually removed the query param from the URL. Very confusing. I tried it in Chrome (logged in) and Firefox (not logged in), with the same result. There were no other statements on the item when i tried it, but not sure if that's relevant. Setting language to English would reload the page but wouldn't solve the problem. Repo: * Open an item like https://www.wikidata.org/wiki/Q25454422?uselang=en-US * Try to add a statement * Observe that there is no auto-suggested properties * Remove the query portion of the URL - now everything worksTASK DETAILhttps://phabricator.wikimedia.org/T156220EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: YurikCc: Lydia_Pintscher, daniel, Aklapper, Yurik, D3r1ck01, Izno, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T156220: Wikidata autocomplete breaks when with URL ...?uselang=en-US
Yurik created this task.Yurik added a project: Wikidata.Herald added a subscriber: Aklapper. TASK DESCRIPTIONFor some reason, I ended up with several browser tabs that all had ?uselang=en-US query param. Attempting to add a statement failed to show any suggestions until I manually removed the query param from the URL. Very confusing. I tried it in Chrome (logged in) and Firefox (not logged in), with the same result. There were no other statements on the item when i tried it, but not sure if that's relevant. Setting language to English would reload the page but wouldn't solve the problem.TASK DETAILhttps://phabricator.wikimedia.org/T156220EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: YurikCc: Lydia_Pintscher, daniel, Aklapper, Yurik, D3r1ck01, Izno, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Retitled] T156220: Wikidata autocomplete breaks with URL ...?uselang=en-US
Yurik changed the title from "Wikidata autocomplete breaks when with URL ...?uselang=en-US" to "Wikidata autocomplete breaks with URL ...?uselang=en-US". TASK DETAILhttps://phabricator.wikimedia.org/T156220EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: YurikCc: Lydia_Pintscher, daniel, Aklapper, Yurik, D3r1ck01, Izno, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T89213: Allow fallback to any language
Yurik added a comment. I'm on the fence about the "languages using the same script as the requested one" is the best path forward. For example, if a Russian user tries to get a label that has Ukranian and English, which should be preferable? I would argue that in a general case, Latin-based scripts have a greater universal appeal (at least in Russian schools Latin script was studied very early on), but I don't know the situation in other countries.TASK DETAILhttps://phabricator.wikimedia.org/T89213EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: YurikCc: Yurik, Sjoerddebruin, Nemo_bis, Liuxinyu970226, daniel, Lydia_Pintscher, Aklapper, Bugreporter, D3r1ck01, Izno, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T159106: Show P31 in the Wikidata search results
Yurik added a comment. @Lydia_Pintscher, showing description assumes that it is given for each item. Never the case. Any time i search in wikidata, it shows me useless Qnnn, or at most a label, because the search does not use language fallbacks. P-31/P-279 have much higher chance of having more informative label/description than the item itself, especially in the language i'm searching.TASK DETAILhttps://phabricator.wikimedia.org/T159106EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: YurikCc: Lydia_Pintscher, Esc3300, Aklapper, Yurik, D3r1ck01, Izno, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Edited] T159106: Show P31 in the Wikidata search results
Yurik edited the task description. (Show Details) EDIT DETAILSI think the most useful piece of information when searching is P 31. Please consider showing it in the search results.TASK DETAILhttps://phabricator.wikimedia.org/T159106EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: YurikCc: Aklapper, Yurik, D3r1ck01, Izno, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Closed] T138868: Create integrated GeoShapes + Wikidata Query service
Yurik closed this task as "Resolved".Yurik claimed this task.Yurik added a comment. already done: https://maps.wikimedia.org/geoshape?query=TASK DETAILhttps://phabricator.wikimedia.org/T138868EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: YurikCc: Lydia_Pintscher, daniel, Smalyshev, Aklapper, MaxSem, Yurik, Zppix, mschwarzer, Avner, debt, Gehel, JGirault, D3r1ck01, phabyogi, FloNight, Susannaanas, Izno, lxbarth, Planemad, Wikidata-bugs, aude, Deskana, Mbch331, Jay8g___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T141394: Add a "search location" box in the map dialog (VE edit)
Yurik added a project: Maps.Herald added a project: Discovery. TASK DETAILhttps://phabricator.wikimedia.org/T141394EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: YurikCc: Esanders, Yurik, Aklapper, eranroz, mschwarzer, merbst, Avner, Ddproxy, Wess, debt, Gehel, JGirault, D3r1ck01, phabyogi, FloNight, Susannaanas, Izno, ferdbold, lxbarth, Jrf, Husun1297, Planemad, Wikidata-bugs, Etonkovidova, aude, Deskana, Swainr, Jdforrester-WMF, MaxSem, Mbch331, Jay8g___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T115966: [Story] Show map for coordinate diffs
Yurik added a project: Maps.Herald added a project: Discovery. TASK DETAILhttps://phabricator.wikimedia.org/T115966EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Sjoerddebruin, YurikCc: aude, JGirault, Yurik, Lydia_Pintscher, Sjoerddebruin, Ricordisamoa, Nikki, Aklapper, mschwarzer, dachary, Avner, Ddproxy, debt, Gehel, D3r1ck01, phabyogi, FloNight, Susannaanas, Izno, ferdbold, lxbarth, Planemad, Wikidata-bugs, Deskana, MaxSem, Mbch331, Jay8g___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T140757: Review CoordinateDiffMap.js Userscript
Yurik added a project: Maps.Herald added a project: Discovery. TASK DETAILhttps://phabricator.wikimedia.org/T140757EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: YurikCc: aude, Zppix, Aklapper, Nikki, Ricordisamoa, Sjoerddebruin, Lydia_Pintscher, Yurik, JGirault, Tobi_WMDE_SW, mschwarzer, dachary, Avner, Ddproxy, debt, Gehel, D3r1ck01, phabyogi, FloNight, Susannaanas, Izno, ferdbold, lxbarth, Planemad, Wikidata-bugs, Deskana, MaxSem, Mbch331, Jay8g___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T145171: without lat/long should use coordinates from Wikidata
Yurik created this task.Yurik added projects: Kartographer, Wikidata, Maps.Herald added a subscriber: Aklapper.Herald added a project: Discovery. TASK DESCRIPTIONWhen is placed on a page, it should automatically use the corresponding coordinates from Wikidata's itemTASK DETAILhttps://phabricator.wikimedia.org/T145171EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: YurikCc: daniel, MaxSem, Lydia_Pintscher, Aklapper, Yurik, mschwarzer, Avner, Ddproxy, debt, Gehel, JGirault, D3r1ck01, phabyogi, FloNight, Susannaanas, Izno, ferdbold, lxbarth, Planemad, Wikidata-bugs, aude, Deskana, Mbch331, Jay8g___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Changed Subscribers] T120452: Allow structured datasets on a central repository (CSV, TSV, JSON, GeoJSON, XML, ...)
Yurik added a subscriber: daniel.Yurik added a comment. @ArthurPSmith thanks, timeseries do represent a large portion of the common data needs. I have discussed reusing some of the Wikibase type system code with @daniel, but apparently their code is fairly Wikibase centric, especially in the front end, and it might be difficult to reuse. I certainly hope that at some point we will be able to do that. Until then, I am hoping to launch a generic tabular service with a limited subset of types, and later move on to integrate more of Wikibase's work into it.TASK DETAILhttps://phabricator.wikimedia.org/T120452EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: YurikCc: daniel, ArthurPSmith, RobLa-WMF, TheDJ, Eloy, Jdforrester-WMF, brion, ThurnerRupert, intracer, TerraCodes, Pokefan95, gerritbot, -jem-, Bawolff, MZMcBride, Milimetric, Thryduulf, JEumerus, MarkTraceur, Yurik, Matanya, ekkis, matmarex, Lydia_Pintscher, Aklapper, Steinsplitter, StudiesWorld, DannyH, V4switch, D3r1ck01, Izno, JAllemandou, Wikidata-bugs, matthiasmullie, aude, El_Grafo, jayvdb, Ricordisamoa, Shizhao, Fabrice_Florin, Mbch331, Jay8g, Krenair, jeremyb___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Edited] T147729: wikibase:language ignores language codes with a space
Yurik edited the task description. (Show Details) EDIT DETAILSThis query did not produce Armenian labels for many items even though they actually exist, only because of the extra space in the language code list. I think the labeling service should be more tolerant, or it should raise an error. Silent ignore is the worst. ```lang=sql SELECT ?item ?itemLabel...TASK DETAILhttps://phabricator.wikimedia.org/T147729EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: YurikCc: Smalyshev, Aklapper, Yurik, mschwarzer, Avner, debt, Gehel, D3r1ck01, Jonas, FloNight, Xmlizer, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Deskana, Manybubbles, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T149281: Fix Governor's demo - party affiliations
Yurik created this task.Yurik added projects: Maps, Interactive-Sprint, Easy, Wikidata-Query-Service.Herald added subscribers: TerraCodes, Aklapper.Herald added projects: Wikidata, Discovery. TASK DESCRIPTIONPlease fix https://www.mediawiki.org/wiki/Help:Extension:Kartographer - governor's demo. The SPARQL query gets "party" (if multiple, gets any one), and compares it with Democrat and Republican Qid. The "getting any" behavior is non-deterministic, and sometimes I see Mark Dayton as either Democrat or independent. Please change it to explicitly check if entry has Democrat/Republic party link (without end date), and if either both are false or both are true, treat it as independent (or an error?).TASK DETAILhttps://phabricator.wikimedia.org/T149281EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Smalyshev, YurikCc: Aklapper, TerraCodes, Yurik, mschwarzer, Avner, debt, Gehel, JGirault, D3r1ck01, Jonas, phabyogi, FloNight, Xmlizer, MuhammadShuaib, Susannaanas, Izno, lxbarth, jkroll, Planemad, Smalyshev, Wikidata-bugs, Jdouglas, aude, Deskana, Manybubbles, MaxSem, Mbch331, Jay8g___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
