[Wikidata-bugs] [Maniphest] [Updated] T88991: improve Wikidata dumps [tracking]
Bugreporter added a subtask: T229290: Incremental RDF dumps. TASK DETAIL https://phabricator.wikimedia.org/T88991 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Bugreporter Cc: Lazhar, PokestarFan, Ricordisamoa, Denis.bykov, Jimkont, JanZerebecki, aude, Manybubbles, hoo, bd808, ArielGlenn, mark, Lydia_Pintscher, daniel, ezachte, Aklapper, darthmon_wmde, DannyS712, Nickleh, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Wikidata-bugs, Svick, Mbch331, jeremyb ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T88991: improve Wikidata dumps [tracking]
hoo added a subtask: T115223: Provide wikidata downloads as multiple files to make access more robust and efficient . TASK DETAILhttps://phabricator.wikimedia.org/T88991EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Lazhar, PokestarFan, Ricordisamoa, Denis.bykov, Jimkont, JanZerebecki, aude, Liuxinyu970226, Manybubbles, hoo, bd808, ArielGlenn, mark, Lydia_Pintscher, daniel, ezachte, Aklapper, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, Svick, Mbch331, jeremyb___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T88991: improve Wikidata dumps [tracking]
hoo added a subtask: T191639: Wikidata JSON dumps do not have the 'ns' (namespace). TASK DETAILhttps://phabricator.wikimedia.org/T88991EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Lazhar, PokestarFan, Ricordisamoa, Denis.bykov, Jimkont, JanZerebecki, aude, Liuxinyu970226, Manybubbles, hoo, bd808, ArielGlenn, mark, Lydia_Pintscher, daniel, ezachte, Aklapper, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, Svick, Mbch331, jeremyb___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T88991: improve Wikidata dumps [tracking]
hoo added a subtask: T70792: Wikidata JSON dump: filename prefix. TASK DETAILhttps://phabricator.wikimedia.org/T88991EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Lazhar, PokestarFan, Ricordisamoa, Denis.bykov, Jimkont, JanZerebecki, aude, Liuxinyu970226, Manybubbles, hoo, bd808, ArielGlenn, mark, Lydia_Pintscher, daniel, ezachte, Aklapper, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, Svick, Mbch331, jeremyb___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T88991: improve Wikidata dumps [tracking]
hoo added a subtask: T155103: Create a truthy nt dump. TASK DETAILhttps://phabricator.wikimedia.org/T88991EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Lazhar, PokestarFan, Ricordisamoa, Denis.bykov, Jimkont, JanZerebecki, aude, Liuxinyu970226, Manybubbles, hoo, bd808, ArielGlenn, mark, Lydia_Pintscher, daniel, ezachte, Aklapper, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, Svick, Mbch331, jeremyb___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T88991: improve Wikidata dumps [tracking]
hoo added a subtask: T151876: Consider using pigz (Zopfli) for Wikidata JSON dump. TASK DETAILhttps://phabricator.wikimedia.org/T88991EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Lazhar, PokestarFan, Ricordisamoa, Denis.bykov, Jimkont, JanZerebecki, aude, Liuxinyu970226, Manybubbles, hoo, bd808, ArielGlenn, mark, Lydia_Pintscher, daniel, ezachte, Aklapper, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, Svick, Mbch331, jeremyb___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T88991: improve Wikidata dumps [tracking]
hoo added a subtask: T118379: bz2 dumps cannot be read with PHP. TASK DETAILhttps://phabricator.wikimedia.org/T88991EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Lazhar, PokestarFan, Ricordisamoa, Denis.bykov, Jimkont, JanZerebecki, aude, Liuxinyu970226, Manybubbles, hoo, bd808, ArielGlenn, mark, Lydia_Pintscher, daniel, ezachte, Aklapper, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, Svick, Mbch331, jeremyb___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T88991: improve Wikidata dumps [tracking]
hoo added a subtask: T185589: Repeating blank node ids in Wikidata entity RDF dumps. TASK DETAILhttps://phabricator.wikimedia.org/T88991EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Lazhar, PokestarFan, Ricordisamoa, Denis.bykov, Jimkont, JanZerebecki, aude, Liuxinyu970226, Manybubbles, hoo, bd808, ArielGlenn, mark, Lydia_Pintscher, daniel, ezachte, Aklapper, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, Svick, Mbch331, jeremyb___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T88991: improve Wikidata dumps [tracking]
hoo added a subtask: T187888: "Failed to dump Q12129 (Value must be at most 127 characters long.)" when dumping Wikidata as TTL. TASK DETAILhttps://phabricator.wikimedia.org/T88991EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Lazhar, PokestarFan, Ricordisamoa, Denis.bykov, Jimkont, JanZerebecki, aude, Liuxinyu970226, Manybubbles, hoo, bd808, ArielGlenn, mark, Lydia_Pintscher, daniel, ezachte, Aklapper, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, Svick, Mbch331, jeremyb___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T88991: improve Wikidata dumps [tracking]
hoo added a subtask: T179681: Add HDT dump of Wikidata. TASK DETAILhttps://phabricator.wikimedia.org/T88991EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: PokestarFan, Ricordisamoa, Denis.bykov, Jimkont, JanZerebecki, aude, Liuxinyu970226, Manybubbles, hoo, bd808, ArielGlenn, mark, Lydia_Pintscher, daniel, ezachte, Aklapper, Lahi, Gq86, GoranSMilovanovic, QZanden, Wikidata-bugs, Svick, Mbch331, jeremyb___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T88991: improve Wikidata dumps [tracking]
Smalyshev added a subtask: T178978: Include information about Wikidata dumps in Wikidata query service. TASK DETAILhttps://phabricator.wikimedia.org/T88991EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: PokestarFan, Ricordisamoa, Denis.bykov, Jimkont, JanZerebecki, aude, Liuxinyu970226, Manybubbles, hoo, bd808, ArielGlenn, mark, Lydia_Pintscher, daniel, ezachte, Aklapper, Lahi, Gq86, GoranSMilovanovic, QZanden, Wikidata-bugs, Svick, Mbch331, jeremyb___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T88991: improve Wikidata dumps [tracking]
Smalyshev added a subtask: T182348: dcatap.rdf in dumps contains invalid data. TASK DETAILhttps://phabricator.wikimedia.org/T88991EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: PokestarFan, Ricordisamoa, Denis.bykov, Jimkont, JanZerebecki, aude, Liuxinyu970226, Manybubbles, hoo, bd808, ArielGlenn, mark, Lydia_Pintscher, daniel, ezachte, Aklapper, Lahi, Gq86, GoranSMilovanovic, QZanden, Wikidata-bugs, Svick, Mbch331, jeremyb___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T88991: improve Wikidata dumps [tracking]
hoo added subtasks: T94019: Generate RDF from JSON, T144103: Create .nt (NTriples) dumps for wikidata data, T98320: [Task] Include redirects in JSON dumps, T162351: Create a "page prop" dump for Wikidata entities ("pagePropertiesRdf"). TASK DETAILhttps://phabricator.wikimedia.org/T88991EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Ricordisamoa, Denis.bykov, Jimkont, JanZerebecki, aude, Liuxinyu970226, Manybubbles, hoo, bd808, ArielGlenn, mark, Lydia_Pintscher, daniel, ezachte, Aklapper, QZanden, Salgo60, D3r1ck01, Izno, Wikidata-bugs, Svick, Mbch331, jeremyb___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T88991: improve Wikidata dumps
hoo added a blocked task: T72385: Wikidata JSON dump: file directory location should follow standard patterns. TASK DETAIL https://phabricator.wikimedia.org/T88991 REPLY HANDLER ACTIONS Reply to comment or attach files, or !close, !claim, !unsubscribe or !assign username. EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: hoo Cc: Jimkont, JanZerebecki, aude, Liuxinyu970226, Manybubbles, hoo, bd808, ArielGlenn, mark, Lydia_Pintscher, daniel, ezachte, Aklapper, Wikidata-bugs, Svick, jeremyb ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T88991: improve Wikidata dumps
hoo removed a blocked task: T72385: Wikidata JSON dump: file directory location should follow standard patterns. TASK DETAIL https://phabricator.wikimedia.org/T88991 REPLY HANDLER ACTIONS Reply to comment or attach files, or !close, !claim, !unsubscribe or !assign username. EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: hoo Cc: Jimkont, JanZerebecki, aude, Liuxinyu970226, Manybubbles, hoo, bd808, ArielGlenn, mark, Lydia_Pintscher, daniel, ezachte, Aklapper, Wikidata-bugs, Svick, jeremyb ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T88991: improve Wikidata dumps
hoo added a blocked task: T88991: improve Wikidata dumps. TASK DETAIL https://phabricator.wikimedia.org/T88991 REPLY HANDLER ACTIONS Reply to comment or attach files, or !close, !claim, !unsubscribe or !assign username. EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: hoo Cc: Jimkont, JanZerebecki, aude, Liuxinyu970226, Manybubbles, hoo, bd808, ArielGlenn, mark, Lydia_Pintscher, daniel, ezachte, Aklapper, Wikidata-bugs, Svick, jeremyb ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T88991: improve Wikidata dumps
hoo added blocking tasks: T93658: cron job to create RDF dumps, T72385: Wikidata JSON dump: file directory location should follow standard patterns. TASK DETAIL https://phabricator.wikimedia.org/T88991 REPLY HANDLER ACTIONS Reply to comment or attach files, or !close, !claim, !unsubscribe or !assign username. EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: hoo Cc: Jimkont, JanZerebecki, aude, Liuxinyu970226, Manybubbles, hoo, bd808, ArielGlenn, mark, Lydia_Pintscher, daniel, ezachte, Aklapper, Wikidata-bugs, Svick, jeremyb ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T88991: improve Wikidata dumps
Tobi_WMDE_SW added a blocking task: T73349: Fix empty map serialization behaviour. TASK DETAIL https://phabricator.wikimedia.org/T88991 REPLY HANDLER ACTIONS Reply to comment or attach files, or !close, !claim, !unsubscribe or !assign username. EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Tobi_WMDE_SW Cc: JanZerebecki, aude, Liuxinyu970226, Manybubbles, hoo, bd808, ArielGlenn, mark, Lydia_Pintscher, daniel, ezachte, Aklapper, Wikidata-bugs, Svick, jeremyb ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T88991: improve Wikidata dumps
Lydia_Pintscher added a blocking task: T91117: Empty JSON maps serialized as empty lists in XML dumps. TASK DETAIL https://phabricator.wikimedia.org/T88991 REPLY HANDLER ACTIONS Reply to comment or attach files, or !close, !claim, !unsubscribe or !assign username. EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Lydia_Pintscher Cc: aude, Liuxinyu970226, Manybubbles, hoo, bd808, ArielGlenn, mark, Lydia_Pintscher, daniel, ezachte, Aklapper, Wikidata-bugs, Jdouglas, Svick, jeremyb ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T88991: improve Wikidata dumps
ezachte added a blocking task: T89273: Produce stub dumps for all wikis as soon as a new month starts, then generate all other dumps on second round-robin cycle. TASK DETAIL https://phabricator.wikimedia.org/T88991 REPLY HANDLER ACTIONS Reply to comment or attach files, or !close, !claim, !unsubscribe or !assign username. EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: ezachte Cc: Manybubbles, hoo, bd808, ArielGlenn, mark, Lydia_Pintscher, daniel, ezachte, Aklapper, Wikidata-bugs, aude, Svick, jeremyb ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T88991: improve Wikidata dumps
Lydia_Pintscher added a blocking task: T85970: Some Wikidata XML dumps are failing. TASK DETAIL https://phabricator.wikimedia.org/T88991 REPLY HANDLER ACTIONS Reply to comment or attach files, or !close, !claim, !unsubscribe or !assign username. EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Lydia_Pintscher Cc: Manybubbles, hoo, bd808, ArielGlenn, mark, Lydia_Pintscher, daniel, ezachte, Aklapper, Wikidata-bugs, aude, Svick ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T88991: improve Wikidata dumps
Lydia_Pintscher added blocking tasks: T72247: provide latest link for JSON dumps, T72246: provide incremental JSON dumps for Wikidata, T70366: add script for stitching json dump shards, T46581: Partial RDF dumps, T46580: Script for creating RDF dumps of all entities, T85101: create index for each dump, T87283: Wikidata dumps should have revision ID or other sequence mark, T87329: update and consolidate json dump documentation, T85133: Introduce setting to allow import of entities from XML dumps., T85407: improve dump documentation, T87328: link to json dump documentation from dump site, T74348: Wikidata dumps contain old-style serialization.. TASK DETAIL https://phabricator.wikimedia.org/T88991 REPLY HANDLER ACTIONS Reply to comment or attach files, or !close, !claim, !unsubscribe or !assign username. EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Lydia_Pintscher Cc: Manybubbles, hoo, bd808, ArielGlenn, mark, Lydia_Pintscher, daniel, ezachte, Aklapper, Wikidata-bugs, aude, Svick ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T88991: improve Wikidata dumps
daniel added a blocking task: T56085: EntityIdValues should be serialized as strings, not type/number structures.. TASK DETAIL https://phabricator.wikimedia.org/T88991 REPLY HANDLER ACTIONS Reply to comment or attach files, or !close, !claim, !unsubscribe or !assign username. EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: daniel Cc: Manybubbles, hoo, bd808, ArielGlenn, mark, Lydia_Pintscher, daniel, ezachte, Aklapper, Wikidata-bugs, aude, Svick ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T88991: improve Wikidata dumps
daniel added a blocking task: T73992: JSON should (optionally) contain full URIs for referenced external entities. TASK DETAIL https://phabricator.wikimedia.org/T88991 REPLY HANDLER ACTIONS Reply to comment or attach files, or !close, !claim, !unsubscribe or !assign username. EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: daniel Cc: Manybubbles, hoo, bd808, ArielGlenn, mark, Lydia_Pintscher, daniel, ezachte, Aklapper, Wikidata-bugs, aude, Svick ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs