Manybubbles added a comment. In https://phabricator.wikimedia.org/T90119#1065635, @Manybubbles wrote:
> In https://phabricator.wikimedia.org/T90119#1065623, @Thompsonbry.systap > wrote: > > > The RDR inlining of reified statement models is handled by the > > StatementBuffer class. It is important to have a limited lexical scope in > > the dump for the different RDF triples involved in the reified statement > > model. The code needs to buffer incomplete statement models until they > > become complete statement models, at which point it can release the storage > > associated with the partial model and write it out. Also, if your output > > includes a lot of blank nodes, it is a Good Idea to have limited resolution > > scope for blank nodes since the parser must maintain them across the entire > > document. Thus, outputting an RDF dump as a series of files can reduce the > > parser overhead. > > > Are blanks nodes required for the RDR inlining? Is there any way in Turtle > or N-Triples to allow blank nodes to go out of scope? I ask because we'll > certainly be outputting the dump as a single large document - that is how our > dumps work and fighting against that would be difficult. We can create a > tool to slice it smaller if there isn't a standard way to control scope. > > I should note that this buffering thing removes one of the nicest parts about > N-Triples: you can no longer just slice it on any new line to generate > batches. Its context sensitive again. I should say I think that is a small price to pay for RDR inlining. TASK DETAIL https://phabricator.wikimedia.org/T90119 REPLY HANDLER ACTIONS Reply to comment or attach files, or !close, !claim, !unsubscribe or !assign <username>. EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Manybubbles Cc: Thompsonbry.systap, Smalyshev, Manybubbles, Aklapper, Haasepeter, Beebs.systap, daniel, jkroll, Wikidata-bugs, Jdouglas, aude, GWicke, JanZerebecki _______________________________________________ Wikidata-bugs mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
