[jira] [Commented] (JENA-2167) Provide an RDF Binary format using Protobuf
[ https://issues.apache.org/jira/browse/JENA-2167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422953#comment-17422953 ] ASF subversion and git services commented on JENA-2167: --- Commit 0c0a509e3b0f5f636306275ef2b7ab273e99e1fc in jena's branch refs/heads/main from Andy Seaborne [ https://gitbox.apache.org/repos/asf?p=jena.git;h=0c0a509 ] Merge pull request #1079 from afs/fixes JENA-2172, JENA-2167 and small improvements. > Provide an RDF Binary format using Protobuf > --- > > Key: JENA-2167 > URL: https://issues.apache.org/jira/browse/JENA-2167 > Project: Apache Jena > Issue Type: New Feature >Affects Versions: Jena 4.2.0 >Reporter: Andy Seaborne >Assignee: Andy Seaborne >Priority: Major > Fix For: Jena 4.3.0 > > > To go along side the RDF Thrift encoding. > Sometimes, apps want protobuf encoded RDF, e.g. for use with gRPC. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (JENA-2167) Provide an RDF Binary format using Protobuf
[ https://issues.apache.org/jira/browse/JENA-2167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422951#comment-17422951 ] ASF subversion and git services commented on JENA-2167: --- Commit 2071508862313ab58296ef405f6ecc55ab0ba0a1 in jena's branch refs/heads/main from Andy Seaborne [ https://gitbox.apache.org/repos/asf?p=jena.git;h=2071508 ] JENA-2167: Flush output > Provide an RDF Binary format using Protobuf > --- > > Key: JENA-2167 > URL: https://issues.apache.org/jira/browse/JENA-2167 > Project: Apache Jena > Issue Type: New Feature >Affects Versions: Jena 4.2.0 >Reporter: Andy Seaborne >Assignee: Andy Seaborne >Priority: Major > Fix For: Jena 4.3.0 > > > To go along side the RDF Thrift encoding. > Sometimes, apps want protobuf encoded RDF, e.g. for use with gRPC. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (JENA-2167) Provide an RDF Binary format using Protobuf
[ https://issues.apache.org/jira/browse/JENA-2167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17419790#comment-17419790 ] ASF subversion and git services commented on JENA-2167: --- Commit 0ffb1a795d46a642ec6263838d565158f98564cd in jena's branch refs/heads/main from Andy Seaborne [ https://gitbox.apache.org/repos/asf?p=jena.git;h=0ffb1a7 ] Merge pull request #1076 from afs/rdf-protobuf JENA-2167: Protobuf based RDF binary format > Provide an RDF Binary format using Protobuf > --- > > Key: JENA-2167 > URL: https://issues.apache.org/jira/browse/JENA-2167 > Project: Apache Jena > Issue Type: New Feature >Affects Versions: Jena 4.2.0 >Reporter: Andy Seaborne >Assignee: Andy Seaborne >Priority: Major > > To go along side the RDF Thrift encoding. > Sometimes, apps want protobuf encoded RDF, e.g. for use with gRPC. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (JENA-2167) Provide an RDF Binary format using Protobuf
[ https://issues.apache.org/jira/browse/JENA-2167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17419788#comment-17419788 ] ASF subversion and git services commented on JENA-2167: --- Commit 1b5617dade712b6f16a4ea7b76469f67c9aff31f in jena's branch refs/heads/main from Andy Seaborne [ https://gitbox.apache.org/repos/asf?p=jena.git;h=1b5617d ] JENA-2167: Protobuf-based RDF binary format > Provide an RDF Binary format using Protobuf > --- > > Key: JENA-2167 > URL: https://issues.apache.org/jira/browse/JENA-2167 > Project: Apache Jena > Issue Type: New Feature >Affects Versions: Jena 4.2.0 >Reporter: Andy Seaborne >Assignee: Andy Seaborne >Priority: Major > > To go along side the RDF Thrift encoding. > Sometimes, apps want protobuf encoded RDF, e.g. for use with gRPC. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (JENA-2167) Provide an RDF Binary format using Protobuf
[ https://issues.apache.org/jira/browse/JENA-2167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17419789#comment-17419789 ] ASF subversion and git services commented on JENA-2167: --- Commit e1580129eb0aa823f2ea0eefc363e7d23ad5806d in jena's branch refs/heads/main from Andy Seaborne [ https://gitbox.apache.org/repos/asf?p=jena.git;h=e158012 ] JENA-2167: Add required text for Protobuf redistribution > Provide an RDF Binary format using Protobuf > --- > > Key: JENA-2167 > URL: https://issues.apache.org/jira/browse/JENA-2167 > Project: Apache Jena > Issue Type: New Feature >Affects Versions: Jena 4.2.0 >Reporter: Andy Seaborne >Assignee: Andy Seaborne >Priority: Major > > To go along side the RDF Thrift encoding. > Sometimes, apps want protobuf encoded RDF, e.g. for use with gRPC. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (JENA-2167) Provide an RDF Binary format using Protobuf
[ https://issues.apache.org/jira/browse/JENA-2167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17418752#comment-17418752 ] Andy Seaborne commented on JENA-2167: - Some initial figures. Parsing BSBM 25 million (which is large enough to get stable timing figures after warm up): Thrift: 1 million triples per second. Protobuf: 918kTPS N-Triples: 245kTPS The thrift rate is faster than last time I ran it. Same hardware, same code, newer Java (this is Java 17-ea) Suspicion: The protobuf is slightly slower because protobuf does not provide length delimited objects, where as Thrift encoding is self contained. The encoding of a graph is writing triples streaming fashion, each triple a Protobuf message. The protobuf way is to add a block length into the stream, and the extra decoding of this is slightly inefficient (it create two java objects per triple, rather than reuse existing objects). > Provide an RDF Binary format using Protobuf > --- > > Key: JENA-2167 > URL: https://issues.apache.org/jira/browse/JENA-2167 > Project: Apache Jena > Issue Type: New Feature >Affects Versions: Jena 4.2.0 >Reporter: Andy Seaborne >Assignee: Andy Seaborne >Priority: Major > > To go along side the RDF Thrift encoding. > Sometimes, apps want protobuf encoded RDF, e.g. for use with gRPC. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (JENA-2167) Provide an RDF Binary format using Protobuf
[ https://issues.apache.org/jira/browse/JENA-2167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17418746#comment-17418746 ] Andy Seaborne commented on JENA-2167: - The Google Protocol Buffers license is 3-clause BSD-style with an explicit comment that the output of the protobuf compiler is owned by the user, and not under the protobuf license. https://github.com/protocolbuffers/protobuf/blob/master/LICENSE 3-clause BSD-style is cat-A. The requirement to acknowledge redistribution of source (not relevant for this ticket) and binaries (we will be in convenience binaries) zip files: apache-jena, apache-jena-fuseki Combined jars: jena-fuseki-server, jena-fuseki-fulljar, jena-fuseki-war.. > Provide an RDF Binary format using Protobuf > --- > > Key: JENA-2167 > URL: https://issues.apache.org/jira/browse/JENA-2167 > Project: Apache Jena > Issue Type: New Feature >Affects Versions: Jena 4.2.0 >Reporter: Andy Seaborne >Assignee: Andy Seaborne >Priority: Major > > To go along side the RDF Thrift encoding. > Sometimes, apps want protobuf encoded RDF, e.g. for use with gRPC. -- This message was sent by Atlassian Jira (v8.3.4#803005)