[jira] [Commented] (JENA-2167) Provide an RDF Binary format using Protobuf

2021-09-30 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/JENA-2167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422953#comment-17422953
 ] 

ASF subversion and git services commented on JENA-2167:
---

Commit 0c0a509e3b0f5f636306275ef2b7ab273e99e1fc in jena's branch 
refs/heads/main from Andy Seaborne
[ https://gitbox.apache.org/repos/asf?p=jena.git;h=0c0a509 ]

Merge pull request #1079 from afs/fixes

JENA-2172, JENA-2167 and small improvements.

> Provide an RDF Binary format using Protobuf
> ---
>
> Key: JENA-2167
> URL: https://issues.apache.org/jira/browse/JENA-2167
> Project: Apache Jena
>  Issue Type: New Feature
>Affects Versions: Jena 4.2.0
>Reporter: Andy Seaborne
>Assignee: Andy Seaborne
>Priority: Major
> Fix For: Jena 4.3.0
>
>
> To go along side the RDF Thrift encoding.
> Sometimes, apps want protobuf encoded RDF, e.g. for use with gRPC.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (JENA-2167) Provide an RDF Binary format using Protobuf

2021-09-30 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/JENA-2167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17422951#comment-17422951
 ] 

ASF subversion and git services commented on JENA-2167:
---

Commit 2071508862313ab58296ef405f6ecc55ab0ba0a1 in jena's branch 
refs/heads/main from Andy Seaborne
[ https://gitbox.apache.org/repos/asf?p=jena.git;h=2071508 ]

JENA-2167: Flush output


> Provide an RDF Binary format using Protobuf
> ---
>
> Key: JENA-2167
> URL: https://issues.apache.org/jira/browse/JENA-2167
> Project: Apache Jena
>  Issue Type: New Feature
>Affects Versions: Jena 4.2.0
>Reporter: Andy Seaborne
>Assignee: Andy Seaborne
>Priority: Major
> Fix For: Jena 4.3.0
>
>
> To go along side the RDF Thrift encoding.
> Sometimes, apps want protobuf encoded RDF, e.g. for use with gRPC.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (JENA-2167) Provide an RDF Binary format using Protobuf

2021-09-24 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/JENA-2167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17419790#comment-17419790
 ] 

ASF subversion and git services commented on JENA-2167:
---

Commit 0ffb1a795d46a642ec6263838d565158f98564cd in jena's branch 
refs/heads/main from Andy Seaborne
[ https://gitbox.apache.org/repos/asf?p=jena.git;h=0ffb1a7 ]

Merge pull request #1076 from afs/rdf-protobuf

JENA-2167: Protobuf based RDF binary format

> Provide an RDF Binary format using Protobuf
> ---
>
> Key: JENA-2167
> URL: https://issues.apache.org/jira/browse/JENA-2167
> Project: Apache Jena
>  Issue Type: New Feature
>Affects Versions: Jena 4.2.0
>Reporter: Andy Seaborne
>Assignee: Andy Seaborne
>Priority: Major
>
> To go along side the RDF Thrift encoding.
> Sometimes, apps want protobuf encoded RDF, e.g. for use with gRPC.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (JENA-2167) Provide an RDF Binary format using Protobuf

2021-09-24 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/JENA-2167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17419788#comment-17419788
 ] 

ASF subversion and git services commented on JENA-2167:
---

Commit 1b5617dade712b6f16a4ea7b76469f67c9aff31f in jena's branch 
refs/heads/main from Andy Seaborne
[ https://gitbox.apache.org/repos/asf?p=jena.git;h=1b5617d ]

JENA-2167: Protobuf-based RDF binary format


> Provide an RDF Binary format using Protobuf
> ---
>
> Key: JENA-2167
> URL: https://issues.apache.org/jira/browse/JENA-2167
> Project: Apache Jena
>  Issue Type: New Feature
>Affects Versions: Jena 4.2.0
>Reporter: Andy Seaborne
>Assignee: Andy Seaborne
>Priority: Major
>
> To go along side the RDF Thrift encoding.
> Sometimes, apps want protobuf encoded RDF, e.g. for use with gRPC.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (JENA-2167) Provide an RDF Binary format using Protobuf

2021-09-24 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/JENA-2167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17419789#comment-17419789
 ] 

ASF subversion and git services commented on JENA-2167:
---

Commit e1580129eb0aa823f2ea0eefc363e7d23ad5806d in jena's branch 
refs/heads/main from Andy Seaborne
[ https://gitbox.apache.org/repos/asf?p=jena.git;h=e158012 ]

JENA-2167: Add required text for Protobuf redistribution


> Provide an RDF Binary format using Protobuf
> ---
>
> Key: JENA-2167
> URL: https://issues.apache.org/jira/browse/JENA-2167
> Project: Apache Jena
>  Issue Type: New Feature
>Affects Versions: Jena 4.2.0
>Reporter: Andy Seaborne
>Assignee: Andy Seaborne
>Priority: Major
>
> To go along side the RDF Thrift encoding.
> Sometimes, apps want protobuf encoded RDF, e.g. for use with gRPC.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (JENA-2167) Provide an RDF Binary format using Protobuf

2021-09-22 Thread Andy Seaborne (Jira)


[ 
https://issues.apache.org/jira/browse/JENA-2167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17418752#comment-17418752
 ] 

Andy Seaborne commented on JENA-2167:
-

Some initial figures.

Parsing BSBM 25 million (which is large enough to get stable timing figures 
after warm up):

Thrift: 1 million triples per second.
Protobuf: 918kTPS
N-Triples: 245kTPS

The thrift rate is faster than last time I ran it. Same hardware, same code, 
newer Java (this is Java 17-ea)

Suspicion: The protobuf is slightly slower because protobuf does not provide 
length delimited objects, where as Thrift encoding is self contained. The 
encoding of a graph is writing triples streaming fashion, each triple a 
Protobuf message. The protobuf way is to add a block length into the stream, 
and the extra decoding of this is slightly inefficient (it create two java 
objects per triple, rather than reuse existing objects).

 

 

> Provide an RDF Binary format using Protobuf
> ---
>
> Key: JENA-2167
> URL: https://issues.apache.org/jira/browse/JENA-2167
> Project: Apache Jena
>  Issue Type: New Feature
>Affects Versions: Jena 4.2.0
>Reporter: Andy Seaborne
>Assignee: Andy Seaborne
>Priority: Major
>
> To go along side the RDF Thrift encoding.
> Sometimes, apps want protobuf encoded RDF, e.g. for use with gRPC.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (JENA-2167) Provide an RDF Binary format using Protobuf

2021-09-22 Thread Andy Seaborne (Jira)


[ 
https://issues.apache.org/jira/browse/JENA-2167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17418746#comment-17418746
 ] 

Andy Seaborne commented on JENA-2167:
-

The Google Protocol Buffers license is 3-clause BSD-style with an explicit 
comment that the output of the protobuf compiler is owned by the user, and not 
under the protobuf license.

 https://github.com/protocolbuffers/protobuf/blob/master/LICENSE

3-clause BSD-style is cat-A. The requirement to acknowledge redistribution of 
source (not relevant for this ticket) and binaries (we will be in convenience 
binaries)

zip files: apache-jena, apache-jena-fuseki
Combined jars: jena-fuseki-server, jena-fuseki-fulljar, jena-fuseki-war..

> Provide an RDF Binary format using Protobuf
> ---
>
> Key: JENA-2167
> URL: https://issues.apache.org/jira/browse/JENA-2167
> Project: Apache Jena
>  Issue Type: New Feature
>Affects Versions: Jena 4.2.0
>Reporter: Andy Seaborne
>Assignee: Andy Seaborne
>Priority: Major
>
> To go along side the RDF Thrift encoding.
> Sometimes, apps want protobuf encoded RDF, e.g. for use with gRPC.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)