[
https://issues.apache.org/jira/browse/JENA-1121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15106655#comment-15106655
]
Benjamin Geer edited comment on JENA-1121 at 1/19/16 12:32 PM:
---------------------------------------------------------------
Here are some shorter examples with various things removed. The original query
above:
* 10 ms with Fuseki 2.3.0
* 8.6 s with Fuseki 2.3.1
Removing DISTINCT, ORDER, and GROUP BY:
* 12 ms with Fuseki 2.3.0
* 8.1 s with Fuseki 2.3.1
{noformat}
prefix rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#>
prefix rdfs: <http://www.w3.org/2000/01/rdf-schema#>
prefix knora-base: <http://www.knora.org/ontology/knora-base#>
SELECT
?resourceIri
?resourceLabel
?match
WHERE {
BIND(STR("de") AS ?preferredLanguage)
BIND(STR("en") AS ?fallbackLanguage)
?s <http://jena.apache.org/text#query> 'Zeitglöcklein' .
MINUS {
?s knora-base:isDeleted true .
}
OPTIONAL {
?s a ?valueObjectType .
?valueObjectType rdfs:subClassOf+ knora-base:Value .
?resIri ?resourceProperty ?s .
?s knora-base:valueHasString ?literal .
OPTIONAL {
?resourceProperty rdfs:label
?preferredLanguageResourcePropertyLabel .
FILTER (LANG(?preferredLanguageResourcePropertyLabel) =
?preferredLanguage) .
}
OPTIONAL {
?resourceProperty rdfs:label ?fallbackLanguageResourcePropertyLabel
.
FILTER (LANG(?fallbackLanguageResourcePropertyLabel) =
?fallbackLanguage) .
}
OPTIONAL {
?resourceProperty rdfs:label ?anyLanguageResourcePropertyLabel .
}
BIND(COALESCE(str(?preferredLanguageResourcePropertyLabel),
str(?fallbackLanguageResourcePropertyLabel),
str(?anyLanguageResourcePropertyLabel)) AS ?propertyLabel)
BIND(CONCAT(STR(?valueObjectType), "|", STR(?propertyLabel), "|",
STR(?literal)) AS ?match)
MINUS {
?resIri knora-base:isDeleted true .
}
}
BIND(COALESCE(?resIri, ?s) AS ?resourceIri)
?resourceIri a ?resourceClass .
?resourceClass rdfs:subClassOf+ knora-base:Resource .
?resourceIri rdfs:label ?resourceLabel .
}
{noformat}
Removing some of the inner OPTIONALs:
* 9 ms with Fuseki 2.3.0
* 4.8 s with Fuseki 2.3.1
{noformat}
prefix rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#>
prefix rdfs: <http://www.w3.org/2000/01/rdf-schema#>
prefix knora-base: <http://www.knora.org/ontology/knora-base#>
SELECT
?resourceIri
?resourceLabel
?match
WHERE {
?s <http://jena.apache.org/text#query> 'Zeitglöcklein' .
MINUS {
?s knora-base:isDeleted true .
}
OPTIONAL {
?s a ?valueObjectType .
?valueObjectType rdfs:subClassOf+ knora-base:Value .
?resIri ?resourceProperty ?s .
?s knora-base:valueHasString ?literal .
OPTIONAL {
?resourceProperty rdfs:label ?propertyLabel .
}
BIND(CONCAT(STR(?valueObjectType), "|", STR(?propertyLabel), "|",
STR(?literal)) AS ?match)
MINUS {
?resIri knora-base:isDeleted true .
}
}
BIND(COALESCE(?resIri, ?s) AS ?resourceIri)
?resourceIri a ?resourceClass .
?resourceClass rdfs:subClassOf+ knora-base:Resource .
?resourceIri rdfs:label ?resourceLabel .
}
{noformat}
Making the remaining inner OPTIONAL pattern non-optional:
* 9 ms with Fuseki 2.3.0
* 1.9 s with Fuseki 2.3.1
{noformat}
prefix rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#>
prefix rdfs: <http://www.w3.org/2000/01/rdf-schema#>
prefix knora-base: <http://www.knora.org/ontology/knora-base#>
SELECT
?resourceIri
?resourceLabel
?match
WHERE {
?s <http://jena.apache.org/text#query> 'Zeitglöcklein' .
MINUS {
?s knora-base:isDeleted true .
}
OPTIONAL {
?s a ?valueObjectType .
?valueObjectType rdfs:subClassOf+ knora-base:Value .
?resIri ?resourceProperty ?s .
?s knora-base:valueHasString ?literal .
?resourceProperty rdfs:label ?propertyLabel .
BIND(CONCAT(STR(?valueObjectType), "|", STR(?propertyLabel), "|",
STR(?literal)) AS ?match)
MINUS {
?resIri knora-base:isDeleted true .
}
}
BIND(COALESCE(?resIri, ?s) AS ?resourceIri)
?resourceIri a ?resourceClass .
?resourceClass rdfs:subClassOf+ knora-base:Resource .
?resourceIri rdfs:label ?resourceLabel .
}
{noformat}
Removing the MINUSes:
* 8 ms with Fuseki 2.3.0
* 10 ms with Fuseki 2.3.1
{noformat}
prefix rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#>
prefix rdfs: <http://www.w3.org/2000/01/rdf-schema#>
prefix knora-base: <http://www.knora.org/ontology/knora-base#>
SELECT
?resourceIri
?resourceLabel
?match
WHERE {
?s <http://jena.apache.org/text#query> 'Zeitglöcklein' .
OPTIONAL {
?s a ?valueObjectType .
?valueObjectType rdfs:subClassOf+ knora-base:Value .
?resIri ?resourceProperty ?s .
?s knora-base:valueHasString ?literal .
?resourceProperty rdfs:label ?propertyLabel .
BIND(CONCAT(STR(?valueObjectType), "|", STR(?propertyLabel), "|",
STR(?literal)) AS ?match)
}
BIND(COALESCE(?resIri, ?s) AS ?resourceIri)
?resourceIri a ?resourceClass .
?resourceClass rdfs:subClassOf+ knora-base:Resource .
?resourceIri rdfs:label ?resourceLabel .
}
{noformat}
Keeping the inner OPTIONAL but removing the MINUSes:
* 2.8 s with Fuseki 2.3.0
* 2.8 s with Fuseki 2.3.1
{noformat}
prefix rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#>
prefix rdfs: <http://www.w3.org/2000/01/rdf-schema#>
prefix knora-base: <http://www.knora.org/ontology/knora-base#>
SELECT
?resourceIri
?resourceLabel
?match
WHERE {
?s <http://jena.apache.org/text#query> 'Zeitglöcklein' .
OPTIONAL {
?s a ?valueObjectType .
?valueObjectType rdfs:subClassOf+ knora-base:Value .
?resIri ?resourceProperty ?s .
?s knora-base:valueHasString ?literal .
OPTIONAL {
?resourceProperty rdfs:label ?propertyLabel .
}
BIND(CONCAT(STR(?valueObjectType), "|", STR(?propertyLabel), "|",
STR(?literal)) AS ?match)
}
BIND(COALESCE(?resIri, ?s) AS ?resourceIri)
?resourceIri a ?resourceClass .
?resourceClass rdfs:subClassOf+ knora-base:Resource .
?resourceIri rdfs:label ?resourceLabel .
}
{noformat}
Summary:
* In most of these examples, Fuseki 2.3.0 is hundreds of times faster than
Fuseki 2.3.1.
* When the MINUSes and the inner OPTIONALs are removed, both versions are fast.
* When the MINUSes are removed and an inner OPTIONAL is kept, both versions are
slow.
Note that none of the MINUSes in these examples should actually remove any
results (knora-base:isDeleted does not occur in the test data).
was (Author: benjamingeer):
Here are some shorter examples with various things removed. The original query
above:
* 10 ms with Fuseki 2.3.0
* 8.6 s with Fuseki 2.3.1
Removing DISTINCT, ORDER, and GROUP BY:
* 12 ms with Fuseki 2.3.0
* 8.1 s with Fuseki 2.3.1
{noformat}
prefix rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#>
prefix rdfs: <http://www.w3.org/2000/01/rdf-schema#>
prefix knora-base: <http://www.knora.org/ontology/knora-base#>
SELECT
?resourceIri
?resourceLabel
?match
WHERE {
BIND(STR("de") AS ?preferredLanguage)
BIND(STR("en") AS ?fallbackLanguage)
?s <http://jena.apache.org/text#query> 'Zeitglöcklein' .
MINUS {
?s knora-base:isDeleted true .
}
OPTIONAL {
?s a ?valueObjectType .
?valueObjectType rdfs:subClassOf+ knora-base:Value .
?resIri ?resourceProperty ?s .
?s knora-base:valueHasString ?literal .
OPTIONAL {
?resourceProperty rdfs:label
?preferredLanguageResourcePropertyLabel .
FILTER (LANG(?preferredLanguageResourcePropertyLabel) =
?preferredLanguage) .
}
OPTIONAL {
?resourceProperty rdfs:label ?fallbackLanguageResourcePropertyLabel
.
FILTER (LANG(?fallbackLanguageResourcePropertyLabel) =
?fallbackLanguage) .
}
OPTIONAL {
?resourceProperty rdfs:label ?anyLanguageResourcePropertyLabel .
}
BIND(COALESCE(str(?preferredLanguageResourcePropertyLabel),
str(?fallbackLanguageResourcePropertyLabel),
str(?anyLanguageResourcePropertyLabel)) AS ?propertyLabel)
BIND(CONCAT(STR(?valueObjectType), "|", STR(?propertyLabel), "|",
STR(?literal)) AS ?match)
MINUS {
?resIri knora-base:isDeleted true .
}
}
BIND(COALESCE(?resIri, ?s) AS ?resourceIri)
?resourceIri a ?resourceClass .
?resourceClass rdfs:subClassOf+ knora-base:Resource .
?resourceIri rdfs:label ?resourceLabel .
}
{noformat}
Removing some of the inner OPTIONALs:
* 9 ms with Fuseki 2.3.0
* 4.8 s with Fuseki 2.3.1
{noformat}
prefix rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#>
prefix rdfs: <http://www.w3.org/2000/01/rdf-schema#>
prefix knora-base: <http://www.knora.org/ontology/knora-base#>
SELECT
?resourceIri
?resourceLabel
?match
WHERE {
?s <http://jena.apache.org/text#query> 'Zeitglöcklein' .
MINUS {
?s knora-base:isDeleted true .
}
OPTIONAL {
?s a ?valueObjectType .
?valueObjectType rdfs:subClassOf+ knora-base:Value .
?resIri ?resourceProperty ?s .
?s knora-base:valueHasString ?literal .
OPTIONAL {
?resourceProperty rdfs:label ?propertyLabel .
}
BIND(CONCAT(STR(?valueObjectType), "|", STR(?propertyLabel), "|",
STR(?literal)) AS ?match)
MINUS {
?resIri knora-base:isDeleted true .
}
}
BIND(COALESCE(?resIri, ?s) AS ?resourceIri)
?resourceIri a ?resourceClass .
?resourceClass rdfs:subClassOf+ knora-base:Resource .
?resourceIri rdfs:label ?resourceLabel .
}
{noformat}
Making the remaining inner OPTIONAL pattern non-optional:
* 9 ms with Fuseki 2.3.0
* 1.9 s with Fuseki 2.3.1
{noformat}
prefix rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#>
prefix rdfs: <http://www.w3.org/2000/01/rdf-schema#>
prefix knora-base: <http://www.knora.org/ontology/knora-base#>
SELECT
?resourceIri
?resourceLabel
?match
WHERE {
?s <http://jena.apache.org/text#query> 'Zeitglöcklein' .
MINUS {
?s knora-base:isDeleted true .
}
OPTIONAL {
?s a ?valueObjectType .
?valueObjectType rdfs:subClassOf+ knora-base:Value .
?resIri ?resourceProperty ?s .
?s knora-base:valueHasString ?literal .
?resourceProperty rdfs:label ?propertyLabel .
BIND(CONCAT(STR(?valueObjectType), "|", STR(?propertyLabel), "|",
STR(?literal)) AS ?match)
MINUS {
?resIri knora-base:isDeleted true .
}
}
BIND(COALESCE(?resIri, ?s) AS ?resourceIri)
?resourceIri a ?resourceClass .
?resourceClass rdfs:subClassOf+ knora-base:Resource .
?resourceIri rdfs:label ?resourceLabel .
}
{noformat}
Removing the MINUSes:
* 8 ms with Fuseki 2.3.0
* 10 ms with Fuseki 2.3.1
{noformat}
prefix rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#>
prefix rdfs: <http://www.w3.org/2000/01/rdf-schema#>
prefix knora-base: <http://www.knora.org/ontology/knora-base#>
SELECT
?resourceIri
?resourceLabel
?match
WHERE {
?s <http://jena.apache.org/text#query> 'Zeitglöcklein' .
OPTIONAL {
?s a ?valueObjectType .
?valueObjectType rdfs:subClassOf+ knora-base:Value .
?resIri ?resourceProperty ?s .
?s knora-base:valueHasString ?literal .
?resourceProperty rdfs:label ?propertyLabel .
BIND(CONCAT(STR(?valueObjectType), "|", STR(?propertyLabel), "|",
STR(?literal)) AS ?match)
}
BIND(COALESCE(?resIri, ?s) AS ?resourceIri)
?resourceIri a ?resourceClass .
?resourceClass rdfs:subClassOf+ knora-base:Resource .
?resourceIri rdfs:label ?resourceLabel .
}
{noformat}
Keeping the inner OPTIONAL but removing the MINUSes:
* 2.8 s with Fuseki 2.3.0
* 2.8 s with Fuseki 2.3.1
{noformat}
prefix rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#>
prefix rdfs: <http://www.w3.org/2000/01/rdf-schema#>
prefix knora-base: <http://www.knora.org/ontology/knora-base#>
SELECT
?resourceIri
?resourceLabel
?match
WHERE {
?s <http://jena.apache.org/text#query> 'Zeitglöcklein' .
OPTIONAL {
?s a ?valueObjectType .
?valueObjectType rdfs:subClassOf+ knora-base:Value .
?resIri ?resourceProperty ?s .
?s knora-base:valueHasString ?literal .
OPTIONAL {
?resourceProperty rdfs:label ?propertyLabel .
}
BIND(CONCAT(STR(?valueObjectType), "|", STR(?propertyLabel), "|",
STR(?literal)) AS ?match)
}
BIND(COALESCE(?resIri, ?s) AS ?resourceIri)
?resourceIri a ?resourceClass .
?resourceClass rdfs:subClassOf+ knora-base:Resource .
?resourceIri rdfs:label ?resourceLabel .
}
{noformat}
Summary:
* In most of these examples, Fuseki 2.3.0 is hundreds of times faster than
Fuseki 2.3.1.
* When the MINUSes and the inner OPTIONALs are removed, both versions are fast.
* When the MINUSes are removed and an inner OPTIONAL are kept, both versions
are slow.
Note that none of the MINUSes in these examples should actually remove any
results (knora-base:isDeleted does not occur in the test data).
> Performance regression in Jena 3.0.1 / Fuseki 2.3.1
> ---------------------------------------------------
>
> Key: JENA-1121
> URL: https://issues.apache.org/jira/browse/JENA-1121
> Project: Apache Jena
> Issue Type: Bug
> Components: Jena
> Affects Versions: Jena 3.0.1, Fuseki 2.3.1, Jena 3.1.0, Fuseki 2.4.0
> Environment: Mac OS X 10.10.5, iMac, 3.4 GHz Intel Core i7, 32 GB RAM
> Reporter: Benjamin Geer
> Priority: Critical
> Labels: performance
>
> We seem to have encountered a severe performance regression in Jena 3.0.1 /
> Fuseki 2.3.1 as compared with Jena 3.0.0 / Fuseki 2.3.0. A number of our
> queries are running between 2 and 20 times slower. Here's one small example
> with configuration for Fuseki. With Fuseki 2.3.0, the query below takes about
> 200 milliseconds. With Fuseki 2.3.1, it takes 9 seconds. I've also tried it
> with the latest Fuseki snapshot
> (apache-jena-fuseki-2.4.0-20160117.183513-33.zip), and got the same result as
> with the 2.3.1 release.
> Here's the test data and configuration:
> https://www.dropbox.com/s/b9aepexij5e7noj/jena-performance-test.zip?dl=0
> Here's the query:
> {noformat}
> prefix rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#>
> prefix rdfs: <http://www.w3.org/2000/01/rdf-schema#>
> prefix knora-base: <http://www.knora.org/ontology/knora-base#>
> SELECT DISTINCT
> ?resourceIri
> ?resourceLabel
> (SAMPLE(?anyMatch) AS ?match)
> WHERE {
> BIND(STR("de") AS ?preferredLanguage)
> BIND(STR("en") AS ?fallbackLanguage)
> ?s <http://jena.apache.org/text#query> 'Zeitglöcklein' .
> MINUS {
> ?s knora-base:isDeleted true .
> }
> OPTIONAL {
> ?s a ?valueObjectType .
> ?valueObjectType rdfs:subClassOf+ knora-base:Value .
> ?resIri ?resourceProperty ?s .
> ?s knora-base:valueHasString ?literal .
> OPTIONAL {
> ?resourceProperty rdfs:label
> ?preferredLanguageResourcePropertyLabel .
> FILTER (LANG(?preferredLanguageResourcePropertyLabel) =
> ?preferredLanguage) .
> }
> OPTIONAL {
> ?resourceProperty rdfs:label
> ?fallbackLanguageResourcePropertyLabel .
> FILTER (LANG(?fallbackLanguageResourcePropertyLabel) =
> ?fallbackLanguage) .
> }
> OPTIONAL {
> ?resourceProperty rdfs:label ?anyLanguageResourcePropertyLabel .
> }
> BIND(COALESCE(str(?preferredLanguageResourcePropertyLabel),
> str(?fallbackLanguageResourcePropertyLabel),
> str(?anyLanguageResourcePropertyLabel)) AS ?propertyLabel)
> BIND(CONCAT(STR(?valueObjectType), "|", STR(?propertyLabel), "|",
> STR(?literal)) AS ?anyMatch)
> MINUS {
> ?resIri knora-base:isDeleted true .
> }
> }
> BIND(COALESCE(?resIri, ?s) AS ?resourceIri)
> ?resourceIri a ?resourceClass .
> ?resourceClass rdfs:subClassOf+ knora-base:Resource .
> ?resourceIri rdfs:label ?resourceLabel .
> }
> GROUP BY
> ?resourceIri
> ?resourceLabel
> ORDER BY ?resourceIri
> {noformat}
> Best regards,
> Benjamin Geer
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
