[
https://issues.apache.org/jira/browse/JENA-1121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15106655#comment-15106655
]
Benjamin Geer edited comment on JENA-1121 at 1/19/16 12:31 PM:
---------------------------------------------------------------
Here are some shorter examples with various things removed. The original query
above:
* 10 ms with Fuseki 2.3.0
* 8.6 s with Fuseki 2.3.1
Removing DISTINCT, ORDER, and GROUP BY:
* 12 ms with Fuseki 2.3.0
* 8.1 s with Fuseki 2.3.1
{noformat}
prefix rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#>
prefix rdfs: <http://www.w3.org/2000/01/rdf-schema#>
prefix knora-base: <http://www.knora.org/ontology/knora-base#>
SELECT
?resourceIri
?resourceLabel
?match
WHERE {
BIND(STR("de") AS ?preferredLanguage)
BIND(STR("en") AS ?fallbackLanguage)
?s <http://jena.apache.org/text#query> 'Zeitglöcklein' .
MINUS {
?s knora-base:isDeleted true .
}
OPTIONAL {
?s a ?valueObjectType .
?valueObjectType rdfs:subClassOf+ knora-base:Value .
?resIri ?resourceProperty ?s .
?s knora-base:valueHasString ?literal .
OPTIONAL {
?resourceProperty rdfs:label
?preferredLanguageResourcePropertyLabel .
FILTER (LANG(?preferredLanguageResourcePropertyLabel) =
?preferredLanguage) .
}
OPTIONAL {
?resourceProperty rdfs:label ?fallbackLanguageResourcePropertyLabel
.
FILTER (LANG(?fallbackLanguageResourcePropertyLabel) =
?fallbackLanguage) .
}
OPTIONAL {
?resourceProperty rdfs:label ?anyLanguageResourcePropertyLabel .
}
BIND(COALESCE(str(?preferredLanguageResourcePropertyLabel),
str(?fallbackLanguageResourcePropertyLabel),
str(?anyLanguageResourcePropertyLabel)) AS ?propertyLabel)
BIND(CONCAT(STR(?valueObjectType), "|", STR(?propertyLabel), "|",
STR(?literal)) AS ?match)
MINUS {
?resIri knora-base:isDeleted true .
}
}
BIND(COALESCE(?resIri, ?s) AS ?resourceIri)
?resourceIri a ?resourceClass .
?resourceClass rdfs:subClassOf+ knora-base:Resource .
?resourceIri rdfs:label ?resourceLabel .
}
{noformat}
Removing some of the inner OPTIONALs:
* 9 ms with Fuseki 2.3.0
* 4.8 s with Fuseki 2.3.1
{noformat}
prefix rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#>
prefix rdfs: <http://www.w3.org/2000/01/rdf-schema#>
prefix knora-base: <http://www.knora.org/ontology/knora-base#>
SELECT
?resourceIri
?resourceLabel
?match
WHERE {
?s <http://jena.apache.org/text#query> 'Zeitglöcklein' .
MINUS {
?s knora-base:isDeleted true .
}
OPTIONAL {
?s a ?valueObjectType .
?valueObjectType rdfs:subClassOf+ knora-base:Value .
?resIri ?resourceProperty ?s .
?s knora-base:valueHasString ?literal .
OPTIONAL {
?resourceProperty rdfs:label ?propertyLabel .
}
BIND(CONCAT(STR(?valueObjectType), "|", STR(?propertyLabel), "|",
STR(?literal)) AS ?match)
MINUS {
?resIri knora-base:isDeleted true .
}
}
BIND(COALESCE(?resIri, ?s) AS ?resourceIri)
?resourceIri a ?resourceClass .
?resourceClass rdfs:subClassOf+ knora-base:Resource .
?resourceIri rdfs:label ?resourceLabel .
}
{noformat}
Making the remaining inner OPTIONAL pattern non-optional:
* 9 ms with Fuseki 2.3.0
* 1.9 s with Fuseki 2.3.1
{noformat}
prefix rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#>
prefix rdfs: <http://www.w3.org/2000/01/rdf-schema#>
prefix knora-base: <http://www.knora.org/ontology/knora-base#>
SELECT
?resourceIri
?resourceLabel
?match
WHERE {
?s <http://jena.apache.org/text#query> 'Zeitglöcklein' .
MINUS {
?s knora-base:isDeleted true .
}
OPTIONAL {
?s a ?valueObjectType .
?valueObjectType rdfs:subClassOf+ knora-base:Value .
?resIri ?resourceProperty ?s .
?s knora-base:valueHasString ?literal .
?resourceProperty rdfs:label ?propertyLabel .
BIND(CONCAT(STR(?valueObjectType), "|", STR(?propertyLabel), "|",
STR(?literal)) AS ?match)
MINUS {
?resIri knora-base:isDeleted true .
}
}
BIND(COALESCE(?resIri, ?s) AS ?resourceIri)
?resourceIri a ?resourceClass .
?resourceClass rdfs:subClassOf+ knora-base:Resource .
?resourceIri rdfs:label ?resourceLabel .
}
{noformat}
Removing the MINUSes:
* 8 ms with Fuseki 2.3.0
* 10 ms with Fuseki 2.3.1
{noformat}
prefix rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#>
prefix rdfs: <http://www.w3.org/2000/01/rdf-schema#>
prefix knora-base: <http://www.knora.org/ontology/knora-base#>
SELECT
?resourceIri
?resourceLabel
?match
WHERE {
?s <http://jena.apache.org/text#query> 'Zeitglöcklein' .
OPTIONAL {
?s a ?valueObjectType .
?valueObjectType rdfs:subClassOf+ knora-base:Value .
?resIri ?resourceProperty ?s .
?s knora-base:valueHasString ?literal .
?resourceProperty rdfs:label ?propertyLabel .
BIND(CONCAT(STR(?valueObjectType), "|", STR(?propertyLabel), "|",
STR(?literal)) AS ?match)
}
BIND(COALESCE(?resIri, ?s) AS ?resourceIri)
?resourceIri a ?resourceClass .
?resourceClass rdfs:subClassOf+ knora-base:Resource .
?resourceIri rdfs:label ?resourceLabel .
}
{noformat}
Keeping the inner OPTIONAL but removing the MINUSes:
* 2.8 s with Fuseki 2.3.0
* 2.8 s with Fuseki 2.3.1
{noformat}
prefix rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#>
prefix rdfs: <http://www.w3.org/2000/01/rdf-schema#>
prefix knora-base: <http://www.knora.org/ontology/knora-base#>
SELECT
?resourceIri
?resourceLabel
?match
WHERE {
?s <http://jena.apache.org/text#query> 'Zeitglöcklein' .
OPTIONAL {
?s a ?valueObjectType .
?valueObjectType rdfs:subClassOf+ knora-base:Value .
?resIri ?resourceProperty ?s .
?s knora-base:valueHasString ?literal .
OPTIONAL {
?resourceProperty rdfs:label ?propertyLabel .
}
BIND(CONCAT(STR(?valueObjectType), "|", STR(?propertyLabel), "|",
STR(?literal)) AS ?match)
}
BIND(COALESCE(?resIri, ?s) AS ?resourceIri)
?resourceIri a ?resourceClass .
?resourceClass rdfs:subClassOf+ knora-base:Resource .
?resourceIri rdfs:label ?resourceLabel .
}
{noformat}
Summary:
* In most of these examples, Fuseki 2.3.0 is hundreds of times faster than
Fuseki 2.3.1.
* When the MINUSes and the inner OPTIONALs are removed, both versions are fast.
* When the MINUSes are removed and an inner OPTIONAL are kept, both versions
are slow.
Note that none of the MINUSes in these examples should actually remove any
results (knora-base:isDeleted does not occur in the test data).
was (Author: benjamingeer):
Here are some shorter examples with various things removed. The original query
above:
* 10 ms with Fuseki 2.3.0
* 8.6 s with Fuseki 2.3.1
Removing DISTINCT, ORDER, and GROUP BY:
* 12 ms with Fuseki 2.3.0
* 8.1 s with Fuseki 2.3.1
{noformat}
prefix rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#>
prefix rdfs: <http://www.w3.org/2000/01/rdf-schema#>
prefix knora-base: <http://www.knora.org/ontology/knora-base#>
SELECT
?resourceIri
?resourceLabel
?match
WHERE {
BIND(STR("de") AS ?preferredLanguage)
BIND(STR("en") AS ?fallbackLanguage)
?s <http://jena.apache.org/text#query> 'Zeitglöcklein' .
MINUS {
?s knora-base:isDeleted true .
}
OPTIONAL {
?s a ?valueObjectType .
?valueObjectType rdfs:subClassOf+ knora-base:Value .
?resIri ?resourceProperty ?s .
?s knora-base:valueHasString ?literal .
OPTIONAL {
?resourceProperty rdfs:label
?preferredLanguageResourcePropertyLabel .
FILTER (LANG(?preferredLanguageResourcePropertyLabel) =
?preferredLanguage) .
}
OPTIONAL {
?resourceProperty rdfs:label ?fallbackLanguageResourcePropertyLabel
.
FILTER (LANG(?fallbackLanguageResourcePropertyLabel) =
?fallbackLanguage) .
}
OPTIONAL {
?resourceProperty rdfs:label ?anyLanguageResourcePropertyLabel .
}
BIND(COALESCE(str(?preferredLanguageResourcePropertyLabel),
str(?fallbackLanguageResourcePropertyLabel),
str(?anyLanguageResourcePropertyLabel)) AS ?propertyLabel)
BIND(CONCAT(STR(?valueObjectType), "|", STR(?propertyLabel), "|",
STR(?literal)) AS ?match)
MINUS {
?resIri knora-base:isDeleted true .
}
}
BIND(COALESCE(?resIri, ?s) AS ?resourceIri)
?resourceIri a ?resourceClass .
?resourceClass rdfs:subClassOf+ knora-base:Resource .
?resourceIri rdfs:label ?resourceLabel .
}
{noformat}
Removing some of the inner OPTIONALs:
* 9 ms with Fuseki 2.3.0
* 4.8 s with Fuseki 2.3.1
{noformat}
prefix rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#>
prefix rdfs: <http://www.w3.org/2000/01/rdf-schema#>
prefix knora-base: <http://www.knora.org/ontology/knora-base#>
SELECT
?resourceIri
?resourceLabel
?match
WHERE {
?s <http://jena.apache.org/text#query> 'Zeitglöcklein' .
MINUS {
?s knora-base:isDeleted true .
}
OPTIONAL {
?s a ?valueObjectType .
?valueObjectType rdfs:subClassOf+ knora-base:Value .
?resIri ?resourceProperty ?s .
?s knora-base:valueHasString ?literal .
OPTIONAL {
?resourceProperty rdfs:label ?propertyLabel .
}
BIND(CONCAT(STR(?valueObjectType), "|", STR(?propertyLabel), "|",
STR(?literal)) AS ?match)
MINUS {
?resIri knora-base:isDeleted true .
}
}
BIND(COALESCE(?resIri, ?s) AS ?resourceIri)
?resourceIri a ?resourceClass .
?resourceClass rdfs:subClassOf+ knora-base:Resource .
?resourceIri rdfs:label ?resourceLabel .
}
{noformat}
Making the remaining inner OPTIONAL pattern non-optional:
* 9 ms with Fuseki 2.3.0
* 1.9 s with Fuseki 2.3.1
{noformat}
prefix rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#>
prefix rdfs: <http://www.w3.org/2000/01/rdf-schema#>
prefix knora-base: <http://www.knora.org/ontology/knora-base#>
SELECT
?resourceIri
?resourceLabel
?match
WHERE {
?s <http://jena.apache.org/text#query> 'Zeitglöcklein' .
MINUS {
?s knora-base:isDeleted true .
}
OPTIONAL {
?s a ?valueObjectType .
?valueObjectType rdfs:subClassOf+ knora-base:Value .
?resIri ?resourceProperty ?s .
?s knora-base:valueHasString ?literal .
?resourceProperty rdfs:label ?propertyLabel .
BIND(CONCAT(STR(?valueObjectType), "|", STR(?propertyLabel), "|",
STR(?literal)) AS ?match)
MINUS {
?resIri knora-base:isDeleted true .
}
}
BIND(COALESCE(?resIri, ?s) AS ?resourceIri)
?resourceIri a ?resourceClass .
?resourceClass rdfs:subClassOf+ knora-base:Resource .
?resourceIri rdfs:label ?resourceLabel .
}
{noformat}
Removing the MINUSes:
* 8 ms with Fuseki 2.3.0
* 10 ms with Fuseki 2.3.1
{noformat}
prefix rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#>
prefix rdfs: <http://www.w3.org/2000/01/rdf-schema#>
prefix knora-base: <http://www.knora.org/ontology/knora-base#>
SELECT
?resourceIri
?resourceLabel
?match
WHERE {
?s <http://jena.apache.org/text#query> 'Zeitglöcklein' .
OPTIONAL {
?s a ?valueObjectType .
?valueObjectType rdfs:subClassOf+ knora-base:Value .
?resIri ?resourceProperty ?s .
?s knora-base:valueHasString ?literal .
?resourceProperty rdfs:label ?propertyLabel .
BIND(CONCAT(STR(?valueObjectType), "|", STR(?propertyLabel), "|",
STR(?literal)) AS ?match)
}
BIND(COALESCE(?resIri, ?s) AS ?resourceIri)
?resourceIri a ?resourceClass .
?resourceClass rdfs:subClassOf+ knora-base:Resource .
?resourceIri rdfs:label ?resourceLabel .
}
{noformat}
Keeping the inner OPTIONAL but removing the MINUSes:
* 2.8 s with Fuseki 2.3.0
* 2.8 s with Fuseki 2.3.1
{noformat}
prefix rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#>
prefix rdfs: <http://www.w3.org/2000/01/rdf-schema#>
prefix knora-base: <http://www.knora.org/ontology/knora-base#>
SELECT
?resourceIri
?resourceLabel
?match
WHERE {
?s <http://jena.apache.org/text#query> 'Zeitglöcklein' .
OPTIONAL {
?s a ?valueObjectType .
?valueObjectType rdfs:subClassOf+ knora-base:Value .
?resIri ?resourceProperty ?s .
?s knora-base:valueHasString ?literal .
OPTIONAL {
?resourceProperty rdfs:label ?propertyLabel .
}
BIND(CONCAT(STR(?valueObjectType), "|", STR(?propertyLabel), "|",
STR(?literal)) AS ?match)
}
BIND(COALESCE(?resIri, ?s) AS ?resourceIri)
?resourceIri a ?resourceClass .
?resourceClass rdfs:subClassOf+ knora-base:Resource .
?resourceIri rdfs:label ?resourceLabel .
}
{noformat}
Summary: in these examples, Fuseki 2.3.0 is hundreds of times faster than
Fuseki 2.3.1, except when the MINUSes are removed and the inner OPTIONAL is
kept, in which case both versions are slow.
Note that none of the MINUSes in these examples should actually remove any
results (knora-base:isDeleted does not occur in the test data).
> Performance regression in Jena 3.0.1 / Fuseki 2.3.1
> ---------------------------------------------------
>
> Key: JENA-1121
> URL: https://issues.apache.org/jira/browse/JENA-1121
> Project: Apache Jena
> Issue Type: Bug
> Components: Jena
> Affects Versions: Jena 3.0.1, Fuseki 2.3.1, Jena 3.1.0, Fuseki 2.4.0
> Environment: Mac OS X 10.10.5, iMac, 3.4 GHz Intel Core i7, 32 GB RAM
> Reporter: Benjamin Geer
> Priority: Critical
> Labels: performance
>
> We seem to have encountered a severe performance regression in Jena 3.0.1 /
> Fuseki 2.3.1 as compared with Jena 3.0.0 / Fuseki 2.3.0. A number of our
> queries are running between 2 and 20 times slower. Here's one small example
> with configuration for Fuseki. With Fuseki 2.3.0, the query below takes about
> 200 milliseconds. With Fuseki 2.3.1, it takes 9 seconds. I've also tried it
> with the latest Fuseki snapshot
> (apache-jena-fuseki-2.4.0-20160117.183513-33.zip), and got the same result as
> with the 2.3.1 release.
> Here's the test data and configuration:
> https://www.dropbox.com/s/b9aepexij5e7noj/jena-performance-test.zip?dl=0
> Here's the query:
> {noformat}
> prefix rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#>
> prefix rdfs: <http://www.w3.org/2000/01/rdf-schema#>
> prefix knora-base: <http://www.knora.org/ontology/knora-base#>
> SELECT DISTINCT
> ?resourceIri
> ?resourceLabel
> (SAMPLE(?anyMatch) AS ?match)
> WHERE {
> BIND(STR("de") AS ?preferredLanguage)
> BIND(STR("en") AS ?fallbackLanguage)
> ?s <http://jena.apache.org/text#query> 'Zeitglöcklein' .
> MINUS {
> ?s knora-base:isDeleted true .
> }
> OPTIONAL {
> ?s a ?valueObjectType .
> ?valueObjectType rdfs:subClassOf+ knora-base:Value .
> ?resIri ?resourceProperty ?s .
> ?s knora-base:valueHasString ?literal .
> OPTIONAL {
> ?resourceProperty rdfs:label
> ?preferredLanguageResourcePropertyLabel .
> FILTER (LANG(?preferredLanguageResourcePropertyLabel) =
> ?preferredLanguage) .
> }
> OPTIONAL {
> ?resourceProperty rdfs:label
> ?fallbackLanguageResourcePropertyLabel .
> FILTER (LANG(?fallbackLanguageResourcePropertyLabel) =
> ?fallbackLanguage) .
> }
> OPTIONAL {
> ?resourceProperty rdfs:label ?anyLanguageResourcePropertyLabel .
> }
> BIND(COALESCE(str(?preferredLanguageResourcePropertyLabel),
> str(?fallbackLanguageResourcePropertyLabel),
> str(?anyLanguageResourcePropertyLabel)) AS ?propertyLabel)
> BIND(CONCAT(STR(?valueObjectType), "|", STR(?propertyLabel), "|",
> STR(?literal)) AS ?anyMatch)
> MINUS {
> ?resIri knora-base:isDeleted true .
> }
> }
> BIND(COALESCE(?resIri, ?s) AS ?resourceIri)
> ?resourceIri a ?resourceClass .
> ?resourceClass rdfs:subClassOf+ knora-base:Resource .
> ?resourceIri rdfs:label ?resourceLabel .
> }
> GROUP BY
> ?resourceIri
> ?resourceLabel
> ORDER BY ?resourceIri
> {noformat}
> Best regards,
> Benjamin Geer
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
