[
https://issues.apache.org/jira/browse/JENA-1313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15963023#comment-15963023
]
Osma Suominen commented on JENA-1313:
-------------------------------------
{quote}
Not worry to much about efficiency in a first pass
{quote}
Sounds good to me. I can contribute a test case for measuring performance:
1. Use the YSA thesaurus as data set:
http://api.finto.fi/download/ysa/ysa-skos.ttl
2. Execute the following query that lists all the labels beginning with the
letter T, ordered alphabetically:
{noformat}
PREFIX skos: <http://www.w3.org/2004/02/skos/core#>
SELECT ?label
WHERE {
?conc a skos:Concept .
?conc skos:prefLabel|skos:altLabel ?label .
FILTER(STRSTARTS(LCASE(?label), "t"))
}
ORDER BY ?label
{noformat}
There are around 3500 such labels and this query takes a bit less than 2
seconds for me currently. The results are of course not properly collated; the
previous examples of invalid Finnish collation are all within this result set.
Ideally, the query shouldn't take much longer with proper collation, but we'll
see.
> Language-specific collation in ARQ
> ----------------------------------
>
> Key: JENA-1313
> URL: https://issues.apache.org/jira/browse/JENA-1313
> Project: Apache Jena
> Issue Type: Improvement
> Components: ARQ
> Affects Versions: Jena 3.2.0
> Reporter: Osma Suominen
>
> As [discussed|http://markmail.org/message/v2bvsnsza5ksl2cv] on the users
> mailing list in October 2016, I would like to change ARQ collation of literal
> values to be language-aware and respect language-specific collation rules.
> This would probably involve changing at least the
> [NodeUtils.compareLiteralsBySyntax|https://github.com/apache/jena/blob/master/jena-arq/src/main/java/org/apache/jena/sparql/util/NodeUtils.java#L199]
> method.
> It currently sorts by lexical value first, then by language tag. Since the
> collation order needs to be stable across all possible literal values, I
> think the safest way would be to sort by language tag first, then by lexical
> value according to the collation rules for that language.
> But what about subtags like {{@en-US}} or {{@pt-BR}}? Can they have different
> collation rules than the main language? It would be a bit strange if all
> {{@en-US}} literals sorted after {{@en}} literals...
> It would be good to check how Dydra does this and possibly take the same
> approach. See the message linked above for further backgound.
> I've been talking with [~kinow] about this and he may be interested in
> implementing it.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
