Thanks Mike. Did the upgrade and so far so good. I've ran the same baseline queries, and haven't had any timeout issues yet. Looks like it fixed it.
Joel On Wed, Jul 30, 2014 at 11:44 AM, Michael Blakeley <[email protected]> wrote: > The latest release is 7.0-3 and includes several bug fixes related to > triples and SPARQL. So I'd try upgrading first, and see if that helps. > > -- Mike > > On 30 Jul 2014, at 09:15 , Joel Ruisi <[email protected]> wrote: > > > Thanks Mike. I did use query-meters, and cache misses were pretty low, > at about 2% of the total hits. One thing I noticed is that when I turn > optimization off ("optimize=0"), the query runs fine. When optimize is set > to 1 or 2, I start seeing the timeout issues again. Any thoughts on that? > > > > Thanks, > > > > Joel > > > > > > On Wed, Jul 30, 2014 at 12:10 PM, Michael Blakeley <[email protected]> > wrote: > > The latest release is 7.0-3 and includes several bug fixes related to > triples and SPARQL. So I'd try upgrading first, and see if that helps. > > > > If that doesn't help, it could be that it works when enough data is in > cache, and times out when it has to do too much I/O because data isn't > cached. You might take a look at http://{$hostname}:8002/history/ and see > if you can correlate that activity with your queries. Or watch > http://{$hostname}:8002/dashboard/load/ > while running the query, and watch the query read load. > > > > It might also be revealing to wrap the sparql in XQuery, so you can get > xdmp:query-meters() output. In qconsole you'd set the "Query Type" selector > to "XQuery". > > > > sem:sparql('SELECT ...') > > , > > xdmp:query-meters() > > > > That will only show output if the query succeeds. You might be able to > show how far the query got before timing out with a try-catch expression: > > > > try { > > sem:sparql('SELECT...') > > } catch($ex) { $ex } > > , > > xdmp:query-meters() > > > > Either way the data on cache hits and misses might tell us something. > > > > -- Mike > > > > On 30 Jul 2014, at 08:29 , Joel Ruisi <[email protected]> wrote: > > > > > I'm having a problem with a SPARQL query that sometimes works fine, > and other times times out. Most of the time it times out. I'm running it > through qconsole using sem:sparql. > > > > > > Marklogic Version: 7.0-2.3 > > > > > > Here's an example of the query: > > > > > > SELECT DISTINCT ?test1 ?test2 ?test3 ?test4 ?test5 ?test6 ?test7 ?graph > > > FROM NAMED <rdf> > > > > > > WHERE { > > > GRAPH ?graph { > > > ?person pref:name "Test" . > > > ?person rdf:type <http://test/tester.owl#Person> . > > > > > > ?object stef:name ?test1 . > > > ?object rdf:type equip:Object . > > > ?object pref:directType ?test5 . > > > ?object daf:UUID ?test7 . > > > > > > ?test4 pref:associatedWith ?person . > > > ?test4 pref:associatedWith ?object . > > > ?test4 msg:containedIn ?Message . > > > > > > ?Message msg:nodeId ?test6 . > > > ?Message pref:directType ?test3 . > > > ?Message msg:messageURI ?test2 . > > > ?Message rdf:type ?test3 . > > > ?Message msg:validMessage "true" . > > > } > > > } > > > > > > I've enabled some trace flags, and here is the output for the failed > query: > > > > > > [Event:id=SPARQL AST] sessionKey=1530478562463724765 > > > 2014-07-30 14:07:59.023 Info: plan=SPARQLModule[ > > > 2014-07-30 14:07:59.023 Info: Prolog[] > > > 2014-07-30 14:07:59.023 Info: > SPARQLSelect[SPARQLDistinct[SPARQLProject[order() > > > 2014-07-30 14:07:59.023 Info: GraphNode[Var name 0] > > > 2014-07-30 14:07:59.023 Info: GraphNode[Var message 1] > > > 2014-07-30 14:07:59.023 Info: GraphNode[Var messageType 2] > > > 2014-07-30 14:07:59.023 Info: GraphNode[Var event 3] > > > 2014-07-30 14:07:59.023 Info: GraphNode[Var equipmentType 4] > > > 2014-07-30 14:07:59.023 Info: GraphNode[Var nodeId 5] > > > 2014-07-30 14:07:59.023 Info: GraphNode[Var uniqueId 6] > > > 2014-07-30 14:07:59.023 Info: GraphNode[Var graph 7] > > > 2014-07-30 14:07:59.023 Info: SPARQLScatterJoin[order(8,7) > hash(7==7,8==8,10==10) > > > 2014-07-30 14:07:59.023 Info: SPARQLBloomJoin[order(9,0,7) > hash(7==7,9==9,10==10) > > > 2014-07-30 14:07:59.023 Info: > SPARQLBloomJoin[order(3,10,7) hash(7==7,8==8) > > > 2014-07-30 14:07:59.023 Info: TriplePattern[order(8,7) > OPS > > > 2014-07-30 14:07:59.023 Info: GraphNode[Var hvi 8] > > > 2014-07-30 14:07:59.023 Info: GraphNode[IRI < > http://test#name>] > > > 2014-07-30 14:07:59.023 Info: GraphNode[Literal > "HOLMES"] > > > 2014-07-30 14:07:59.023 Info: GraphNode[Var graph 7]] > > > 2014-07-30 14:07:59.023 Info: > SPARQLScatterJoin[order(3,10,7) hash(3==3,7==7) > > > 2014-07-30 14:07:59.023 Info: > SPARQLScatterJoin[order(3,8,7) hash(3==3,7==7) > > > 2014-07-30 14:07:59.023 Info: > SPARQLBloomJoin[order(9,3,7) hash(7==7,9==9) > > > 2014-07-30 14:07:59.023 Info: > TriplePattern[order(9,7) OPS > > > 2014-07-30 14:07:59.023 Info: GraphNode[Var > equipment 9] > > > 2014-07-30 14:07:59.023 Info: GraphNode[IRI < > http://www.w3.org/1999/02/22-rdf-syntax-ns#type>] > > > 2014-07-30 14:07:59.023 Info: GraphNode[IRI < > http://test#Equipment>] > > > 2014-07-30 14:07:59.023 Info: GraphNode[Var > graph 7]] > > > 2014-07-30 14:07:59.023 Info: > TriplePattern[order(9,3,7) OPS > > > 2014-07-30 14:07:59.023 Info: GraphNode[Var > event 3] > > > 2014-07-30 14:07:59.023 Info: GraphNode[IRI < > http://test#associatedWith>] > > > 2014-07-30 14:07:59.023 Info: GraphNode[Var > equipment 9] > > > 2014-07-30 14:07:59.023 Info: GraphNode[Var > graph 7]]] > > > 2014-07-30 14:07:59.023 Info: > TriplePattern[order(3,8,7) PSO > > > 2014-07-30 14:07:59.023 Info: GraphNode[Var event > 3] > > > 2014-07-30 14:07:59.023 Info: GraphNode[IRI < > http://test#associatedWith>] > > > 2014-07-30 14:07:59.023 Info: GraphNode[Var hvi 8] > > > 2014-07-30 14:07:59.023 Info: GraphNode[Var graph > 7]]] > > > 2014-07-30 14:07:59.023 Info: > TriplePattern[order(3,10,7) PSO > > > 2014-07-30 14:07:59.023 Info: GraphNode[Var event 3] > > > 2014-07-30 14:07:59.023 Info: GraphNode[IRI < > http://test/Message.owl#containedIn>] > > > 2014-07-30 14:07:59.023 Info: GraphNode[Var Message > 10] > > > 2014-07-30 14:07:59.023 Info: GraphNode[Var graph > 7]]]] > > > 2014-07-30 14:07:59.023 Info: SPARQLHashJoin[order(9,0,7) > hash(7==7,9==9) > > > 2014-07-30 14:07:59.023 Info: > SPARQLHashJoin[order(9,6,7) hash(7==7,9==9) > > > 2014-07-30 14:07:59.023 Info: > SPARQLHashJoin[order(9,4,7) hash(7==7) > > > 2014-07-30 14:07:59.023 Info: > SPARQLHashJoin[order(10,1,7) hash(7==7,10==10) > > > 2014-07-30 14:07:59.023 Info: > SPARQLMergeJoin[order(10,2,7) hash(2==2,7==7,10==10) > > > 2014-07-30 14:07:59.023 Info: > TriplePattern[order(10,2,7) PSO > > > 2014-07-30 14:07:59.023 Info: GraphNode[Var > Message 10] > > > 2014-07-30 14:07:59.023 Info: GraphNode[IRI < > http://www.w3.org/1999/02/22-rdf-syntax-ns#type>] > > > 2014-07-30 14:07:59.023 Info: GraphNode[Var > messageType 2] > > > 2014-07-30 14:07:59.023 Info: GraphNode[Var > graph 7]] > > > 2014-07-30 14:07:59.023 Info: > TriplePattern[order(10,2,7) PSO > > > 2014-07-30 14:07:59.023 Info: GraphNode[Var > Message 10] > > > 2014-07-30 14:07:59.023 Info: GraphNode[IRI < > http://www.openrdf.org/schema/sesame#directType>] > > > 2014-07-30 14:07:59.023 Info: GraphNode[Var > messageType 2] > > > 2014-07-30 14:07:59.023 Info: GraphNode[Var > graph 7]]] > > > 2014-07-30 14:07:59.023 Info: > TriplePattern[order(10,1,7) PSO > > > 2014-07-30 14:07:59.023 Info: GraphNode[Var > Message 10] > > > 2014-07-30 14:07:59.023 Info: GraphNode[IRI < > http://test/Message.owl#messageURI>] > > > 2014-07-30 14:07:59.023 Info: GraphNode[Var > message 1] > > > 2014-07-30 14:07:59.023 Info: GraphNode[Var > graph 7]]] > > > 2014-07-30 14:07:59.023 Info: > TriplePattern[order(9,4,7) PSO > > > 2014-07-30 14:07:59.023 Info: GraphNode[Var > equipment 9] > > > 2014-07-30 14:07:59.023 Info: GraphNode[IRI < > http://www.openrdf.org/schema/sesame#directType>] > > > 2014-07-30 14:07:59.023 Info: GraphNode[Var > equipmentType 4] > > > 2014-07-30 14:07:59.023 Info: GraphNode[Var graph > 7]]] > > > 2014-07-30 14:07:59.023 Info: > TriplePattern[order(9,6,7) PSO > > > 2014-07-30 14:07:59.023 Info: GraphNode[Var > equipment 9] > > > 2014-07-30 14:07:59.023 Info: GraphNode[IRI < > http://test/daf.owl#UUID>] > > > 2014-07-30 14:07:59.023 Info: GraphNode[Var uniqueId > 6] > > > 2014-07-30 14:07:59.023 Info: GraphNode[Var graph > 7]]] > > > 2014-07-30 14:07:59.023 Info: TriplePattern[order(9,0,7) > PSO > > > 2014-07-30 14:07:59.023 Info: GraphNode[Var equipment > 9] > > > 2014-07-30 14:07:59.023 Info: GraphNode[IRI < > http://test/stef.owl#name>] > > > 2014-07-30 14:07:59.023 Info: GraphNode[Var name 0] > > > 2014-07-30 14:07:59.023 Info: GraphNode[Var graph 7]]]] > > > 2014-07-30 14:07:59.023 Info: SPARQLHashJoin[order(8,7) > hash(7==7) > > > 2014-07-30 14:07:59.023 Info: SPARQLHashJoin[order(10,5,7) > hash(7==7,10==10) > > > 2014-07-30 14:07:59.023 Info: TriplePattern[order(10,7) > SOP > > > 2014-07-30 14:07:59.023 Info: GraphNode[Var Message 10] > > > 2014-07-30 14:07:59.023 Info: GraphNode[IRI < > http://test/Message.owl#validMessage>] > > > 2014-07-30 14:07:59.023 Info: GraphNode[Literal "true"] > > > 2014-07-30 14:07:59.023 Info: GraphNode[Var graph 7]] > > > 2014-07-30 14:07:59.023 Info: > TriplePattern[order(10,5,7) PSO > > > 2014-07-30 14:07:59.023 Info: GraphNode[Var Message 10] > > > 2014-07-30 14:07:59.023 Info: GraphNode[IRI < > http://test/Message.owl#nodeId>] > > > 2014-07-30 14:07:59.023 Info: GraphNode[Var nodeId 5] > > > 2014-07-30 14:07:59.023 Info: GraphNode[Var graph 7]]] > > > 2014-07-30 14:07:59.023 Info: TriplePattern[order(8,7) SOP > > > 2014-07-30 14:07:59.023 Info: GraphNode[Var hvi 8] > > > 2014-07-30 14:07:59.023 Info: GraphNode[IRI < > http://www.w3.org/1999/02/22-rdf-syntax-ns#type>] > > > 2014-07-30 14:07:59.023 Info: GraphNode[IRI < > http://test/Agent.owl#Person>] > > > 2014-07-30 14:07:59.023 Info: GraphNode[Var graph > 7]]]]]]]] > > > > > > Any help is appreciated, > > > > > > Thanks, > > > > > > Joel > > > _______________________________________________ > > > General mailing list > > > [email protected] > > > http://developer.marklogic.com/mailman/listinfo/general > > > > _______________________________________________ > > General mailing list > > [email protected] > > http://developer.marklogic.com/mailman/listinfo/general > > > > _______________________________________________ > > General mailing list > > [email protected] > > http://developer.marklogic.com/mailman/listinfo/general > > _______________________________________________ > General mailing list > [email protected] > http://developer.marklogic.com/mailman/listinfo/general >
_______________________________________________ General mailing list [email protected] http://developer.marklogic.com/mailman/listinfo/general
