RE: Tried to compact a live TDB2 dataset using Lucene engine but failed

[李惠玲]

Hi,

To Lorenz:
Yes, we are using SNAPSHOT version.

To Andy:
We tried using "http://location:8080/fuseki/$/compact/lod " to run online 
compact

And here is the config file:
================================================================================
@prefix :      <http://base/#> .
@prefix rdf:   <http://www.w3.org/1999/02/22-rdf-syntax-ns#> .
@prefix tdb2:  <http://jena.apache.org/2016/tdb#> .
@prefix ja:    <http://jena.hpl.hp.com/2005/11/Assembler#> .
@prefix rdfs:  <http://www.w3.org/2000/01/rdf-schema#> .
@prefix fuseki: <http://jena.apache.org/fuseki#> .
@prefix text:  <http://jena.apache.org/text#> .
@prefix madsrdf: <http://www.loc.gov/mads/rdf/v1#> .

tdb2:DatasetTDB  rdfs:subClassOf  ja:RDFDataset .

ja:DatasetTxnMem  rdfs:subClassOf  ja:RDFDataset .

<http://jena.hpl.hp.com/2008/tdb#DatasetTDB>
        rdfs:subClassOf  ja:RDFDataset .

<http://jena.hpl.hp.com/2008/tdb#GraphTDB>
        rdfs:subClassOf  ja:Model .

tdb2:GraphTDB2  rdfs:subClassOf  ja:Model .

ja:MemoryDataset  rdfs:subClassOf  ja:RDFDataset .

ja:RDFDatasetZero  rdfs:subClassOf  ja:RDFDataset .

<http://jena.apache.org/text#TextDataset>
        rdfs:subClassOf  ja:RDFDataset .

:service_tdb_all  a                       fuseki:Service ;
        rdfs:label                        "TDB2 lod" ;
        fuseki:name                       "lod" ;      
        
        fuseki:endpoint [
            fuseki:operation fuseki:query ;
            fuseki:name "query" ;
        ] ;
        fuseki:endpoint [
            fuseki:operation fuseki:gsp-r ;
            fuseki:name "get" ;
        ] ;
        fuseki:endpoint [ 
            fuseki:operation fuseki:gsp-rw ; 
            fuseki:name "data" ;
            #fuseki:allowedUsers "*" ;
        ] ; 
        fuseki:endpoint [
            fuseki:operation fuseki:update ;
            fuseki:name "update" ;
            #fuseki:allowedUsers "*" ;
        ] ; 
        fuseki:endpoint [ 
            fuseki:operation fuseki:upload ;
            fuseki:name "upload" ;
            #fuseki:allowedUsers "*" ;
        ] ;

        fuseki:dataset                    <#dataset_fulltext> .

<#dataset_fulltext> rdf:type     text:TextDataset ;
    text:dataset     <#tdb_dataset_readwrite> ;
    text:index       <#indexLucene> .

<#indexLucene> a text:TextIndexLucene ;
    text:directory  <file:luceneIndex/lod> ;    
    text:entityMap <#entMap> ;
    text:storeValues true ; 
    text:analyzer [ 
        a text:StandardAnalyzer 
    ] ;    
    text:queryAnalyzer [
        a text:StandardAnalyzer 
    ] ;
    text:queryParser text:AnalyzingQueryParser ;    
    text:multilingualSupport true . # optional

<#entMap> a text:EntityMap ;
    text:defaultField     "authoritativeLabel" ; 
    text:entityField      "uri" ;
    text:uidField         "uid" ;
    text:langField        "lang" ;
    text:graphField       "graph" ;
    text:map (
        [ text:field "authoritativeLabel" ; text:predicate 
madsrdf:authoritativeLabel]
        [ text:field "variantLabel" ; text:predicate madsrdf:variantLabel]
        [ text:field "citation-note" ; text:predicate madsrdf:citation-note]
        [ text:field "citation-source" ; text:predicate madsrdf:citation-source]
    ) .

<#tdb_dataset_readwrite>
        a              tdb2:DatasetTDB2 ;
        tdb2:unionDefaultGraph true ;
        tdb2:location  "apache-jena-fuseki/databases/lod" .

tdb2:GraphTDB  rdfs:subClassOf  ja:Model .

ja:RDFDatasetOne  rdfs:subClassOf  ja:RDFDataset .

ja:RDFDatasetSink  rdfs:subClassOf  ja:RDFDataset .

tdb2:DatasetTDB2  rdfs:subClassOf  ja:RDFDataset .

==============================================================================

Thank you for your kindly help.

Regards,
Huiling Lee

-----Original Message-----
From: Andy Seaborne <a...@apache.org> 
Sent: Friday, December 4, 2020 6:20 PM
To: users@jena.apache.org
Subject: Re: Tried to compact a live TDB2 dataset using Lucene engine but failed

Hi - without a config file it's not tpossible to be definitive.

A guess - are you applying compact to the text dataset (which may use
TDbB2 for storage)? A text dataset may have various different storages.

I think you will need to directly expose the TDB2 dataset and send the 
"compact" request to that.

     Andy

On 04/12/2020 10:08, Lorenz Buehmann wrote:
> without seeing the config file it's just a guess, but did you use TDB 
> or TDB2?
>
> Please share the config file.
>
> Minor: there is no 3.18.0 release unless you're using the SNAPSHOT 
> version for whatever reason.
>
> On 04.12.20 10:45, 李惠玲 wrote:
>> Our project implemented Jena Fuseki server (3.18.0) and using Lucene (7.7.x) 
>> as fulltext search engine.
>> As for the doc<https://jena.apache.org/documentation/tdb2/tdb2_admin.html> 
>> from jena.apache.org, it's possible to run a live compaction on TDB2 
>> dataset, which we tried to do, but we got error message says "Not a TDB2 
>> dataset: Compact only applies to TDB2".
>> We are confused and don't know where the problem may be, could someone help 
>> to figure out?
>>
>> Thanks!