Peter Kostelnik, PhD.
Mon, 31 May 2010 05:24:55 -0700
hi, thanks, ivan, the current configuration is as follows (right now we are experimenting with various configs) ::
"ruleset" -> "empty",
"build-pcsot" -> "true",
"build-ptsoc" -> "true", // we'll try to turn it off
"cache-memory" -> "384M", // the point for experiments
"predicate-memory" -> "56M", // queries don't use wildcard predicates
"enable-optimization" -> "true",
"entity-index-size" -> "20000000",
"fts-memory" -> "0M", // we are building our own lucene index
"storage-folder" -> "bigowlim-store",
"repository-type" -> "file-repository",
"console-thread" -> "false"
last time, the run was something like:
./import <options> -Dcache-memory=7000m -Xmx9000m -Xms256m
all data are imported through conn.add(x, y, z, ctx1, ctx2) in a single
transaction commited when all data are inside ..
(btw, on 3.2.a7 snapshot we were able to get them in with practically
default configuration)
thanks in advance,
Peter K.
> Hi Peter,
>
> The tripleset component is a 5-th dimension of the RDF space (subject,
> predicate, object and context being the first four). This component cannot
> be
> used through the Sesame API which is why you never knew it existed. In
> short,
> you don't need to enable this index, it won't help.
>
> You need to tune the memory parameters (e.g. tuple-index-memory,
> predicate-memory, cache-memory, etc.) if you experience memory issues. Can
> you post here your current configuration and also how much memory it
> requires
> to load 100M statements?
>
>
> Cheers,
> Ivan
>
> On Monday 31 May 2010 15:03:32 Peter Kostelnik, PhD. wrote:
>> hi there ..
>>
>> I'd like to ask, what exactly means the tripleset, for which the ptsoc
>> index can be build? .. we are wandering which indices to build when
>> loading the data (as we are often using context based querying, I know,
>> that we have to build pcsot for sure .. )
>>
>> btw, which configuration parameters can affect the load of data (e.g.
>> enable-optimization?)? .. we've faced the strange memory consuming
>> behaviour when loading cca. 100 milions of statements ..
>>
>> thanks in advance,
>> Peter K.
>>
>> _______________________________________________
>> OWLIM-discussion mailing list
>> OWLIM-discussion@ontotext.com
>> http://ontotext.com/mailman/listinfo/owlim-discussion
>
_______________________________________________
OWLIM-discussion mailing list
OWLIM-discussion@ontotext.com
http://ontotext.com/mailman/listinfo/owlim-discussion