On 11 Aug 2011, at 15:46, Tsuyoshi Ito wrote:

> Hi Henry
> 
> I think it is not a OS X bug. I have the same issue on my ubuntu. BTW Reto is 
> also working on a linux distribution.

Ok, so it's a OSX and ubuntu bug then :-) Solaris does not have the problem. 
Btw. I am using java7 on both osx and solaris.
It's probably worth reporting that.


> I am pretty sure that few months ago the graphs were very small when 
> launching the platform the first time.
> 
> IMO our sesame provider is not an alternative because it is extremely slow 
> compared to tdb. that's why trialox has changed the default provider to tdb 
> in 2009.

Sesame has a large number of sails. Which one(s) were slow?
Btw http://www.systap.com/bigdata.htm looks very interesting. I suppose the GPL 
license is problematic.


Henry

> 
> Cheers
> Tsuy
> 
> On Aug 11, 2011, at 2:15 PM, Henry Story wrote:
> 
>> 
>> On 11 Aug 2011, at 10:56, Henry Story wrote:
>> 
>>> 
>>> On 10 Aug 2011, at 15:59, Tsuyoshi Ito wrote:
>>> 
>>>> Hi 
>>>> 
>>>> I tried to copy a felix-cache (latest platform without additional 
>>>> resources in the graphs) from one pc to another. During the copy process I 
>>>> realized that each graph is exactly 201,4MB on my mac. So a platform with 
>>>> no extra data is about 1.2GB - quite big. Each additional graph is using 
>>>> also 200MB.
>>>> 
>>>> Has this to do with the update of tdb? 3-4 month ago a graph with no 
>>>> triples was very small.
>>>> 
>>>> Is it possible to reduce the file size?
>> 
>> It looks like this is a OSX bug. On Solaris with my live version of clerezza 
>> at 
>>  http://foafssl.org/srv/idp
>> which has been running for a few days now, and which has a few graphs I get 
>> reasonable graph sizes
>> 
>> $ du -h -d 2 felix-cache/bundle100       
>> 15K   felix-cache/bundle100/version0.0
>> 226K   
>> felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Fid.myopenlink.net%2Fdataspace%2Fperson%2FKingsleyUyiIdehen1
>> 225K   
>> felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Ffoaf.me%2Fflorent
>> 226K   
>> felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Fdata.kontroversen.de%2Ffoaf.rdf
>> 227K   
>> felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Fwebid.myxwiki.org%2Fxwiki%2Fbin%2Fview%2FXWiki%2Fsnapgull
>> 231K   
>> felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Fwww.anjeve.de%2Ffoaf.rdf
>> 225K   
>> felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Fwww.turnguard.com%2Fturnguard
>> 228K   
>> felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Fwebid.myxwiki.org%2Fxwiki%2Fbin%2Fview%2FXWiki%2Ffish2010
>> 224K   
>> felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Fdavelevy.info%2Ffoaf.rdf
>> 224K   
>> felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Ffoaf.me%2Fgihandias
>> 225K   
>> felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Fbblfish.net%2F
>> 258K   
>> felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Fbblfish.net%2Fpeople%2Fhenry%2Fcard
>> 225K   
>> felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Fmelvincarvalho.com%2F
>> 227K   
>> felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Fid.myopenlink.net%2Fdataspace%2Fperson%2Ftthibodeau
>> 223K   
>> felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Ftbox.graph
>> 223K   
>> felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Fcgulls.dontexist.org%2Fwebid%2Fwebid.php%3Fname%3Dniclas
>> 223K   
>> felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Fwww.bergnet.org%2Fpeople%2Fbergi%2Fcard
>> 228K   
>> felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Fwww.w3.org%2FPeople%2FBerners-Lee%2Fcard
>> 224K   
>> felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Ffoaf.me%2Fdguardiola
>> 224K   
>> felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Ffoaf.me%2Fah1
>> 224K   
>> felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Fwebid.fcns.eu%2Fpeople%2Fgebhardt%2Fcard
>> 226K   
>> felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Fbigasterisk.com%2Ffoaf.rdf
>> 223K   
>> felix-cache/bundle100/data/tdb-data/graph/urn%3Ax-localinstance%3A%2Fcache%2Fhttp%3A%2F%2Ftest.com%2F
>> 4.9M   felix-cache/bundle100/data/tdb-data/graph
>> 222K   
>> felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Ffoaf.me%2Fdguardiola
>> 222K   
>> felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Fwebid.myxwiki.org%2Fxwiki%2Fbin%2Fview%2FXWiki%2Fsnapgull
>> 222K   
>> felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Fid.myopenlink.net%2Fdataspace%2Fperson%2FKingsleyUyiIdehen1
>> 223K   
>> felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fcontent.graph
>> 227K   
>> felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fsystem.graph
>> 222K   
>> felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Fwebid.myxwiki.org%2Fxwiki%2Fbin%2Fview%2FXWiki%2Ffish2010
>> 227K   
>> felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fconfig.graph
>> 222K   
>> felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Fbblfish.net%2F
>> 222K   
>> felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Fwww.bergnet.org%2Fpeople%2Fbergi%2Fcard
>> 222K   
>> felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Fmelvincarvalho.com%2F
>> 228K   
>> felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fgraph-access.graph
>> 608K   
>> felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fweb-resources-cache.graph1312967243159
>> 222K   
>> felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Fwebid.fcns.eu%2Fpeople%2Fgebhardt%2Fcard
>> 222K   
>> felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Fcgulls.dontexist.org%2Fwebid%2Fwebid.php%3Fname%3Dniclas
>> 222K   
>> felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Fcgulls.dontexist.org%2F%7Efiona%2Ffiona.rdf
>> 222K   
>> felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Ffoaf.me%2Fgihandias
>> 222K   
>> felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Fdata.kontroversen.de%2Ffoaf.rdf
>> 224K   
>> felix-cache/bundle100/data/tdb-data/mgraph/https%3A%2F%2Fbblfish.net%2Fuser%2Fadmin%2Fprofile
>> 222K   
>> felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Fid.myopenlink.net%2Fdataspace%2Fperson%2Ftthibodeau
>> 222K   
>> felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Ffoaf.me%2Fflorent
>> 222K   
>> felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Fcgulls.dontexist.org%2F%7Efiona%2Ffiona.xml
>> 222K   
>> felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Ftest.com%2F
>> 222K   
>> felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Fwww.turnguard.com%2Fturnguard
>> 222K   
>> felix-cache/bundle100/data/tdb-data/mgraph/urn%3Ax-localinstance%3A%2Fuser%2Fhttp%3A%2F%2Fbblfish.net%2Fpeople%2Fhenry%2Fcard
>> 5.6M   felix-cache/bundle100/data/tdb-data/mgraph
>> 11M   felix-cache/bundle100/data/tdb-data
>> 11M   felix-cache/bundle100/data
>> 11M   felix-cache/bundle100
>> 
>> It would be interesting to compare those sizes with Sesame. 
>> 
>> 
>>> 
>>> Thanks for pointing that out. I just checked the size of bundle 100 and 
>>> just on my pretty empty test
>>> database that I run locally and delete every so often, it is 1.5GB!
>>> 
>>> $ du -d 2 -h felix-cache/bundle100/
>>> 1.5G        felix-cache/bundle100//data/tdb-data
>>> 1.5G        felix-cache/bundle100//data
>>> 16K felix-cache/bundle100//version0.0
>>> 1.5G        felix-cache/bundle100/
>>> 
>>> So for the Social Web applications I am working where I would like to work 
>>> with a lot of graphs, this is not good. I'd like to know the reason for 
>>> this. But it does look like a reason to switch to Sesame otherwise...
>>> 
>>> Henry
>>> 
>>> 
>>>> 
>>>> 
>>>> Cheers
>>>> Tsuy
>>>> 
>>> 
>>> Social Web Architect
>>> http://bblfish.net/
>>> 
>> 
>> Social Web Architect
>> http://bblfish.net/
>> 
> 
> --trialox ag--------------------------------------
> 
> Tsuyoshi Ito
> Hardturmstrasse 101
> CH-8005 Zürich
> URL: http://trialox.org
> 

Social Web Architect
http://bblfish.net/

Reply via email to