After one analysis job the following resources were used: - disk space in sling/felix/bundle85/data/tdb-data/mgraph raised from 1.8M to 5.5M. - open files by java process raised from 734 to 1.681.
BR David On Fri, Mar 16, 2012 at 11:53 AM, David Riccitelli <[email protected]>wrote: > Hoping these more details can help solve this issue: in order to restart > Stanbol I have to clear up the sling/felix/bundle85/data/tdb-data/mgraph/ > folder otherwise these files get loaded at start-up and the server breaks > with 'Too many open files'. > > BR > David > > > On Fri, Mar 16, 2012 at 11:49 AM, David Riccitelli <[email protected]>wrote: > >> I'll try to add more details on what is happening now: all the analysis >> jobs are failing because of this error: java.io.IOException: Too many open >> files. >> >> I found more than 1.300 ontonet files open by the *java* process: >> $ lsof | grep "mgraph/ontonet" | wc -l >> 1323 >> >> e.g. >> >> sling/felix/bundle85/data/tdb-data/mgraph/ontonet%3A%3Ainputstream%3Aontology49/OSP.idn >> >> sling/felix/bundle85/data/tdb-data/mgraph/ontonet%3A%3Ainputstream%3Aontology49/OSP.dat >> >> It's important to note that I am the only user on this stanbol instance >> and the error is raised at the second analysis. >> >> I think I can easily help you reproduce this issue in case. >> >> BR >> David >> >> On Fri, Mar 16, 2012 at 11:44 AM, Rupert Westenthaler < >> [email protected]> wrote: >> >>> Hi David, all >>> >>> this could be the explanation for the failed build on the Jenkins server >>> when the SEO configuration for the Refactor engine was used in the default >>> configuration of the Full launcher >>> >>> see http://markmail.org/message/sprwklaobdjankig for details. >>> >>> For me that looks like as if the RefactorEngine does create multiple >>> Jena TDB instances for various created MGraphs. One needs to know the even >>> for an empty graph Jena TDB creates ~200MByte of index files. So it is >>> important to map multiple MGraphs to different named graphs of the same >>> Jena TDB store. >>> >>> I have no Idea how Clerezza manages this or how Ontonet creates MGraphs, >>> but I hope this can help in tracing this down. >>> >>> best >>> Rupert >>> >>> On 16.03.2012, at 10:30, David Riccitelli wrote: >>> >>> > Dears, >>> > >>> > As I ran into disk issues, I found that this folder: >>> > sling/felix/bundleXXX/data/tdb-data/mgraph >>> > >>> > where XX is the bundle of: >>> > Clerezza - SCB Jena TDB Storage Provider >>> > org.apache.clerezza.rdf.jena.tdb.storage >>> > >>> > took almost 70 gbytes of disk space (then the disk space has been >>> > exhausted). >>> > >>> > These are some of the files I found inside: >>> > 193M ./ontonet%3A%3Ainputstream%3Aontology889 >>> > 193M ./ontonet%3A%3Ainputstream%3Aontology1041 >>> > 193M ./ontonet%3A%3Ainputstream%3Aontology395 >>> > 193M ./ontonet%3A%3Ainputstream%3Aontology363 >>> > 193M ./ontonet%3A%3Ainputstream%3Aontology661 >>> > 193M ./ontonet%3A%3Ainputstream%3Aontology786 >>> > 193M ./ontonet%3A%3Ainputstream%3Aontology608 >>> > 193M ./ontonet%3A%3Ainputstream%3Aontology213 >>> > 193M ./ontonet%3A%3Ainputstream%3Aontology188 >>> > 193M ./ontonet%3A%3Ainputstream%3Aontology602 >>> > >>> > >>> > Any clues? >>> > >>> > Thanks, >>> > David Riccitelli >>> > >>> > >>> ******************************************************************************** >>> > InsideOut10 s.r.l. >>> > P.IVA: IT-11381771002 >>> > Fax: +39 0110708239 >>> > --- >>> > LinkedIn: http://it.linkedin.com/in/riccitelli >>> > Twitter: ziodave >>> > --- >>> > Layar Partner Network< >>> http://www.layar.com/publishing/developers/list/?page=1&country=&city=&keyword=insideout10&lpn=1 >>> > >>> > >>> ******************************************************************************** >>> >>> >> >> >> -- >> David Riccitelli >> >> >> ******************************************************************************** >> InsideOut10 s.r.l. >> P.IVA: IT-11381771002 >> Fax: +39 0110708239 >> --- >> LinkedIn: http://it.linkedin.com/in/riccitelli >> Twitter: ziodave >> --- >> Layar Partner >> Network<http://www.layar.com/publishing/developers/list/?page=1&country=&city=&keyword=insideout10&lpn=1> >> >> ******************************************************************************** >> >> > > > -- > David Riccitelli > > > ******************************************************************************** > InsideOut10 s.r.l. > P.IVA: IT-11381771002 > Fax: +39 0110708239 > --- > LinkedIn: http://it.linkedin.com/in/riccitelli > Twitter: ziodave > --- > Layar Partner > Network<http://www.layar.com/publishing/developers/list/?page=1&country=&city=&keyword=insideout10&lpn=1> > > ******************************************************************************** > > -- David Riccitelli ******************************************************************************** InsideOut10 s.r.l. P.IVA: IT-11381771002 Fax: +39 0110708239 --- LinkedIn: http://it.linkedin.com/in/riccitelli Twitter: ziodave --- Layar Partner Network<http://www.layar.com/publishing/developers/list/?page=1&country=&city=&keyword=insideout10&lpn=1> ********************************************************************************
