I think we will create LRU pool of storages so you may be able to keep memory consumption inside of boundaries. Any way how many storages do you plan to have ?
On Wed, Aug 26, 2015 at 5:14 PM Andrey Lomakin <[email protected]> wrote: > Hi, > In order to understand what is going on we need to have memory dump. > Also each storage instance has in memory resident data structures so the > more instances will you have the more heap memory you will consume, that is > for sure. > > How many storage instances do you need ? > > > > On Tue, Aug 25, 2015 at 6:24 PM <[email protected]> wrote: > >> Hi, >> >> I am running a service that creates some snapshot databases (plocal). >> I noticed a constant increase in the memory usage and breaks with OOM >> after some point. There other issues in the application which I am working >> on but also found some related to DB. >> >> To simulate the behavior, I tried to create 1000 dbs from a 4MB JSON >> file. The JSON file is deserialized once to java object and same objects >> are used to create all the database instances. >> I have a threadpool of size 5 i.e. 5 databases are created in parallel. I >> do not see an OOM in the test app but almost froze after 380 instances. >> Tests are run using 512 heap size to reproduce the issue early. >> >> I am using OPartitionedDatabasePool and closing the pool after each >> database instance is created and data is written. >> However pool.close does not close the storage, also WAL threads and Cache >> flush threads are retained for each instance even though those threads are >> not working much. >> Storages are closed at jvm shutdown for performance reasons and not when >> DB instance is not in use. >> >> The heap usage is growing constantly for each database instance created. >> How can I optimize this? >> I would assume the application should behave more or less same as at a >> time it is working only with 5 instances even though it has already created >> 300 instances. >> >> Also I am getting "max number of files open" in some linux flavors and >> had to override the max files open limit. >> >> *Below is the graphs from visualvm* >> >> First 5 instances >> >> >> <https://lh3.googleusercontent.com/-PA9IcVmGjy8/VdyC1g7yijI/AAAAAAAAAck/bolFqekEG4c/s1600/at5instances.png> >> >> 50 instances >> >> >> <https://lh3.googleusercontent.com/-4i2YmajZzpw/VdyDHpyMjrI/AAAAAAAAAcs/DkKTyziPeNs/s1600/at50instances.png> >> >> 350 Instances >> >> >> <https://lh3.googleusercontent.com/-sVtrYF9u4ak/VdyDKFwmhJI/AAAAAAAAAc0/b07vsBXuIOc/s1600/at350instances.png> >> >> Threads List at the point of 350 + instances. 2 Threads per instance. >> >> >> <https://lh3.googleusercontent.com/-16gIIu8Gndo/VdyDMLHKIdI/AAAAAAAAAc8/r4rGy_RGH2U/s1600/threadsat350instances.png> >> >> >> <https://lh3.googleusercontent.com/-hyEaDu5jRmo/VdyDOE3c0fI/AAAAAAAAAdE/f-uaDlxstEM/s1600/threadsat350instances1.png> >> >> -- >> >> --- >> You received this message because you are subscribed to the Google Groups >> "OrientDB" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to [email protected]. >> For more options, visit https://groups.google.com/d/optout. >> > -- --- You received this message because you are subscribed to the Google Groups "OrientDB" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/d/optout.
