Thank you for the pointers Kyle. This storage space quantity makes no sense at all when looking at the data that I have stored and *.sbc* files "seem" to include only a repeated pattern and in no "sensible" proportions.
Regards, -Stefán On Friday, 17 April 2015 01:17:25 UTC, Kyle wrote: > > I don't think I am someone "in-the-know" but here are a few more points: > > 1) > including more of the info specified in > IMPORTANT: Improving issue management > https://groups.google.com/forum/#!topic/orient-database/uDqnWjQ0uJE > > would probably be helpful. > > Minimally what version of orientdb you are using. > Telling more about the shape of your data, properties and indices could be > helpful too. > > 2) > This page of the doc describes the WAL stuff and says how to disable it. > http://orientdb.com/docs/last/orientdb.wiki/Write-Ahead-Log.html > > This page of the doc has more performance help > http://orientdb.com/docs/last/orientdb.wiki/Configuration.html > > 3) > My previous post established that the .sbc files are probably indices of > some sort. > > looking at the files in a database, I see examples of these sbc files: > ./multi/collections_13.sbc > > inspecting the schema for that db shows I have some EMBEDDEDSET properties > and an index on some. > > I do not want to do this now but you could experiment with creating > different dbs, for example: > i) create one without collection-like properties (no EMBEDDEDSET, etc) > ii) create one with collection-like properties (EMBEDDEDSET, etc) > iii) create one with collection-like properties and create and index > iii) add a large amount of data to some of the previous dbs > > and see how that affects the file existence/sizes. do some > debugging/science! > > 4) > You can take a look at the code to try to figure more stuff out, this file > might be relevant: > > https://github.com/orientechnologies/orientdb/blob/master/client/src/main/java/com/orientechnologies/orient/client/remote/OSBTreeBonsaiRemote.java > > 5) double/triple posting rapidly is rude! > > On Thursday, April 16, 2015 at 3:04:41 PM UTC-7, [email protected] > wrote: >> >> >> No one? >> >> On Thursday, 16 April 2015 09:20:14 UTC, [email protected] wrote: >>> >>> Hi, >>> >>> I think this is quite a serious matter that demands attention from those >>> in-the-know. >>> >>> Can someone please share a light on what these *.sbc* files are and >>> what can be done to keep *.wal* and *.sbc* files in check. >>> >>> Regards, >>> -Stefán >>> >>> >>> On Wednesday, 15 April 2015 08:53:56 UTC, [email protected] >>> wrote: >>>> >>>> Hi, >>>> >>>> Thank you for the links. >>>> >>>> I'm running a test now to see how these are accumulated and the .sbc >>>> and .wal files take up 2/3 of the total storage space (1/3 each). >>>> >>>> Viewing the content of the .sbc files reviles nothing as they seem to >>>> contain the same "garbage"-patter repeatedly. >>>> >>>> I'm quite concerned because this (alleged) storage inefficiency is >>>> affecting our plans. >>>> >>>> Can someone that knows please chime in? (I'm hoping this is a >>>> settings/configuration mistake on my behalf) >>>> >>>> Regards, >>>> -Stefán >>>> >>>> >>>> >>>> >>>> On Tuesday, 14 April 2015 18:15:11 UTC, [email protected] wrote: >>>>> >>>>> This part of the docs detail what the various extensions mean, however >>>>> I do not see a ".sbc" >>>>> >>>>> http://orientdb.com/docs/last/orientdb.wiki/Paginated-Local-Storage.html >>>>> >>>>> >>>>> This part of the javadoc lists ".sbc" as the default extension for >>>>> >>>>> "com.orientechnologies.orient.core.db.record.ridbag.sbtree.OSBTreeCollectionManagerAbstract" >>>>> http://orientdb.com/javadoc/latest/constant-values.html >>>>> >>>>> I'm still not sure what ".sbc" means but it looks like it represents >>>>> some sort of index structure, hopefully those links are helpful. >>>>> >>>>> On Tuesday, April 14, 2015 at 12:14:58 AM UTC-7, >>>>> [email protected] wrote: >>>>>> >>>>>> Hi, >>>>>> >>>>>> Can you at least tell me what these *.sbc* files are? >>>>>> >>>>>> Regards, >>>>>> -Stefan >>>>>> >>>>>> On Monday, 13 April 2015 12:13:13 UTC, [email protected] >>>>>> wrote: >>>>>>> >>>>>>> Hi, >>>>>>> >>>>>>> I'm running Orientdb for a relatively "small" project and the >>>>>>> storage space taken by OrientDB puzzles me quite a bit. >>>>>>> >>>>>>> I have 12 million "empty (not light)" edges (12.271.168) taking up >>>>>>> *850mb* of storage space. >>>>>>> I also have *25G* worth of *.sbc* files even though the data files >>>>>>> are "only" about *1G.* >>>>>>> >>>>>>> Am I doing something obviously wrong or ? >>>>>>> >>>>>>> Regards, >>>>>>> -Stefán >>>>>>> >>>>>>> >>>>>>> >>>>>>> -- --- You received this message because you are subscribed to the Google Groups "OrientDB" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/d/optout.
