I don't think I am someone "in-the-know" but here are a few more points:
1) including more of the info specified in IMPORTANT: Improving issue management https://groups.google.com/forum/#!topic/orient-database/uDqnWjQ0uJE would probably be helpful. Minimally what version of orientdb you are using. Telling more about the shape of your data, properties and indices could be helpful too. 2) This page of the doc describes the WAL stuff and says how to disable it. http://orientdb.com/docs/last/orientdb.wiki/Write-Ahead-Log.html This page of the doc has more performance help http://orientdb.com/docs/last/orientdb.wiki/Configuration.html 3) My previous post established that the .sbc files are probably indices of some sort. looking at the files in a database, I see examples of these sbc files: ./multi/collections_13.sbc inspecting the schema for that db shows I have some EMBEDDEDSET properties and an index on some. I do not want to do this now but you could experiment with creating different dbs, for example: i) create one without collection-like properties (no EMBEDDEDSET, etc) ii) create one with collection-like properties (EMBEDDEDSET, etc) iii) create one with collection-like properties and create and index iii) add a large amount of data to some of the previous dbs and see how that affects the file existence/sizes. do some debugging/science! 4) You can take a look at the code to try to figure more stuff out, this file might be relevant: https://github.com/orientechnologies/orientdb/blob/master/client/src/main/java/com/orientechnologies/orient/client/remote/OSBTreeBonsaiRemote.java 5) double/triple posting rapidly is rude! On Thursday, April 16, 2015 at 3:04:41 PM UTC-7, [email protected] wrote: > > > No one? > > On Thursday, 16 April 2015 09:20:14 UTC, [email protected] wrote: >> >> Hi, >> >> I think this is quite a serious matter that demands attention from those >> in-the-know. >> >> Can someone please share a light on what these *.sbc* files are and what >> can be done to keep *.wal* and *.sbc* files in check. >> >> Regards, >> -Stefán >> >> >> On Wednesday, 15 April 2015 08:53:56 UTC, [email protected] >> wrote: >>> >>> Hi, >>> >>> Thank you for the links. >>> >>> I'm running a test now to see how these are accumulated and the .sbc and >>> .wal files take up 2/3 of the total storage space (1/3 each). >>> >>> Viewing the content of the .sbc files reviles nothing as they seem to >>> contain the same "garbage"-patter repeatedly. >>> >>> I'm quite concerned because this (alleged) storage inefficiency is >>> affecting our plans. >>> >>> Can someone that knows please chime in? (I'm hoping this is a >>> settings/configuration mistake on my behalf) >>> >>> Regards, >>> -Stefán >>> >>> >>> >>> >>> On Tuesday, 14 April 2015 18:15:11 UTC, [email protected] wrote: >>>> >>>> This part of the docs detail what the various extensions mean, however >>>> I do not see a ".sbc" >>>> http://orientdb.com/docs/last/orientdb.wiki/Paginated-Local-Storage.html >>>> >>>> >>>> This part of the javadoc lists ".sbc" as the default extension for >>>> >>>> "com.orientechnologies.orient.core.db.record.ridbag.sbtree.OSBTreeCollectionManagerAbstract" >>>> http://orientdb.com/javadoc/latest/constant-values.html >>>> >>>> I'm still not sure what ".sbc" means but it looks like it represents >>>> some sort of index structure, hopefully those links are helpful. >>>> >>>> On Tuesday, April 14, 2015 at 12:14:58 AM UTC-7, >>>> [email protected] wrote: >>>>> >>>>> Hi, >>>>> >>>>> Can you at least tell me what these *.sbc* files are? >>>>> >>>>> Regards, >>>>> -Stefan >>>>> >>>>> On Monday, 13 April 2015 12:13:13 UTC, [email protected] >>>>> wrote: >>>>>> >>>>>> Hi, >>>>>> >>>>>> I'm running Orientdb for a relatively "small" project and the storage >>>>>> space taken by OrientDB puzzles me quite a bit. >>>>>> >>>>>> I have 12 million "empty (not light)" edges (12.271.168) taking up >>>>>> *850mb* of storage space. >>>>>> I also have *25G* worth of *.sbc* files even though the data files >>>>>> are "only" about *1G.* >>>>>> >>>>>> Am I doing something obviously wrong or ? >>>>>> >>>>>> Regards, >>>>>> -Stefán >>>>>> >>>>>> >>>>>> >>>>>> -- --- You received this message because you are subscribed to the Google Groups "OrientDB" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/d/optout.
